Corby Rosset

Corby Rosset

Auto-generated profile, based on publicly available information

Corby Rosset

Microsoft, Redmond, WA, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 April 2023
Verified
Conference Paper
Open access
ZWZhenduo Wang
Zhenduo Wang
YTYuancheng Tu
Yuancheng Tu
CRCorby Rosset
Corby Rosset
NCNick Craswell
Nick Craswell
MWMing Wu
Ming Wu
QAQingyao Ai
Qingyao Ai
A long-standing challenge for search and conversational assistants is query intention detection in ambiguous queries. Asking clarifying questions in conversational search has been widely studied and considered an effective solution to resolve query ambiguity. Existing work have explored various approaches for clarifying question ranking and generation. However, due to the lack of real conversational search data, they have to use artificial datasets for training, which limits their generalizability to real-world search scenarios. As a result, the industry has shown reluctance to implement them in reality, further suspending the availability of real conversational search interaction data. The above dilemma can be formulated as a cold start problem of clarifying question generation and conversational search in general. Furthermore, even if we do have large-scale conversational logs, it is not realistic to gather training data that can comprehensively cover all possible queries and topics in open-domain search scenarios. The risk of fitting bias when training a clarifying question retrieval/generation model on incomprehensive dataset is thus another important challenge. In this work, we innovatively explore generating clarifying questions in a zero-shot setting to overcome the cold start problem and we propose a constrained clarifying question generation system which uses both question templates and query facets to guide the effective and precise question generation. The experiment results show that our method outperforms existing state-of-the-art zero-shot baselines by a large margin. Human annotations to our model outputs also indicate our method generates 25.2% more natural questions, 18.1% more useful questions, 6.1% less unnatural and 4% less useless questions.

13 May 2024
Verified
Conference Paper
Open access
QCQi Chen
Qi Chen
XGXiubo Geng
Xiubo Geng
CRCorby Rosset
Corby Rosset
CBCarolyn Buractaon
Carolyn Buractaon
JLJingwen Lu
Jingwen Lu
CZCe Zhang
Ce Zhang
Recent breakthroughs in large models have highlighted the critical significance of data scale, labels and modals. In this paper, we introduce MS MARCO Web Search, the first large-scale information-rich web dataset, featuring millions of real clicked query-document labels. This dataset closely mimics real-world web document and query distribution, provides rich information for various kinds of downstream tasks and encourages research in various areas, such as generic end-to-end neural indexer models, generic embedding models, and next generation information access system with large language models. MS MARCO Web Search offers a retrieval benchmark with three web retrieval challenge tasks that demands innovations in both machine learning and information retrieval system research domains. As the first dataset that meets large, real and rich data requirements, MS MARCO Web Search paves the way for future advancements in AI and system research. MS MARCO Web Search dataset is available at: https://github.com/microsoft/MS-MARCO-Web-Search.

13 July 2025
Verified
Conference Paper
Open access
CRCorbin Rosset
Corbin Rosset
HCHo-Lam Chung
Ho-Lam Chung
GQGuanghui Qin
Guanghui Qin
ECEthan Chau
Ethan Chau
ZFZhuo Feng
Zhuo Feng
NRNikhil Rao
Nikhil Rao