Ryen W. White

Ryen W. White

Auto-generated profile, based on publicly available information

Ryen W. White

Microsoft Research, Redmond, WA, USA

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 December 2016 in Journal of Medical Internet Research
Verified
Journal Article
Open access
TATim Althoff
Tim Althoff
RWRyen W White
Ryen W White
EHEric Horvitz
Eric Horvitz
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet

7 March 2013 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
RWRyen W White
Ryen W White
NTNicholas P Tatonetti
Nicholas P Tatonetti
NSNigam H Shah
Nigam H Shah
RARuss B Altman
Russ B Altman
EHEric Horvitz
Eric Horvitz
Adverse drug events cause substantial morbidity and mortality and are often discovered after a drug comes to market. We hypothesized that Internet use

1 August 2016 in Journal of Oncology Practice
Verified
Journal Article
Closed access
JPJohn Paparrizos
John Paparrizos
RWRyen W. White
Ryen W. White
EHEric Horvitz
Eric Horvitz
Introduction: People’s online activities can yield clues about their emerging health conditions. We performed an intensive study to explore the feasibility of using anonymized Web query logs to screen for the emergence of pancreatic adenocarcinoma. The methods used statistical analyses of large-scale anonymized search logs considering the symptom queries from millions of people, with the potential application of warning individual searchers about the value of seeking attention from health care professionals. Methods: We identified searchers in logs of online search activity who issued special queries that are suggestive of a recent diagnosis of pancreatic adenocarcinoma. We then went back many months before these landmark queries were made, to examine patterns of symptoms, which were expressed as searches about concerning symptoms. We built statistical classifiers that predicted the future appearance of the landmark queries based on patterns of signals seen in search logs. Results: We found that signals about patterns of queries in search logs can predict the future appearance of queries that are highly suggestive of a diagnosis of pancreatic adenocarcinoma. We showed specifically that we can identify 5% to 15% of cases, while preserving extremely low false-positive rates (0.00001 to 0.0001). Conclusion: Signals in search logs show the possibilities of predicting a forthcoming diagnosis of pancreatic adenocarcinoma from combinations of subtle temporal signals revealed in the queries of searchers.

24 August 2024
Verified
Conference Paper
Open access
MWMengting Wan
Mengting Wan
TSTara Safavi
Tara Safavi
SJSujay Kumar Jauhar
Sujay Kumar Jauhar
YKYujin Kim
Yujin Kim
SCScott Counts
Scott Counts
NRNagu Rangan
Nagu Rangan
Transforming unstructured text into structured and meaningful forms, organized by useful category labels, is a fundamental step in text mining for downstream analysis and application. However, most existing methods for producing label taxonomies and building text-based label classifiers still rely heavily on domain expertise and manual curation, making the process expensive and time-consuming. This is particularly challenging when the label space is under-specified and large-scale data annotations are unavailable. In this paper, we address these challenges with Large Language Models (LLMs), whose prompt-based interface facilitates the induction and use of large-scale pseudo labels. We propose TnT-LLM, a two-phase framework that employs LLMs to automate the process of end-to-end label generation and assignment with minimal human effort for any given use-case. In the first phase, we introduce a zero-shot, multi-stage reasoning approach which enables LLMs to produce and refine a label taxonomy iteratively. In the second phase, LLMs are used as data labelers that yield training samples so that lightweight supervised classifiers can be reliably built, deployed, and served at scale. We apply TnT-LLM to the analysis of user intent and conversational domain for Bing Copilot (formerly Bing Chat), an open-domain chat-based search engine. Extensive experiments using both human and automatic evaluation metrics demonstrate that TnT-LLM generates more accurate and relevant label taxonomies when compared against state-of-the-art baselines, and achieves a favorable balance between accuracy and efficiency for classification at scale.

22 August 2025 in ACM Transactions on the Web
Verified
Journal Article
Open access
CSChirag Shah
Chirag Shah
RWRyen White
Ryen White
RAReid Andersen
Reid Andersen
GBGeorg Buscher
Georg Buscher
SCScott Counts
Scott Counts
LYLongqi Yang
Longqi Yang
Understanding user intents in information access scenarios can help us provide more relevant and personalized search results and recommendations. However, analyzing user intents is not easy, especially for emerging forms of Web search such as Artificial Intelligence (AI)-driven chat. To understand user intents from retrospective log data, we need a way to label them with meaningful categories that capture their diversity and dynamics. Existing methods rely on manual or Machine-Learned (ML) labeling, which is either expensive or inflexible for large and dynamic datasets. Large Language Models (LLMs) could generate rich and relevant concepts, descriptions, and examples for user intents using log data of user interactions. However, using LLMs to generate a user intent taxonomy and applying it for a given Information Retrieval (IR) application can be problematic for two main reasons: (1) such a taxonomy is not externally validated; and (2) there may be an undesirable feedback loop if an LLM does both these tasks without external validation. To address this, we propose a new methodology with human experts and assessors to verify the quality of the LLM-generated taxonomy. We also present an end-to-end pipeline that uses an LLM with Human-in-the-Loop (HITL) to produce, refine, and apply labels for user intent analysis in log data. We demonstrate its effectiveness by uncovering new insights into user intents from search and chat logs from the Microsoft Bing Web search engine. The novelty in this research stems from the method for generating purpose-driven user intent taxonomies with strong validation. Our approach not only helps remove methodological and practical bottlenecks from intent-focused research, but also provides a new framework for generating, validating, and applying other kinds of taxonomies in a scalable and adaptable way, with reasonable human effort.

26 August 2024 in Communications of the ACM
Verified
Journal Article
Open access
RWRyen W. White
Ryen W. White
Dek : AI agents are extending the capabilities of traditional search engines to help users tackle complex tasks.