Irene Li

Dr. Irene Li


Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 September 2022 in Computer Science Review
Verified
Journal Article
Closed access
ILIrene Li
Irene Li
JPJessica Pan
Jessica Pan
JGJeremy Goldwasser
Jeremy Goldwasser
NVNeha Verma
Neha Verma
WWWai Pan Wong
Wai Pan Wong
DRDragomir Radev
Dragomir Radev

19 November 2024 in Journal of Medical Internet Research
Verified
Journal Article
Open access
YKYuhe Ke
Yuhe Ke
RYRui Yang
Rui Yang
SLSui An Lie
Sui An Lie
TLTaylor Xin Yi Lim
Taylor Xin Yi Lim
YNYilin Ning
Yilin Ning
Nan LiuNan Liu
Nan Liu
Background: Cognitive biases in clinical decision-making significantly contribute to errors in diagnosis and suboptimal patient outcomes. Addressing these biases presents a formidable challenge in the medical field. Objective: This study aimed to explore the role of large language models (LLMs) in mitigating these biases through the use of the multi-agent framework. We simulate the clinical decision-making processes through multi-agent conversation and evaluate its efficacy in improving diagnostic accuracy compared with humans. Methods: A total of 16 published and unpublished case reports where cognitive biases have resulted in misdiagnoses were identified from the literature. In the multi-agent framework, we leveraged GPT-4 (OpenAI) to facilitate interactions among different simulated agents to replicate clinical team dynamics. Each agent was assigned a distinct role: (1) making the final diagnosis after considering the discussions, (2) acting as a devil’s advocate to correct confirmation and anchoring biases, (3) serving as a field expert in the required medical subspecialty, (4) facilitating discussions to mitigate premature closure bias, and (5) recording and summarizing findings. We tested varying combinations of these agents within the framework to determine which configuration yielded the highest rate of correct final diagnoses. Each scenario was repeated 5 times for consistency. The accuracy of the initial diagnoses and the final differential diagnoses were evaluated, and comparisons with human-generated answers were made using the Fisher exact test. Results: A total of 240 responses were evaluated (3 different multi-agent frameworks). The initial diagnosis had an accuracy of 0% (0/80). However, following multi-agent discussions, the accuracy for the top 2 differential diagnoses increased to 76% (61/80) for the best-performing multi-agent framework (Framework 4-C). This was significantly higher compared with the accuracy achieved by human evaluators (odds ratio 3.49; P=.002). Conclusions: The multi-agent framework demonstrated an ability to re-evaluate and correct misconceptions, even in scenarios with misleading initial investigations. In addition, the LLM-driven, multi-agent conversation framework shows promise in enhancing diagnostic accuracy in diagnostically challenging medical scenarios.

1 January 2024
Verified
Conference Paper
Open access
PDF file
RYRui Yang
Rui Yang
HLHaoran Liu
Haoran Liu
EMEdison Marrese-Taylor
Edison Marrese-Taylor
QZQingcheng Zeng
Qingcheng Zeng
YKYuhe Ke
Yuhe Ke
ILIrene Li
Irene Li
Rui Yang, Haoran Liu, Edison Marrese-Taylor, Qingcheng Zeng, Yuhe Ke, Wanxin Li, Lechao Cheng, Qingyu Chen, James Caverlee, Yutaka Matsuo, Irene Li. Proceedings of the 23rd Workshop on Biomedical Natural Language Processing. 2024.

14 September 2023
Verified
Conference Paper
Open access
BYBoming Yang
Boming Yang
DLDairui Liu
Dairui Liu
TSToyotaro Suzumura
Toyotaro Suzumura
RDRuihai Dong
Ruihai Dong
ILIrene Li
Irene Li
Precisely recommending candidate news articles to users has always been a core challenge for personalized news recommendation systems. Most recent works primarily focus on using advanced natural language processing techniques to extract semantic information from rich textual data, employing content-based methods derived from local historical news. However, this approach lacks a global perspective, failing to account for users’ hidden motivations and behaviors beyond semantic information. To address this challenge, we propose a novel model called GLORY (Global-LOcal news Recommendation sYstem), which combines global representations learned from other users with local representations to enhance personalized recommendation systems. We accomplish this by constructing a Global-aware Historical News Encoder, which includes a global news graph and employs gated graph neural networks to enrich news representations, thereby fusing historical news representations by a historical news aggregator. Similarly, we extend this approach to a Global Candidate News Encoder, utilizing a global entity graph and a candidate news aggregator to enhance candidate news representation. Evaluation results on two public news datasets demonstrate that our method outperforms existing approaches. Furthermore, our model offers more diverse recommendations1.

17 July 2019 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
ILIrene Li
Irene Li
AFAlexander R. Fabbri
Alexander R. Fabbri
RTRobert R. Tung
Robert R. Tung
DRDragomir R. Radev
Dragomir R. Radev
Recent years have witnessed the rising popularity of Natural Language Processing (NLP) and related fields such as Artificial Intelligence (AI) and Machine Learning (ML). Many online courses and resources are available even for those without a strong background in the field. Often the student is curious about a specific topic but does not quite know where to begin studying. To answer the question of “what should one learn first,”we apply an embedding-based method to learn prerequisite relations for course concepts in the domain of NLP. We introduce LectureBank, a dataset containing 1,352 English lecture files collected from university courses which are each classified according to an existing taxonomy as well as 208 manually-labeled prerequisite relation topics, which is publicly available 1. The dataset will be useful for educational purposes such as lecture preparation and organization as well as applications such as reading list generation. Additionally, we experiment with neural graph-based networks and non-neural classifiers to learn these prerequisite relations from our dataset.

8 December 2020
Verified
Book Chapter
Closed access
PDF file
ILIrene Li
Irene Li
YLYixin Li
Yixin Li
TLTianxiao Li
Tianxiao Li
SASergio Alvarez-Napagao
Sergio Alvarez-Napagao
DGDario Garcia-Gasulla
Dario Garcia-Gasulla
TSToyotaro Suzumura
Toyotaro Suzumura