Greg Silverman

Mr. Greg Silverman

orcid

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

17 August 2023 in Journal of Healthcare Informatics Research
Verified
Journal Article
Closed access
PDF file
HZHuixue Zhou
Huixue Zhou
GSGreg Silverman
Greg Silverman
ZNZhongran Niu
Zhongran Niu
JSJenzi Silverman
Jenzi Silverman
RERoni Evans
Roni Evans
RZRui Zhang
Rui Zhang

20 September 2024 in Preprints.org
Verified
Preprint
Open access
PDF file
VTVedansh Thakkar
Vedansh Thakkar
GSGreg Silverman
Greg Silverman
AKAbhinab Kc
Abhinab Kc
NINicholas Elliott Ingraham
Nicholas Elliott Ingraham
EJEmma Kate Jones
Emma Kate Jones
CTChristopher J. Tignanelli
Christopher J. Tignanelli
Patient symptoms play a critical role in disease progression and diagnosis, yet they are most often captured in unstructured clinical notes. This study explores use of large language models (LLMs) for extracting patient symptoms from clinical notes, comparing their performance against rule-based information extraction (IE) systems, like BioMedICUS. By fine-tuning an LLM on diverse corpora from multiple healthcare institutions, we aimed to improve symptom extraction accuracy and efficiency with symptoms related to acute and post-acute sequelae of SARS-CoV-2. We also conducted prevalence analysis to highlight significant differences in symptom prevalence across corpora and performed fairness analysis to assess the model's equity across race and gender. Our findings indicate that while LLMs can match the effectiveness of rule-based IE methods, they face significant challenges related to demographic bias and generalizability due to variability in training corpora. This evaluation revealed overfitting and insufficient generalization, especially when models were trained predominantly on limited datasets with single annotator bias. This study also revealed that LLMs offer substantial advantages in efficiency, adaptability, and scalability for biomedical IE, marking a transformative shift in clinical data extraction processes. These results provide real-world evidence of the necessity for diverse, high-quality training datasets and robust annotation processes to enhance LLM’s performance and reliability in clinical applications.