Siddhi Ramesh

Siddhi Ramesh

Auto-generated profile, based on publicly available information

Siddhi Ramesh

Pritzker School of Medicine, University of Chicago, Chicago, IL, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 December 2022 in bioRxiv
Verified
Preprint
Open access
PDF file
CGCatherine A. Gao
Catherine A. Gao
FHFrederick M. Howard
Frederick M. Howard
NMNikolay S. Markov
Nikolay S. Markov
EDEmma C. Dyer
Emma C. Dyer
SRSiddhi Ramesh
Siddhi Ramesh
APAlexander T. Pearson
Alexander T. Pearson
Background Large language models such as ChatGPT can produce increasingly realistic text, with unknown information on the accuracy and integrity of using these models in scientific writing. Methods We gathered ten research abstracts from five high impact factor medical journals (n=50) and asked ChatGPT to generate research abstracts based on their titles and journals. We evaluated the abstracts using an artificial intelligence (AI) output detector, plagiarism detector, and had blinded human reviewers try to distinguish whether abstracts were original or generated. Results All ChatGPT-generated abstracts were written clearly but only 8% correctly followed the specific journal’s formatting requirements. Most generated abstracts were detected using the AI output detector, with scores (higher meaning more likely to be generated) of median [interquartile range] of 99.98% [12.73, 99.98] compared with very low probability of AI-generated output in the original abstracts of 0.02% [0.02, 0.09]. The AUROC of the AI output detector was 0.94. Generated abstracts scored very high on originality using the plagiarism detector (100% [100, 100] originality). Generated abstracts had a similar patient cohort size as original abstracts, though the exact numbers were fabricated. When given a mixture of original and general abstracts, blinded human reviewers correctly identified 68% of generated abstracts as being generated by ChatGPT, but incorrectly identified 14% of original abstracts as being generated. Reviewers indicated that it was surprisingly difficult to differentiate between the two, but that the generated abstracts were vaguer and had a formulaic feel to the writing. Conclusion ChatGPT writes believable scientific abstracts, though with completely generated data. These are original without any plagiarism detected but are often identifiable using an AI output detector and skeptical human reviewers. Abstract evaluation for journals and medical conferences must adapt policy and practice to maintain rigorous scientific standards; we suggest inclusion of AI output detectors in the editorial process and clear disclosure if these technologies are used. The boundaries of ethical and acceptable use of large language models to help scientific writing remain to be determined.

27 August 2024 in EBioMedicine
Verified
Journal Article
Open access
DCDivya Choudhury
Divya Choudhury
JDJames M. Dolezal
James M. Dolezal
EDEmma Dyer
Emma Dyer
SKSara Kochanny
Sara Kochanny
SRSiddhi Ramesh
Siddhi Ramesh
APAlexander T. Pearson
Alexander T. Pearson
Deployment and access to state-of-the-art precision medicine technologies remains a fundamental challenge in providing equitable global cancer care in low-resource settings. The expansion of digital pathology in recent years and its potential interface with diagnostic artificial intelligence algorithms provides an opportunity to democratize access to personalized medicine. Current digital pathology workstations, however, cost thousands to hundreds of thousands of dollars. As cancer incidence rises in many low- and middle-income countries, the validation and implementation of low-cost automated diagnostic tools will be crucial to helping healthcare providers manage the growing burden of cancer. Here we describe a low-cost ($230) workstation for digital slide capture and computational analysis composed of open-source components. We analyze the predictive performance of deep learning models when they are used to evaluate pathology images captured using this open-source workstation versus images captured using common, significantly more expensive hardware. Validation studies assessed model performance on three distinct datasets and predictive models: head and neck squamous cell carcinoma (HPV positive versus HPV negative), lung cancer (adenocarcinoma versus squamous cell carcinoma), and breast cancer (invasive ductal carcinoma versus invasive lobular carcinoma). When compared to traditional pathology image capture methods, low-cost digital slide capture and analysis with the open-source workstation, including the low-cost microscope device, was associated with model performance of comparable accuracy for breast, lung, and HNSCC classification. At the patient level of analysis, AUROC was 0.84 for HNSCC HPV status prediction, 1.0 for lung cancer subtype prediction, and 0.80 for breast cancer classification. Our ability to maintain model performance despite decreased image quality and low-power computational hardware demonstrates that it is feasible to massively reduce costs associated with deploying deep learning models for digital pathology applications. Improving access to cutting-edge diagnostic tools may provide an avenue for reducing disparities in cancer care between high- and low-income regions. Funding for this project including personnel support was provided via grants from 10.13039/100000002 NIH / 10.13039/100000054 NCI R25-CA240134, 10.13039/100000002 NIH / 10.13039/100000054 NCI U01-CA243075, 10.13039/100000002 NIH / 10.13039/100000072 NIDCR R56-DE030958, 10.13039/100000002 NIH / 10.13039/100000054 NCI R01-CA276652, 10.13039/100000002 NIH / 10.13039/100000054 NCI K08-CA283261, 10.13039/100000002 NIH /NCI-SOAR 25CA240134, SU2C (Stand Up to Cancer) 10.13039/100002086 Fanconi Anemia Research Fund – 10.13039/100015848 Farrah Fawcett Foundation Head and Neck Cancer Research Team Grant, and the 10.13039/501100000780 European Union 10.13039/100019637 Horizon Program (I3LUNG).

9 April 2022 in arXiv
Verified
Preprint
Open access
PDF file
JDJames M Dolezal
James M Dolezal
ASAndrew Srisuwananukorn
Andrew Srisuwananukorn
DKDmitry Karpeyev
Dmitry Karpeyev
SRSiddhi Ramesh
Siddhi Ramesh
SKSara Kochanny
Sara Kochanny
APAlexander T Pearson
Alexander T Pearson
A model's ability to express its own predictive uncertainty is an essential attribute for maintaining clinical user confidence as computational biomarkers are deployed into real-world medical settings. In the domain of cancer digital histopathology, we describe a novel, clinically-oriented approach to uncertainty quantification (UQ) for whole-slide images, estimating uncertainty using dropout and calculating thresholds on training data to establish cutoffs for low- and high-confidence predictions. We train models to identify lung adenocarcinoma vs. squamous cell carcinoma and show that high-confidence predictions outperform predictions without UQ, in both cross-validation and testing on two large external datasets spanning multiple institutions. Our testing strategy closely approximates real-world application, with predictions generated on unsupervised, unannotated slides using predetermined thresholds. Furthermore, we show that UQ thresholding remains reliable in the setting of domain shift, with accurate high-confidence predictions of adenocarcinoma vs. squamous cell carcinoma for out-of-distribution, non-lung cancer cohorts.