1 January 2020 in Gastroenterology
25 August 2022 in Journal of Medical Internet Research
Background: The number of artificial intelligence (AI) studies in medicine has exponentially increased recently. However, there is no clear quantification of the clinical benefits of implementing AI-assisted tools in patient care. Objective: This study aims to systematically review all published randomized controlled trials (RCTs) of AI-assisted tools to characterize their performance in clinical practice. Methods: CINAHL, Cochrane Central, Embase, MEDLINE, and PubMed were searched to identify relevant RCTs published up to July 2021 and comparing the performance of AI-assisted tools with conventional clinical management without AI assistance. We evaluated the primary end points of each study to determine their clinical relevance. This systematic review was conducted following the updated PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. Results: Among the 11,839 articles retrieved, only 39 (0.33%) RCTs were included. These RCTs were conducted in an approximately equal distribution from North America, Europe, and Asia. AI-assisted tools were implemented in 13 different clinical specialties. Most RCTs were published in the field of gastroenterology, with 15 studies on AI-assisted endoscopy. Most RCTs studied biosignal-based AI-assisted tools, and a minority of RCTs studied AI-assisted tools drawn from clinical data. In 77% (30/39) of the RCTs, AI-assisted interventions outperformed usual clinical care, and clinically relevant outcomes improved with AI-assisted intervention in 70% (21/30) of the studies. Small sample size and single-center design limited the generalizability of these studies. Conclusions: There is growing evidence supporting the implementation of AI-assisted tools in daily clinical practice; however, the number of available RCTs is limited and heterogeneous. More RCTs of AI-assisted tools integrated into clinical practice are needed to advance the role of AI in medicine. Trial Registration: PROSPERO CRD42021286539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=286539
1 December 2024 in Annals of Internal Medicine
Randomized clinical trials (RCTs) of computer-aided detection (CADe) system-enhanced colonoscopy compared with conventional colonoscopy suggest increased adenoma detection rate (ADR) and decreased adenoma miss rate (AMR), but the effect on detection of advanced colorectal neoplasia (ACN) is unclear. To conduct a systematic review to compare performance of CADe-enhanced and conventional colonoscopy. Cochrane Library, Google Scholar, Ovid EMBASE, Ovid MEDLINE, PubMed, Scopus, and Web of Science Core Collection databases were searched through February 2024. Published RCTs comparing CADe-enhanced and conventional colonoscopy. Average adenoma per colonoscopy (APC) and ACN per colonoscopy were primary outcomes. Adenoma detection rate, AMR, and ACN detection rate (ACN DR) were secondary outcomes. Balancing outcomes included withdrawal time and resection of nonneoplastic polyps (NNPs). Subgroup analyses were done by neural network architecture. Forty-four RCTs with 36 201 cases were included. Computer-aided detection-enhanced colonoscopies have higher average APC (12 090 of 12 279 [0.98] vs. 9690 of 12 292 [0.78], incidence rate difference [IRD] = 0.22 [95% CI, 0.16 to 0.28]) and higher ADR (7098 of 16 253 [44.7%] vs. 5825 of 15 855 [36.7%], rate ratio [RR] = 1.21 [CI, 1.15 to 1.28]). Average ACN per colonoscopy was similar (1512 of 9296 [0.16] vs. 1392 of 9121 [0.15], IRD = 0.01 [CI, -0.01 to 0.02]), but ACN DR was higher with CADe system use (1260 of 9899 [12.7%] vs. 1119 of 9746 [11.5%], RR = 1.16 [CI, 1.02 to 1.32]). Using CADe systems resulted in resection of almost 2 extra NNPs per 10 colonoscopies and longer total withdrawal time (0.53 minutes [CI, 0.30 to 0.77]). Statistically significant heterogeneity in quality and sample size and inability to blind endoscopists to the intervention in included studies may affect the performance estimates. Computer-aided detection-enhanced colonoscopies have increased APC and detection rate but no difference in ACN per colonoscopy and a small increase in ACN DR. There is minimal increase in procedure time and no difference in performance across neural network architectures. None. (PROSPERO: CRD42023422835).
27 May 2024 in Alimentary Pharmacology & Therapeutics
Summary: Background: Interest in large language models (LLMs), such as OpenAI's ChatGPT, across multiple specialties has grown as a source of patient‐facing medical advice and provider‐facing clinical decision support. The accuracy of LLM responses for gastroenterology and hepatology‐related questions is unknown. Aims: To evaluate the accuracy and potential safety implications for LLMs for the diagnosis, management and treatment of questions related to gastroenterology and hepatology. Methods: We conducted a systematic literature search including Cochrane Library, Google Scholar, Ovid Embase, Ovid MEDLINE, PubMed, Scopus and the Web of Science Core Collection to identify relevant articles published from inception until January 28, 2024, using a combination of keywords and controlled vocabulary for LLMs and gastroenterology or hepatology. Accuracy was defined as the percentage of entirely correct answers. Results: Among the 1671 reports screened, we identified 33 full‐text articles on using LLMs in gastroenterology and hepatology and included 18 in the final analysis. The accuracy of question‐responding varied across different model versions. For example, accuracy ranged from 6.4% to 45.5% with ChatGPT‐3.5 and was between 40% and 91.4% with ChatGPT‐4. In addition, the absence of standardised methodology and reporting metrics for studies involving LLMs places all the studies at a high risk of bias and does not allow for the generalisation of single‐study results. Conclusions: Current general‐purpose LLMs have unacceptably low accuracy on clinical gastroenterology and hepatology tasks, which may lead to adverse patient safety events through incorrect information or triage recommendations, which might overburden healthcare systems or delay necessary care.
4 May 2019 in Digestive Diseases and Sciences