1 August 2021 in Artificial Intelligence in Medicine
1 January 2020 in Neural Networks
26 July 2023 in Alzheimer's & Dementia
INTRODUCTION: The use of applied modeling in dementia risk prediction, diagnosis, and prognostics will have substantial public health benefits, particularly as “deep phenotyping” cohorts with multi‐omics health data become available.METHODS: This narrative review synthesizes understanding of applied models and digital health technologies, in terms of dementia risk prediction, diagnostic discrimination, prognosis, and progression. Machine learning approaches show evidence of improved predictive power compared to standard clinical risk scores in predicting dementia, and the potential to decompose large numbers of variables into relatively few critical predictors.RESULTS: This review focuses on key areas of emerging promise including: emphasis on easier, more transparent data sharing and cohort access; integration of high‐throughput biomarker and electronic health record data into modeling; and progressing beyond the primary prediction of dementia to secondary outcomes, for example, treatment response and physical health.DISCUSSION: Such approaches will benefit also from improvements in remote data measurement, whether cognitive (e.g., online), or naturalistic (e.g., watch‐based accelerometry).
11 August 2023 in IEEE Transactions on Neural Networks and Learning Systems
When the first transformer-based language models were published in the late 2010s, pretraining with general text and then fine-tuning the model on a task-specific dataset often achieved the state-of-the-art performance. However, more recent work suggests that for some tasks, directly prompting the pretrained model matches or surpasses fine-tuning in performance with few or no model parameter updates required. The use of prompts with language models for natural language processing (NLP) tasks is known as prompt learning. We investigated the viability of prompt learning on clinically meaningful decision tasks and directly compared this with more traditional fine-tuning methods. Results show that prompt learning methods were able to match or surpass the performance of traditional fine-tuning with up to 1000 times fewer trainable parameters, less training time, less training data, and lower computation resource requirements. We argue that these characteristics make prompt learning a very desirable alternative to traditional fine-tuning for clinical tasks, where the computational resources of public health providers are limited, and where data can often not be made available or not be used for fine-tuning due to patient privacy concerns. The complementary code to reproduce the experiments presented in this work can be found at https://github.com/NtaylorOX/Public_Clinical_Prompt .
30 September 2024 in Artificial Intelligence in Medicine
Contemporary large language models (LLMs) may have utility for processing unstructured, narrative free-text clinical data contained in electronic health records (EHRs) - a particularly important use-case for mental health where a majority of routinely-collected patient data lacks structured, machine-readable content. A significant problem for the United Kingdom's National Health Service (NHS) are the long waiting lists for specialist mental healthcare. According to NHS data (NHS Digital, 2024), in each month of 2023, there were between 370,000 and 470,000 individual new referrals into secondary mental healthcare services. Referrals must be triaged by clinicians, using clinical information contained in the patient's EHR to arrive at a decision about the most appropriate mental healthcare team to assess and potentially treat these patients. The ability to efficiently recommend a relevant team by ingesting potentially voluminous clinical notes could help services both reduce referral waiting times and with the right technology, improve the evidence available to justify triage decisions. We present and evaluate three different approaches for LLM-based, end-to-end ingestion of variable-length clinical EHR data to assist clinicians when triaging referrals. Our model is able to deliver triage recommendations consistent with existing clinical practices and its architecture was implemented on a single GPU, making it practical for implementation in resource-limited NHS environments where private implementations of LLM technology will be necessary to ensure confidential clinical data are appropriately controlled and governed. Code available at: https://github.com/NtaylorOX/BespokeLLM_Triage.
24 January 2022 in International Journal of Medical Informatics
• Linking UK Clinical Record Interactive Search (UK-CRIS) and UK Biobank. • Comparison of diagnosis for 854 individuals present in both datasets. • Electronic health records from UK-CRIS used to understand self-reported data in UK Biobank.