Elizabeth Millen

Elizabeth Millen

Auto-generated profile, based on publicly available information

Elizabeth Millen

Ada Health GmbH Berlin Germany

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 June 2022 in JMIR Research Protocols
Verified
Journal Article
Open access
MSMarcel Schmude
Marcel Schmude
NMNAHYA SALIM MASOUD
NAHYA SALIM MASOUD
HAHila Azadzoy
Hila Azadzoy
MBMustafa Bane
Mustafa Bane
EMElizabeth Millen
Elizabeth Millen
SGStephen Gilbert
Stephen Gilbert
Background: Low- and middle-income countries face difficulties in providing adequate health care. One of the reasons is a shortage of qualified health workers. Diagnostic decision support systems are designed to aid clinicians in their work and have the potential to mitigate pressure on health care systems. Objective: The Artificial Intelligence–Based Assessment of Health Symptoms in Tanzania (AFYA) study will evaluate the potential of an English-language artificial intelligence–based prototype diagnostic decision support system for mid-level health care practitioners in a low- or middle-income setting. Methods: This is an observational, prospective clinical study conducted in a busy Tanzanian district hospital. In addition to usual care visits, study participants will consult a mid-level health care practitioner, who will use a prototype diagnostic decision support system, and a study physician. The accuracy and comprehensiveness of the differential diagnosis provided by the diagnostic decision support system will be evaluated against a gold-standard differential diagnosis provided by an expert panel. Results: Patient recruitment started in October 2021. Participants were recruited directly in the waiting room of the outpatient clinic at the hospital. Data collection will conclude in May 2022. Data analysis is planned to be finished by the end of June 2022. The results will be published in a peer-reviewed journal. Conclusions: Most diagnostic decision support systems have been developed and evaluated in high-income countries, but there is great potential for these systems to improve the delivery of health care in low- and middle-income countries. The findings of this real-patient study will provide insights based on the performance and usability of a prototype diagnostic decision support system in low- or middle-income countries. Trial Registration: ClinicalTrials.gov NCT04958577; http://clinicaltrials.gov/ct2/show/NCT04958577 International Registered Report Identifier (IRRID): DERR1-10.2196/34298

11 May 2020 in medRxiv
Verified
Preprint
Open access
PDF file
SGStephen Gilbert
Stephen Gilbert
AMAlicia Mehl
Alicia Mehl
ABAdel Baluch
Adel Baluch
CCCaoimhe Cawley
Caoimhe Cawley
JCJean Challiner
Jean Challiner
CNClaire Novorol
Claire Novorol
Objectives: To compare breadth of condition coverage, accuracy of suggested conditions and appropriateness of urgency advice of 8 popular symptom assessment apps with each other and with 7 General Practitioners. Design: Clinical vignettes study. Setting: 200 clinical vignettes representing real-world scenarios in primary care. Intervention/comparator: Condition coverage, suggested condition accuracy, and urgency advice performance was measured against the vignettes’ gold-standard diagnoses and triage level. Primary outcome measures: Outcomes included (i) proportion of conditions “covered” by an app, i.e. not excluded because the patient was too young/old, pregnant, or comorbid, (ii) proportion of vignettes in which the correct primary diagnosis was amongst the top 3 conditions suggested, and, (iii) proportion of “safe” urgency level advice (i.e. at gold standard level, more conservative, or no more than one level less conservative). Results: Condition-suggestion coverage was highly variable, with some apps not offering a suggestion for many users: in alphabetical order, Ada: 99.0%; Babylon: 51.5%; Buoy: 88.5%; K Health: 74.5%; Mediktor: 80.5%; Symptomate: 61.5%; Your.MD: 64.5%. The top-3 suggestion accuracy (M3) of GPs was on average 82.i±5.2%. For the apps it was - Ada: 70.5%; Babylon: 32.0%; Buoy: 43.0%; K Health: 36.0%; Mediktor: 36.0%; Symptomate: 27.5%; WebMD: 35.5%; Your.MD: 23.5%. Some apps exclude certain user groups (e.g. younger users) or certain conditions - for these apps condition-suggestion performance is generally greater with exclusion of these vignettes. For safe urgency advice, tested GPs had an average of 97.0±2.5%. For the vignettes with advice provided, only three apps had safety performance within 1 S.D. of the GPs (mean) - Ada: 97.0%; Babylon: 95.i%; Symptomate: 97.8%. One app had a safety performance within 2 S.D.s of GPs - Your.MD: 92.6%. Three apps had a safety performance outside 2 S.D.s of GPs - Buoy: 80.0% ( p <0.001); K Health: 81.3% ( p <0.001); Mediktor: 87.3% ( p =1.3×10 -3 ). Conclusions: The utility of digital symptom assessment apps relies upon coverage, accuracy, and safety. While no digital tool outperformed GPs, some came close, and the nature of iterative improvements to software offers scalable improvements to care.


30 November 2020 in JMIR Preprints
Verified
Preprint
Open access
EMElizabeth Millen
Elizabeth Millen
AGAndreas Gilsdorf
Andreas Gilsdorf
MFMatthew Fenech
Matthew Fenech
SGStephen Gilbert
Stephen Gilbert
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). The area explored in this publication is interesting and somewhat necessary given the novelty of COVID-19 screeners, but the paper does not compare like with like and is not an appropriate evaluation of the use case of the screeners, including the Ada COVID-19 screener. When comparing the screeners appropriately, which is reported in indices but not reported rigorously in the paper, it is shown that Symptoma does not indeed perform superiorly.


15 June 2021 in JMIR Preprints
Verified
Preprint
Open access
EMElizabeth Millen
Elizabeth Millen
AGAndreas Gilsdorf
Andreas Gilsdorf
MFMatthew Fenech
Matthew Fenech
SGStephen Gilbert
Stephen Gilbert
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).