Michelle B. Leavy

Michelle B. Leavy

Auto-generated profile, based on publicly available information

Michelle B. Leavy

Research, OM1, Inc., Boston, MA, USA

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 January 2020 in Therapeutic Innovation & Regulatory Science
Verified
Journal Article
Closed access
PDF file
RGRichard E. Gliklich
Richard E. Gliklich
MLMichelle B. Leavy
Michelle B. Leavy

20 May 2021 in RMD Open
Verified
Journal Article
Open access
PDF file
PAPedro Alves
Pedro Alves
JBJigar Bandaria
Jigar Bandaria
MLMichelle B Leavy
Michelle B Leavy
BGBenjamin Gliklich
Benjamin Gliklich
CBCostas Boussios
Costas Boussios
GCGary Curhan
Gary Curhan
Objective Use of the Systemic Lupus Erythematosus Disease Activity Index (SLEDAI) in routine clinical practice is inconsistent, and availability of clinician-recorded SLEDAI scores in real-world datasets is limited. This study aimed to validate a machine learning model to estimate SLEDAI score categories using clinical notes and to apply the model to a large, real-world dataset to generate estimated score categories for use in future research studies. Methods A machine learning model was developed to estimate an individual patient’s SLEDAI score category (no activity, mild activity, moderate activity or high/very high activity) for a specific encounter date using clinical notes. A training cohort of 3504 encounters and a separate validation cohort of 1576 encounters were created from the OM1 SLE Registry. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), calculated using a binarised version of the outcome that sets the positive class to be those records with clinician-recorded SLEDAI scores >5 and the negative class to be records with scores ≤5. Model performance was evaluated by categorising the scores into the four disease activity categories and by calculating the Spearman’s R value and Pearson’s R value. Results The AUC for the two categories was 0.93 for the development cohort and 0.91 for the validation cohort. The model had a Spearman’s R value of 0.7 and a Pearson’s R value of 0.7 when calculated using the four disease activity categories. Conclusion The model performs well when estimating SLEDAI score categories using unstructured clinical notes.

1 April 2022 in Multiple Sclerosis Journal – Experimental, Translational and Clinical
Verified
Journal Article
Open access
PAPedro Alves
Pedro Alves
EGEric Green
Eric Green
MLMichelle Leavy
Michelle Leavy
HFHaley Friedler
Haley Friedler
GCGary Curhan
Gary Curhan
CBCostas Boussios
Costas Boussios
Background: Disability assessment using the Expanded Disability Status Scale (EDSS) is important to inform treatment decisions and monitor the progression of multiple sclerosis. Yet, EDSS scores are documented infrequently in electronic medical records. Objective: To validate a machine learning model to estimate EDSS scores for multiple sclerosis patients using clinical notes from neurologists. Methods: A machine learning model was developed to estimate EDSS scores on specific encounter dates using clinical notes from neurologist visits. The OM1 MS Registry data were used to create a training cohort of 2632 encounters and a separate validation cohort of 857 encounters, all with clinician-recorded EDSS scores. Model performance was assessed using the area under the receiver-operating-characteristic curve (AUC), positive predictive value (PPV), and negative predictive value (NPV), calculated using a binarized version of the outcome. The Spearman R and Pearson R values were calculated. The model was then applied to encounters without clinician-recorded EDSS scores in the MS Registry. Results: The model had a PPV of 0.85, NPV of 0.85, and AUC of 0.91. The model had a Spearman R value of 0.75 and Pearson R value of 0.74 when evaluating performance using the continuous estimated EDSS and clinician-recorded EDSS scores. Application of the model to eligible encounters resulted in the generation of eEDSS scores for an additional 190,282 encounters from 13,249 patients. Conclusion: EDSS scores can be estimated with very good performance using a machine learning model applied to clinical notes, thus increasing the utility of real-world data sources for research purposes.

24 November 2021 in RMD Open
Verified
Journal Article
Open access
PDF file
ASAlison K. Spencer
Alison K. Spencer
JBJigar Bandaria
Jigar Bandaria
MLMichelle B. Leavy
Michelle B. Leavy
BGBenjamin Gliklich
Benjamin Gliklich
ZSZhaohui Su
Zhaohui Su
CBCostas Boussios
Costas Boussios
Objective Disease activity measures, such as the Clinical Disease Activity Index (CDAI), are important tools for informing treatment decisions and monitoring patient outcomes in rheumatoid arthritis (RA). Yet, documentation of CDAI scores in electronic medical records and other real-world data sources is inconsistent, making it challenging to use these data for research. The purpose of this study was to validate a machine learning model to estimate CDAI scores for patients with RA using clinical notes. Methods A machine learning model was developed to estimate CDAI score values using clinical notes from a specific rheumatology visit. Data from the OM1 RA Registry were used to create a training cohort of 56 177 encounters and a separate validation cohort of 18 726 encounters, 11 985 of which passed a model-derived confidence filter; all included encounters had both a clinician-recorded CDAI score and a clinical note. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), positive predictive value (PPV) and negative predictive value (NPV), calculated using a binarised version of the outcome. The Spearman’s R and Pearson’s R values were also calculated. Results The model had a PPV of 0.80, NPV of 0.84 and AUC of 0.88 when evaluating performance using the binarised version of the outcome. The model had a Spearman’s R value of 0.72 and a Pearson’s R value of 0.69 when evaluating performance using the continuous CDAI numeric scores. Conclusion A machine learning model estimates CDAI scores from clinical notes with good performance. Application of the model to real-world data sets may allow estimated CDAI scores to be used for research purposes.

1 May 2013 in Value in Health
Verified
Journal Article
Closed access
PDF file
RGR.E. Gliklich
R.E. Gliklich
DLD. Levy
D. Levy
DCD.M. Campion
D.M. Campion
MLM.B. Leavy
M.B. Leavy
JKJ. Karl
J. Karl
DTD. Thompson
D. Thompson

27 March 2019 in Therapeutic Innovation & Regulatory Science
Verified
Journal Article
Closed access
PDF file
RGRichard E. Gliklich
Richard E. Gliklich
MLMichelle B. Leavy
Michelle B. Leavy