Philip Richard Orrin Payne

Philip Richard Orrin Payne

Auto-generated profile, based on publicly available information

Philip Richard Orrin Payne

Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis School of Medicine , St. Louis, MO 63110

Research Focus & Metrics

Academic Career Length

32Years (1995-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 June 2023 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
ALAbigail E Lewis
Abigail E Lewis
NWNicole Weiskopf
Nicole Weiskopf
ZAZachary B Abrams
Zachary B Abrams
RFRandi Foraker
Randi Foraker
ALAlbert M Lai
Albert M Lai
AGAditi Gupta
Aditi Gupta
Objective: We extended a 2013 literature review on electronic health record (EHR) data quality assessment approaches and tools to determine recent improvements or changes in EHR data quality assessment methodologies. Materials and Methods: We completed a systematic review of PubMed articles from 2013 to April 2023 that discussed the quality assessment of EHR data. We screened and reviewed papers for the dimensions and methods defined in the original 2013 manuscript. We categorized papers as data quality outcomes of interest, tools, or opinion pieces. We abstracted and defined additional themes and methods though an iterative review process. Results: We included 103 papers in the review, of which 73 were data quality outcomes of interest papers, 22 were tools, and 8 were opinion pieces. The most common dimension of data quality assessed was completeness, followed by correctness, concordance, plausibility, and currency. We abstracted conformance and bias as 2 additional dimensions of data quality and structural agreement as an additional methodology. Discussion: There has been an increase in EHR data quality assessment publications since the original 2013 review. Consistent dimensions of EHR data quality continue to be assessed across applications. Despite consistent patterns of assessment, there still does not exist a standard approach for assessing EHR data quality. Conclusion: Guidelines are needed for EHR data quality assessment to improve the efficiency, transparency, comparability, and interoperability of data quality assessment. These guidelines must be both scalable and flexible. Automation could be helpful in generalizing this process.

1 July 2021 in JAMIA Open
Verified
Journal Article
Open access
PDF file
SKSayantan Kumar
Sayantan Kumar
IOInez Oh
Inez Oh
SSSuzanne Schindler
Suzanne Schindler
ALAlbert M Lai
Albert M Lai
PPPhilip R O Payne
Philip R O Payne
AGAditi Gupta
Aditi Gupta
Objective: Alzheimer disease (AD) is the most common cause of dementia, a syndrome characterized by cognitive impairment severe enough to interfere with activities of daily life. We aimed to conduct a systematic literature review (SLR) of studies that applied machine learning (ML) methods to clinical data derived from electronic health records in order to model risk for progression of AD dementia. Materials and Methods: We searched for articles published between January 1, 2010, and May 31, 2020, in PubMed, Scopus, ScienceDirect, IEEE Explore Digital Library, Association for Computing Machinery Digital Library, and arXiv. We used predefined criteria to select relevant articles and summarized them according to key components of ML analysis such as data characteristics, computational algorithms, and research focus. Results: There has been a considerable rise over the past 5 years in the number of research papers using ML-based analysis for AD dementia modeling. We reviewed 64 relevant articles in our SLR. The results suggest that majority of existing research has focused on predicting progression of AD dementia using publicly available datasets containing both neuroimaging and clinical data (neurobehavioral status exam scores, patient demographics, neuroimaging data, and laboratory test values). Discussion: Identifying individuals at risk for progression of AD dementia could potentially help to personalize disease management to plan future care. Clinical data consisting of both structured data tables and clinical notes can be effectively used in ML-based approaches to model risk for AD dementia progression. Data sharing and reproducibility of results can enhance the impact, adaptation, and generalizability of this research.

12 December 2024 in Journal of Clinical Investigation
Verified
Journal Article
Open access
PDF file
AAAaron H. Abend
Aaron H. Abend
IHIngrid He
Ingrid He
NBNeil Bahroos
Neil Bahroos
SCStratos Christianakis
Stratos Christianakis
ACAshley B. Crew
Ashley B. Crew
DFDeLisa Fairweather
DeLisa Fairweather
BACKGROUND: Previous epidemiologic studies of autoimmune diseases in the US have included a limited number of diseases or used metaanalyses that rely on different data collection methods and analyses for each disease. METHODS: To estimate the prevalence of autoimmune diseases in the US, we used electronic health record data from 6 large medical systems in the US. We developed a software program using common methodology to compute the estimated prevalence of autoimmune diseases alone and in aggregate that can be readily used by other investigators to replicate or modify the analysis over time. RESULTS: Our findings indicate that over 15 million people, or 4.6% of the US population, have been diagnosed with at least 1 autoimmune disease from January 1, 2011, to June 1, 2022, and 34% of those are diagnosed with more than 1 autoimmune disease. As expected, females (63% of those with autoimmune disease) were almost twice as likely as males to be diagnosed with an autoimmune disease. We identified the top 20 autoimmune diseases based on prevalence and according to sex and age. CONCLUSION: Here, we provide, for what we believe to be the first time, a large-scale prevalence estimate of autoimmune disease in the US by sex and age. FUNDING: Autoimmune Registry Inc., the National Heart Lung and Blood Institute, the National Center for Advancing Translational Sciences, the Intramural Research Program of the National Institute of Environmental Health Sciences.

1 December 2020 in JAMIA Open
Verified
Journal Article
Open access
PDF file
RFRandi E Foraker
Randi E Foraker
SYSean C Yu
Sean C Yu
AGAditi Gupta
Aditi Gupta
AMAndrew P Michelson
Andrew P Michelson
JSJose A Pineda Soto
Jose A Pineda Soto
PPPhilip R O Payne
Philip R O Payne
Synthetic data may provide a solution to researchers who wish to generate and share data in support of precision healthcare. Recent advances in data synthesis enable the creation and analysis of synthetic derivatives as if they were the original data; this process has significant advantages over data deidentification. To assess a big-data platform with data-synthesizing capabilities (MDClone Ltd., Beer Sheva, Israel) for its ability to produce data that can be used for research purposes while obviating privacy and confidentiality concerns. We explored three use cases and tested the robustness of synthetic data by comparing the results of analyses using synthetic derivatives to analyses using the original data using traditional statistics, machine learning approaches, and spatial representations of the data. We designed these use cases with the purpose of conducting analyses at the observation level (Use Case 1), patient cohorts (Use Case 2), and population-level data (Use Case 3). For each use case, the results of the analyses were sufficiently statistically similar (P > 0.05) between the synthetic derivative and the real data to draw the same conclusions. This article presents the results of each use case and outlines key considerations for the use of synthetic data, examining their role in clinical research for faster insights and improved data sharing in support of precision healthcare.

14 October 2021 in Learning Health Systems
Verified
Journal Article
Open access
PDF file
LBLisa Bastarache
Lisa Bastarache
JBJeffrey Brown
Jeffrey Brown
JCJames J. Cimino
James J. Cimino
DDDavid A. Dorr
David A. Dorr
PEPeter J. Embi
Peter J. Embi
MWMark G. Weiner
Mark G. Weiner
Development of evidence‐based practice requires practice‐based evidence, which can be acquired through analysis of real‐world data from electronic health records (EHRs). The EHR contains volumes of information about patients—physical measurements, diagnoses, exposures, and markers of health behavior—that can be used to create algorithms for risk stratification or to gain insight into associations between exposures, interventions, and outcomes. But to transform real‐world data into reliable real‐world evidence, one must not only choose the correct analytical methods but also have an understanding of the quality, detail, provenance, and organization of the underlying source data and address the differences in these characteristics across sites when conducting analyses that span institutions. This manuscript explores the idiosyncrasies inherent in the capture, formatting, and standardization of EHR data and discusses the clinical domain and informatics competencies required to transform the raw clinical, real‐world data into high‐quality, fit‐for‐purpose analytical data sets used to generate real‐world evidence.

1 July 2024 in JAMIA Open
Verified
Journal Article
Open access
PDF file
KBKRITI BHATTARAI
KRITI BHATTARAI
IOInez Y Oh
Inez Y Oh
JSJonathan Moran Sierra
Jonathan Moran Sierra
JTJonathan Tang
Jonathan Tang
PPPhilip R O Payne
Philip R O Payne
ALAlbert M Lai
Albert M Lai
Objective: Accurately identifying clinical phenotypes from Electronic Health Records (EHRs) provides additional insights into patients’ health, especially when such information is unavailable in structured data. This study evaluates the application of OpenAI’s Generative Pre-trained Transformer (GPT)-4 model to identify clinical phenotypes from EHR text in non-small cell lung cancer (NSCLC) patients. The goal was to identify disease stages, treatments and progression utilizing GPT-4, and compare its performance against GPT-3.5-turbo, Flan-T5-xl, Flan-T5-xxl, Llama-3-8B, and 2 rule-based and machine learning-based methods, namely, scispaCy and medspaCy. Materials and Methods: Phenotypes such as initial cancer stage, initial treatment, evidence of cancer recurrence, and affected organs during recurrence were identified from 13 646 clinical notes for 63 NSCLC patients from Washington University in St. Louis, Missouri. The performance of the GPT-4 model is evaluated against GPT-3.5-turbo, Flan-T5-xxl, Flan-T5-xl, Llama-3-8B, medspaCy, and scispaCy by comparing precision, recall, and micro-F1 scores. Results: GPT-4 achieved higher F1 score, precision, and recall compared to Flan-T5-xl, Flan-T5-xxl, Llama-3-8B, medspaCy, and scispaCy’s models. GPT-3.5-turbo performed similarly to that of GPT-4. GPT, Flan-T5, and Llama models were not constrained by explicit rule requirements for contextual pattern recognition. spaCy models relied on predefined patterns, leading to their suboptimal performance. Discussion and Conclusion: GPT-4 improves clinical phenotype identification due to its robust pre-training and remarkable pattern recognition capability on the embedded tokens. It demonstrates data-driven effectiveness even with limited context in the input. While rule-based models remain useful for some tasks, GPT models offer improved contextual understanding of the text, and robust clinical phenotype extraction.