Benjamin Alan Goldstein

Benjamin Alan Goldstein

Auto-generated profile, based on publicly available information

Benjamin Alan Goldstein

Duke University School of Medicine

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 May 2016 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
BGBenjamin A Goldstein
Benjamin A Goldstein
ANAnn Marie Navar
Ann Marie Navar
MPMichael J Pencina
Michael J Pencina
JIJohn P A Ioannidis
John P A Ioannidis
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.

19 July 2016 in European Heart Journal
Verified
Journal Article
Open access
PDF file
BGBenjamin A. Goldstein
Benjamin A. Goldstein
ANAnn Marie Navar
Ann Marie Navar
RCRickey E. Carter
Rickey E. Carter
Risk prediction plays an important role in clinical cardiology research. Traditionally, most risk models have been based on regression models. While useful and robust, these statistical methods are limited to using a small number of predictors which operate in the same way on everyone, and uniformly throughout their range. The purpose of this review is to illustrate the use of machine-learning methods for development of risk prediction models. Typically presented as black box approaches, most machine-learning methods are aimed at solving particular challenges that arise in data analysis that are not well addressed by typical regression approaches. To illustrate these challenges, as well as how different methods can address them, we consider trying to predicting mortality after diagnosis of acute myocardial infarction. We use data derived from our institution's electronic health record and abstract data on 13 regularly measured laboratory markers. We walk through different challenges that arise in modelling these data and then introduce different machine-learning approaches. Finally, we discuss general issues in the application of machine-learning methods including tuning parameters, loss functions, variable importance, and missing data. Overall, this review serves as an introduction for those working on risk modelling to approach the diffuse field of machine learning.

16 November 2016 in American Journal of Epidemiology
Verified
Journal Article
Open access
PDF file
BGBenjamin A. Goldstein
Benjamin A. Goldstein
NBNrupen A. Bhavsar
Nrupen A. Bhavsar
MPMatthew Phelan
Matthew Phelan
MPMichael J. Pencina
Michael J. Pencina
Electronic health records (EHRs) are an increasingly utilized resource for clinical research. While their size allows for many analytical opportunities, as with most observational data there is also the potential for bias. One of the key sources of bias in EHRs is what we term informed presence—the notion that inclusion in an EHR is not random but rather indicates that the subject is ill, making people in EHRs systematically different from those not in EHRs. In this article, we use simulated and empirical data to illustrate the conditions under which such bias can arise and how conditioning on the number of health-care encounters can be one way to remove this bias. In doing so, we also show when such an approach can impart M bias, or bias from conditioning on a collider. Finally, we explore the conditions under which number of medical encounters can serve as a proxy for general health. We apply these methods to an EHR data set from a university medical center covering the years 2007–2013.

21 October 2020 in JMIR Medical Informatics
Verified
Journal Article
Open access
FXFeng Xie
Feng Xie
BCBibhas Chakraborty
Bibhas Chakraborty
Marcus Eng Hock OngMarcus Eng Hock Ong
Marcus Eng Hock Ong
BGBenjamin Alan Goldstein
Benjamin Alan Goldstein
Nan LiuNan Liu
Nan Liu
Background: Risk scores can be useful in clinical risk stratification and accurate allocations of medical resources, helping health providers improve patient care. Point-based scores are more understandable and explainable than other complex models and are now widely used in clinical decision making. However, the development of the risk scoring model is nontrivial and has not yet been systematically presented, with few studies investigating methods of clinical score generation using electronic health records. Objective: This study aims to propose AutoScore, a machine learning–based automatic clinical score generator consisting of 6 modules for developing interpretable point-based scores. Future users can employ the AutoScore framework to create clinical scores effortlessly in various clinical applications. Methods: We proposed the AutoScore framework comprising 6 modules that included variable ranking, variable transformation, score derivation, model selection, score fine-tuning, and model evaluation. To demonstrate the performance of AutoScore, we used data from the Beth Israel Deaconess Medical Center to build a scoring model for mortality prediction and then compared the data with other baseline models using the receiver operating characteristic analysis. A software package in R 3.5.3 (R Foundation) was also developed to demonstrate the implementation of AutoScore. Results: Implemented on the data set with 44,918 individual admission episodes of intensive care, the AutoScore-created scoring models performed comparably well as other standard methods (ie, logistic regression, stepwise regression, least absolute shrinkage and selection operator, and random forest) in terms of predictive accuracy and model calibration but required fewer predictors and presented high interpretability and accessibility. The nine-variable, AutoScore-created, point-based scoring model achieved an area under the curve (AUC) of 0.780 (95% CI 0.764-0.798), whereas the model of logistic regression with 24 variables had an AUC of 0.778 (95% CI 0.760-0.795). Moreover, the AutoScore framework also drives the clinical research continuum and automation with its integration of all necessary modules. Conclusions: We developed an easy-to-use, machine learning–based automatic clinical score generator, AutoScore; systematically presented its structure; and demonstrated its superiority (predictive performance and interpretability) over other conventional methods using a benchmark database. AutoScore will emerge as a potential scoring tool in various medical applications.

7 September 2018 in JAMA Network Open
Verified
Journal Article
Open access
PDF file
NBNrupen A. Bhavsar
Nrupen A. Bhavsar
AGAijing Gao
Aijing Gao
MPMatthew Phelan
Matthew Phelan
NPNeha J. Pagidipati
Neha J. Pagidipati
BGBenjamin A. Goldstein
Benjamin A. Goldstein
Electronic health records (EHRs) have become an important component of clinical practice. However, a key limitation of EHRs when used for research purposes is that they do not reliably collect sociodemographic and neighborhood information, which has long been recognized to be strongly associated with health.1 Social and behavior measures linked to clinical variables within EHRs may improve clinical care and population health while also helping to inform population-level risk reduction strategies.2

1 July 2016 in Epidemiology
Verified
Journal Article
Closed access
BGBenjamin A. Goldstein
Benjamin A. Goldstein
LTLaine Thomas
Laine Thomas
JZJonathan G. Zaroff
Jonathan G. Zaroff
JNJohn Nguyen
John Nguyen
RMRebecca Menza
Rebecca Menza
KKKiran K. Khush
Kiran K. Khush
Background: Over the past two decades, there have been increasingly long waiting times for heart transplantation. We studied the relationship between heart transplant waiting time and transplant failure (removal from the waitlist, pretransplant death, or death or graft failure within 1 year) to determine the risk that conservative donor heart acceptance practices confer in terms of increasing the risk of failure among patients awaiting transplantation. Methods: We studied a cohort of 28,283 adults registered on the United Network for Organ Sharing heart transplant waiting list between 2000 and 2010. We used Kaplan–Meier methods with inverse probability censoring weights to examine the risk of transplant failure accumulated over time spent on the waiting list (pretransplant). In addition, we used transplant candidate blood type as an instrumental variable to assess the risk of transplant failure associated with increased wait time. Results: Our results show that those who wait longer for a transplant have greater odds of transplant failure. While on the waitlist, the greatest risk of failure is during the first 60 days. Doubling the amount of time on the waiting list was associated with a 10% (1.01, 1.20) increase in the odds of failure within 1 year after transplantation. Conclusions: Our findings suggest a relationship between time spent on the waiting list and transplant failure, thereby supporting research aimed at defining adequate donor heart quality and acceptance standards for heart transplantation.