Hyunjoon Lee

Hyunjoon Lee

Auto-generated profile, based on publicly available information

Hyunjoon Lee

Massachusetts General Hospital

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 March 2022 in JMIR Formative Research
Verified
Journal Article
Open access
KBKate H Bentley
Kate H Bentley
KZKelly L Zuromski
Kelly L Zuromski
RFRebecca Fortgang
Rebecca Fortgang
EMEmily M Madsen
Emily M Madsen
DKDaniel Kessler
Daniel Kessler
JSJordan Smoller
Jordan Smoller
Background: Interest in developing machine learning models that use electronic health record data to predict patients’ risk of suicidal behavior has recently proliferated. However, whether and how such models might be implemented and useful in clinical practice remain unknown. To ultimately make automated suicide risk–prediction models useful in practice, and thus better prevent patient suicides, it is critical to partner with key stakeholders, including the frontline providers who will be using such tools, at each stage of the implementation process. Objective: The aim of this focus group study is to inform ongoing and future efforts to deploy suicide risk–prediction models in clinical practice. The specific goals are to better understand hospital providers’ current practices for assessing and managing suicide risk; determine providers’ perspectives on using automated suicide risk–prediction models in practice; and identify barriers, facilitators, recommendations, and factors to consider. Methods: We conducted 10 two-hour focus groups with a total of 40 providers from psychiatry, internal medicine and primary care, emergency medicine, and obstetrics and gynecology departments within an urban academic medical center. Audio recordings of open-ended group discussions were transcribed and coded for relevant and recurrent themes by 2 independent study staff members. All coded text was reviewed and discrepancies were resolved in consensus meetings with doctoral-level staff. Results: Although most providers reported using standardized suicide risk assessment tools in their clinical practices, existing tools were commonly described as unhelpful and providers indicated dissatisfaction with current suicide risk assessment methods. Overall, providers’ general attitudes toward the practical use of automated suicide risk–prediction models and corresponding clinical decision support tools were positive. Providers were especially interested in the potential to identify high-risk patients who might be missed by traditional screening methods. Some expressed skepticism about the potential usefulness of these models in routine care; specific barriers included concerns about liability, alert fatigue, and increased demand on the health care system. Key facilitators included presenting specific patient-level features contributing to risk scores, emphasizing changes in risk over time, and developing systematic clinical workflows and provider training. Participants also recommended considering risk-prediction windows, timing of alerts, who will have access to model predictions, and variability across treatment settings. Conclusions: Providers were dissatisfied with current suicide risk assessment methods and were open to the use of a machine learning–based risk-prediction system to inform clinical decision-making. They also raised multiple concerns about potential barriers to the usefulness of this approach and suggested several possible facilitators. Future efforts in this area will benefit from incorporating systematic qualitative feedback from providers, patients, administrators, and payers on the use of these new approaches in routine care, especially given the complex, sensitive, and unfortunately still stigmatized nature of suicide risk.

21 March 2023 in Psychiatry Research
Verified
Journal Article
Open access
YSYi-Han Sheu
Yi-Han Sheu
JSJiehuan Sun
Jiehuan Sun
HLHyunjoon Lee
Hyunjoon Lee
VCVictor Castro
Victor Castro
YBYuval Barak-Corren
Yuval Barak-Corren
JSJordan Smoller
Jordan Smoller
Growing evidence has shown that applying machine learning models to large clinical data sources may exceed clinician performance in suicide risk stratification. However, many existing prediction models either suffer from "temporal bias" (a bias that stems from using case-control sampling) or require training on all available patient visit data. Here, we adopt a "landmark model" framework that aligns with clinical practice for prediction of suicide-related behaviors (SRBs) using a large electronic health record database. Using the landmark approach, we developed models for SRB prediction (regularized Cox regression and random survival forest) that establish a time-point (e.g., clinical visit) from which predictions are made over user-specified prediction windows using historical information up to that point. We applied this approach to cohorts from three clinical settings: general outpatient, psychiatric emergency department, and psychiatric inpatients, for varying prediction windows and lengths of historical data. Models achieved high discriminative performance (area under the Receiver Operating Characteristic curve 0.74-0.93 for the Cox model) across different prediction windows and settings, even with relatively short periods of historical data. In short, we developed accurate, dynamic SRB risk prediction models with the landmark approach that reduce bias and enhance the reliability and portability of suicide risk prediction models.

25 January 2024 in Translational Psychiatry
Verified
Journal Article
Open access
PDF file
CWColin G. Walsh
Colin G. Walsh
MRMichael A. Ripperger
Michael A. Ripperger
YHYirui Hu
Yirui Hu
YSYi-Han Sheu
Yi-Han Sheu
HLHyunjoon Lee
Hyunjoon Lee
JSJordan Smoller
Jordan Smoller
Bipolar disorder is a leading contributor to disability, premature mortality, and suicide. Early identification of risk for bipolar disorder using generalizable predictive models trained on diverse cohorts around the United States could improve targeted assessment of high risk individuals, reduce misdiagnosis, and improve the allocation of limited mental health resources. This observational case-control study intended to develop and validate generalizable predictive models of bipolar disorder as part of the multisite, multinational PsycheMERGE Network across diverse and large biobanks with linked electronic health records (EHRs) from three academic medical centers: in the Northeast (Massachusetts General Brigham), the Mid-Atlantic (Geisinger) and the Mid-South (Vanderbilt University Medical Center). Predictive models were developed and valid with multiple algorithms at each study site: random forests, gradient boosting machines, penalized regression, including stacked ensemble learning algorithms combining them. Predictors were limited to widely available EHR-based features agnostic to a common data model including demographics, diagnostic codes, and medications. The main study outcome was bipolar disorder diagnosis as defined by the International Cohort Collection for Bipolar Disorder, 2015. In total, the study included records for 3,529,569 patients including 12,533 cases (0.3%) of bipolar disorder. After internal and external validation, algorithms demonstrated optimal performance in their respective development sites. The stacked ensemble achieved the best combination of overall discrimination (AUC = 0.82–0.87) and calibration performance with positive predictive values above 5% in the highest risk quantiles at all three study sites. In conclusion, generalizable predictive models of risk for bipolar disorder can be feasibly developed across diverse sites to enable precision medicine. Comparison of a range of machine learning methods indicated that an ensemble approach provides the best performance overall but required local retraining. These models will be disseminated via the PsycheMERGE Network website.

2 June 2022 in Complex Psychiatry
Verified
Journal Article
Closed access
PDF file
MJMariela V. Jennings
Mariela V. Jennings
HLHyunjoon Lee
Hyunjoon Lee
DRDaniel B. Rocha
Daniel B. Rocha
SBSevim B. Bianchi
Sevim B. Bianchi
BCBrandon J. Coombes
Brandon J. Coombes
SSSandra Sanchez-Roige
Sandra Sanchez-Roige
Introduction: Opioid use disorders (OUDs) constitute a major public health issue, and we urgently need alternative methods for characterizing risk for OUD. Electronic health records (EHRs) are useful tools for understanding complex medical phenotypes but have been underutilized for OUD because of challenges related to underdiagnosis, binary diagnostic frameworks, and minimally characterized reference groups. As a first step in addressing these challenges, a new paradigm is warranted that characterizes risk for opioid prescription misuse on a continuous scale of severity, i.e., as a continuum. Methods: Across sites within the PsycheMERGE network, we extracted prescription opioid data and diagnoses that co-occur with OUD (including psychiatric and substance use disorders, pain-related diagnoses, HIV, and hepatitis C) for over 2.6 million patients across three health registries (Vanderbilt University Medical Center, Mass General Brigham, Geisinger) between 2005 and 2018. We defined three groups based on levels of opioid exposure: no prescriptions, minimal exposure, and chronic exposure and then compared the comorbidity profiles of these groups to the full registries and to those with OUD diagnostic codes. Results: Our results confirm that EHR data reflects known higher prevalence of substance use disorders, psychiatric disorders, medical, and pain diagnoses in patients with OUD diagnoses and chronic opioid use. Comorbidity profiles that distinguish opioid exposure are strikingly consistent across large health systems, indicating the phenotypes described in this new quantitative framework are robust to health systems differences. Conclusion: This work indicates that EHR prescription opioid data can serve as a platform to characterize complex risk markers for OUD using existing data.

8 January 2024 in JMIR Formative Research
Verified
Journal Article
Open access
KBKate H Bentley
Kate H Bentley
EMEmily M Madsen
Emily M Madsen
ESEugene Song
Eugene Song
YZYu Zhou
Yu Zhou
VCVictor Castro
Victor Castro
JSJordan Smoller
Jordan Smoller
Background: Prior suicide attempts are a relatively strong risk factor for future suicide attempts. There is growing interest in using longitudinal electronic health record (EHR) data to derive statistical risk prediction models for future suicide attempts and other suicidal behavior outcomes. However, model performance may be inflated by a largely unrecognized form of “data leakage” during model training: diagnostic codes for suicide attempt outcomes may refer to prior attempts that are also included in the model as predictors. Objective: We aimed to develop an automated rule for determining when documented suicide attempt diagnostic codes identify distinct suicide attempt events. Methods: From a large health care system’s EHR, we randomly sampled suicide attempt codes for 300 patients with at least one pair of suicide attempt codes documented at least one but no more than 90 days apart. Supervised chart reviewers assigned the clinical settings (ie, emergency department [ED] versus non-ED), methods of suicide attempt, and intercode interval (number of days). The probability (or positive predictive value) that the second suicide attempt code in a given pair of codes referred to a distinct suicide attempt event from its preceding suicide attempt code was calculated by clinical setting, method, and intercode interval. Results: Of 1015 code pairs reviewed, 835 (82.3%) were nonindependent (ie, the 2 codes referred to the same suicide attempt event). When the second code in a pair was documented in a clinical setting other than the ED, it represented a distinct suicide attempt 3.3% of the time. The more time elapsed between codes, the more likely the second code in a pair referred to a distinct suicide attempt event from its preceding code. Code pairs in which the second suicide attempt code was assigned in an ED at least 5 days after its preceding suicide attempt code had a positive predictive value of 0.90. Conclusions: EHR-based suicide risk prediction models that include International Classification of Diseases codes for prior suicide attempts as a predictor may be highly susceptible to bias due to data leakage in model training. We derived a simple rule to distinguish codes that reflect new, independent suicide attempts: suicide attempt codes documented in an ED setting at least 5 days after a preceding suicide attempt code can be confidently treated as new events in EHR-based suicide risk prediction models. This rule has the potential to minimize upward bias in model performance when prior suicide attempts are included as predictors in EHR-based suicide risk prediction models.

31 January 2023 in Psychiatry Research Communications
Verified
Journal Article
Open access
ATAllison K. Tu
Allison K. Tu
JHJuliana Restivo Haney
Juliana Restivo Haney
KOKathryn O'NEill
Kathryn O'NEill
ASAkshay Swaminathan
Akshay Swaminathan
KCKarmel W. Choi
Karmel W. Choi
John NaslundJohn Naslund
John Naslund
Throughout the COVID-19 pandemic, graduate students have faced increased risk of mental health challenges. Research suggests that experiencing adversity may induce positive psychological changes, called post-traumatic growth (PTG). These changes can include improved relationships with others, perceptions of oneself, and enjoyment of life. Few existing studies have explored this phenomenon among graduate students. This secondary data analysis of a survey conducted in November 2020 among graduate students at a private R1 University in the northeast United States examined graduate students' levels and correlates of PTG during the COVID-19 pandemic. Students had a low level of PTG, with a mean score of 10.31 out of 50. Linear regression models showed significant positive relationships between anxiety and PTG and between a measure of self-reported impact of the pandemic and PTG. Non-White minorities also had significantly greater PTG than White participants. Experiencing more negative impact due to the pandemic and ruminating about the pandemic were correlated with greater PTG. These findings advance research on the patterns of PTG during the COVID-19 pandemic and can inform future studies of graduate students' coping mechanisms and support efforts to promote pandemic recovery and resilience.