Background: Alert fatigue is unavoidable when many irrelevant alerts are generated in response to a small number of useful alerts. It is necessary to increase the effectiveness of the clinical decision support system (CDSS) by understanding physicians’ responses. Objective: This study aimed to understand the CDSS and physicians’ behavior by evaluating the clinical appropriateness of alerts and the corresponding physicians’ responses in a medication-related passive alert system. Methods: Data on medication-related orders, alerts, and patients’ electronic medical records were analyzed. The analyzed data were generated between August 2019 and June 2020 while the patient was in the emergency department. We evaluated the appropriateness of alerts and physicians’ responses for a subset of 382 alert cases and classified them. Results: Of the 382 alert cases, only 7.3% (n=28) of the alerts were clinically appropriate. Regarding the appropriateness of the physicians’ responses about the alerts, 92.4% (n=353) were deemed appropriate. In the classification of alerts, only 3.4% (n=13) of alerts were successfully triggered, and 2.1% (n=8) were inappropriate in both alert clinical relevance and physician’s response. In this study, the override rate was 92.9% (n=355). Conclusions: We evaluated the appropriateness of alerts and physicians’ responses through a detailed medical record review of the medication-related passive alert system. An excessive number of unnecessary alerts are generated, because the algorithm operates as a rule base without reflecting the individual condition of the patient. It is important to maximize the value of the CDSS by comprehending physicians’ responses.

Background: Since its introduction, telemedicine for patients with chronic diseases has been studied in various clinical settings. However, there is limited evidence of the effectiveness and medical safety of the nationwide adoption of telemedicine. Objective: This study aimed to analyze the effects of telemedicine on chronic diseases during the COVID-19 pandemic under a temporary telemedicine policy in South Korea using national claims data. Methods: Health insurance claims data were extracted over 2 years: 1 year before (from February 24, 2019, to February 23, 2020) and 1 year after the policy was implemented (from February 24, 2020, to February 23, 2021). We included all patients who used telemedicine at least once in the first year after the policy was implemented and compared them with a control group of patients who never used telemedicine. The comparison focused on health care use; the medication possession ratio (MPR); and admission rates to general wards (GWs), emergency departments (EDs), and intensive care units (ICUs) using difference-in-differences analysis. A total of 4 chronic diseases were targeted: hypertension, diabetes mellitus (DM), chronic obstructive pulmonary disease (COPD), and common mental disorders. Results: A total of 1,773,454 patients with hypertension; 795,869 patients with DM; 37,460 patients with COPD; and 167,084 patients with common mental disorders were analyzed in this study. Patients diagnosed with hypertension or DM showed increased MPRs without an increase in GW, ED, or ICU admission rates during the policy year. Moreover, patients in the DM group who did not use telemedicine had higher rates of ED, GW, and ICU admissions, and patients in the hypertension group had higher rates of GW or ICU admissions after 1 year of policy implementation. This trend was not evident in COPD and common mental disorders. Conclusions: The temporary telemedicine policy was effective in increasing medication adherence and reducing admission rates for patients with hypertension and DM; however, the efficacy of the policy was limited for patients with COPD and common mental disorders. Future studies are required to demonstrate the long-term effects of telemedicine policies with various outcome measures reflecting disease characteristics.

Objective/Introduction: Sequential vital-sign information and trends in vital signs are useful for predicting changes in patient state. This study aims to predict latent shock by observing sequential changes in patient vital signs. Methods: The dataset for this retrospective study contained a total of 93,194 emergency department (ED) visits from January 1, 2016, and December 31, 2020, and Medical Information Mart for Intensive Care (MIMIC)-IV-ED data. We further divided the data into training and validation datasets by random sampling without replacement at a 7:3 ratio. We carried out external validation with MIMIC-IV-ED. Our prediction model included logistic regression (LR), random forest (RF) classifier, a multilayer perceptron (MLP), and a recurrent neural network (RNN). To analyze the model performance, we used area under the receiver operating characteristic curve (AUROC). Results: Data of 89,250 visits of patients who met prespecified criteria were used to develop a latent-shock prediction model. Data of 142,250 patient visits from MIMIC-IV-ED satisfying the same inclusion criteria were used for external validation of the prediction model. The AUROC values of prediction for latent shock were 0.822, 0.841, 0.852, and 0.830 with RNN, MLP, RF, and LR methods, respectively, at 3 h before latent shock. This is higher than the shock index or adjusted shock index. Conclusion: We developed a latent shock prediction model based on 24 h of vital-sign sequence that changed with time and predicted the results by individual.

Background and objectives: The aim of this study is to describe the temporal change in alert override with a minimally interruptive clinical decision support (CDS) on a Next-Generation electronic medical record (EMR) and analyze factors associated with the change. Materials and Methods: The minimally interruptive CDS used in this study was implemented in the hospital in 2016, which was a part of the new next-generation EMR, Data Analytics and Research Window for Integrated kNowledge (DARWIN), which does not generate modals, ‘pop-ups’ but show messages as in-line information. The prescription (medication order) and alerts data from July 2016 to December 2017 were extracted. Piece-wise regression analysis and linear regression analysis was performed to determine the temporal change and factors associated with it. Results: Overall, 2,706,395 alerts and 993 doctors were included in the study. Among doctors, 37.2% were faculty (professors), 17.2% were fellows, and 45.6% trainees (interns and residents). The overall override rate was 61.9%. There was a significant change in an increasing trend at month 12 (p < 0.001). We found doctors’ positions and specialties, along with the number of alerts and medication variability, were significantly associated with the change. Conclusions: In this study, we found a significant temporal change of alert override. We also found factors associated with the change, which had statistical significance.

Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Since its introduction, telemedicine for patients with chronic diseases has been studied in various clinical settings. However, there is limited evidence of the effectiveness and medical safety of the nationwide adoption of telemedicine. Objective: This study aimed to analyze the effects of telemedicine on chronic diseases during the COVID-19 pandemic under a temporary telemedicine policy in South Korea using national claims data. Methods: Health insurance claims data were extracted over 2 years: 1 year before (from February 24, 2019, to February 23, 2020) and 1 year after the policy was implemented (from February 24, 2020, to February 23, 2021). We included all patients who used telemedicine at least once in the first year after the policy was implemented and compared them with a control group of patients who never used telemedicine. The comparison focused on health care use; the medication possession ratio (MPR); and admission rates to general wards (GWs), emergency departments (EDs), and intensive care units (ICUs) using difference-in-differences analysis. A total of 4 chronic diseases were targeted: hypertension, diabetes mellitus (DM), chronic obstructive pulmonary disease (COPD), and common mental disorders. Results: A total of 1,773,454 patients with hypertension; 795,869 patients with DM; 37,460 patients with COPD; and 167,084 patients with common mental disorders were analyzed in this study. Patients diagnosed with hypertension or DM showed increased MPRs without an increase in GW, ED, or ICU admission rates during the policy year. Moreover, patients in the DM group who did not use telemedicine had higher rates of ED, GW, and ICU admissions, and patients in the hypertension group had higher rates of GW or ICU admissions after 1 year of policy implementation. This trend was not evident in COPD and common mental disorders. Conclusions: The temporary telemedicine policy was effective in increasing medication adherence and reducing admission rates for patients with hypertension and DM; however, the efficacy of the policy was limited for patients with COPD and common mental disorders. Future studies are required to demonstrate the long-term effects of telemedicine policies with various outcome measures reflecting disease characteristics.