Triage is a process to accurately assess and classify symptoms to identify and provide rapid treatment to patients. The Korean Triage and Acuity Scale (KTAS) is used as a triage instrument in all emergency centers. The aim of this study was to train and compare machine learning models to predict KTAS levels. This was a cross-sectional study using data from a single emergency department of a tertiary university hospital. Information collected during triage was used in the analysis. Logistic regression, random forest, and XGBoost were used to predict the KTAS level. The models with the highest area under the receiver operating characteristic curve (AUROC) were the random forest and XGBoost models trained on the entire dataset (AUROC = 0.922, 95% confidence interval 0.917-0.925 and AUROC = 0.922, 95% confidence interval 0.918-0.925, respectively). The AUROC of the models trained on the clinical data was higher than that of models trained on text data only, but the models trained on all variables had the highest AUROC among similar machine learning models. Machine learning can robustly predict the KTAS level at triage, which may have many possibilities for use, and the addition of text data improves the predictive performance compared to that achieved by using structured data alone.
12 June 2020 in Journal of Medical Internet Research
Background: South Korea took preemptive action against coronavirus disease (COVID-19) by implementing extensive testing, thorough epidemiological investigation, strict social distancing, and rapid treatment of patients according to disease severity. The Korean government entrusted large-scale hospitals with the operation of living and treatment support centers (LTSCs) for the management for clinically healthy COVID-19 patients. Objective: The aim of this paper is to introduce our experience implementing information and communications technology (ICT)-based remote patient management systems at a COVID-19 LTSC. Methods: We adopted new electronic health record templates, hospital information system (HIS) dashboards, cloud-based medical image sharing, a mobile app, and smart vital sign monitoring devices. Results: Enhancements were made to the HIS to assist in the workflow and care of patients in the LTSC. A dashboard was created for the medical staff to view the vital signs and symptoms of all patients. Patients used a mobile app to consult with their physician or nurse, answer questionnaires, and input self-measured vital signs; the results were uploaded to the hospital information system in real time. Cloud-based image sharing enabled interoperability between medical institutions. Korea’s strategy of aggressive mitigation has “flattened the curve” of the rate of infection. A multidisciplinary approach was integral to develop systems supporting patient care and management at the living and treatment support center as quickly as possible. Conclusions: Faced with a novel infectious disease, we describe the implementation and experience of applying an ICT-based patient management system in the LTSC affiliated with Seoul National University Hospital. ICT-based tools and applications are increasingly important in health care, and we hope that our experience will provide insight into future technology-based infectious disease responses.
Machine learning requires a large volume of sample data, especially when it is used in high-accuracy medical applications. However, patient records are one of the most sensitive private information that is not usually shared among institutes. This paper presents spatio-temporal split learning, a distributed deep neural network framework, which is a turning point in allowing collaboration among privacy-sensitive organizations. Our spatio-temporal split learning presents how distributed machine learning can be efficiently conducted with minimal privacy concerns. The proposed split learning consists of a number of clients and a centralized server. Each client has only has one hidden layer, which acts as the privacy-preserving layer, and the centralized server comprises the other hidden layers and the output layer. Since the centralized server does not need to access the training data and trains the deep neural network with parameters received from the privacy-preserving layer, privacy of original data is guaranteed. We have coined the term, spatio-temporal split learning, as multiple clients are spatially distributed to cover diverse datasets from different participants, and we can temporally split the learning process, detaching the privacy preserving layer from the rest of the learning process to minimize privacy breaches. This paper shows how we can analyze the medical data whilst ensuring privacy using our proposed multi-site spatio-temporal split learning algorithm on Coronavirus Disease-19 (COVID-19) chest Computed Tomography (CT) scans, MUsculoskeletal RAdiographs (MURA) X-ray images, and cholesterol levels.
Smoking is an important variable for clinical research, but there are few studies regarding automatic obtainment of smoking classification from unstructured bilingual electronic health records (EHR). We aim to develop an algorithm to classify smoking status based on unstructured EHRs using natural language processing (NLP). With acronym replacement and Python package Soynlp, we normalize 4711 bilingual clinical notes. Each EHR notes was classified into 4 categories: current smokers, past smokers, never smokers, and unknown. Subsequently, SPPMI (Shifted Positive Point Mutual Information) is used to vectorize words in the notes. By calculating cosine similarity between these word vectors, keywords denoting the same smoking status are identified. Compared to other keyword extraction methods (word co-occurrence-, PMI-, and NPMI-based methods), our proposed approach improves keyword extraction precision by as much as 20.0%. These extracted keywords are used in classifying 4 smoking statuses from our bilingual EHRs. Given an identical SVM classifier, the F1 score is improved by as much as 1.8% compared to those of the unigram and bigram Bag of Words. Our study shows the potential of SPPMI in classifying smoking status from bilingual, unstructured EHRs. Our current findings show how smoking information can be easily acquired for clinical practice and research.
27 July 2022 in Journal of Medical Internet Research
Background: A clinical decision support system (CDSS) is recognized as a technology that enhances clinical efficacy and safety. However, its full potential has not been realized, mainly due to clinical data standards and noninteroperable platforms. Objective: In this paper, we introduce the common data model–based intelligent algorithm network environment (CANE) platform that supports the implementation and deployment of a CDSS. Methods: CDSS reasoning engines, usually represented as R or Python objects, are deployed into the CANE platform and converted into C# objects. When a clinician requests CANE-based decision support in the electronic health record (EHR) system, patients’ information is transformed into Health Level 7 Fast Healthcare Interoperability Resources (FHIR) format and transmitted to the CANE server inside the hospital firewall. Upon receiving the necessary data, the CANE system’s modules perform the following tasks: (1) the preprocessing module converts the FHIRs into the input data required by the specific reasoning engine, (2) the reasoning engine module operates the target algorithms, (3) the integration module communicates with the other institutions’ CANE systems to request and transmit a summary report to aid in decision support, and (4) creates a user interface by integrating the summary report and the results calculated by the reasoning engine. Results: We developed a CANE system such that any algorithm implemented in the system can be directly called through the RESTful application programming interface when it is integrated with an EHR system. Eight algorithms were developed and deployed in the CANE system. Using a knowledge-based algorithm, physicians can screen patients who are prone to sepsis and obtain treatment guides for patients with sepsis with the CANE system. Further, using a nonknowledge-based algorithm, the CANE system supports emergency physicians’ clinical decisions about optimum resource allocation by predicting a patient’s acuity and prognosis during triage. Conclusions: We successfully developed a common data model–based platform that adheres to medical informatics standards and could aid artificial intelligence model deployment using R or Python.
Background: Digital health care is an important strategy in the war against COVID-19. South Korea introduced living and treatment support centers (LTSCs) to control regional outbreaks and care for patients with asymptomatic or mild COVID-19. Seoul National University Hospital (SNUH) introduced information and communications technology (ICT)–based solutions to manage clinically healthy patients with COVID-19. Objective: This study aims to investigate satisfaction and usability by patients and health professionals in the optimal use of a mobile app and wearable device that SNUH introduced to the LTSC for clinically healthy patients with COVID-19. Methods: Online surveys and focus group interviews were conducted to collect quantitative and qualitative data. Results: Regarding usability testing of the wearable device, perceived usefulness had the highest mean score of 4.45 (SD 0.57) points out of 5. Regarding usability of the mobile app, perceived usefulness had the highest mean score of 4.62 (SD 0.48) points out of 5. Regarding satisfaction items for the mobile app among medical professionals, the “self-reporting” item had the highest mean score of 4.42 (SD 0.58) points out of 5. In focus group interviews of health care professionals, hospital information system interfacing was the most important functional requirement for ICT-based COVID-19 telemedicine. Conclusions: Improvement of patient safety and reduction of the burden on medical staff were the expected positive outcomes. Stability and reliability of the device, patient education, accountability, and reimbursement issues should be considered as part of the development of remote patient monitoring. In responding to a novel contagious disease, telemedicine and a wearable device were shown to be useful during a global crisis.
About Me
Office of Hospital Information. Department of Emergency Medicine.
Office of Hospital Information. Department of Emergency Medicine.