Objective: The heterogeneous nature of sepsis renders determining its underlying causes difficult, which may delay diagnosis and intervention. VitalCare-SEPsis Score (VC-SEPS) is a deep learning-based algorithm that predicts sepsis and monitors patient conditions based on electronic medical record data. However, few studies have prospectively compared medical artificial intelligence software algorithms and traditional scoring systems to predict sepsis. This prospective observational study attempted to validate the predictive performance and risk stratification of VC-SEPS for early prediction of sepsis. Methods: In this prospective observational study, we collected electronic medical record data from 6,797 patients hospitalised at Keimyung University Dongsan Hospital, Daegu, South Korea. The final version of the analysed set included 6,455 patients, 325 of whom were diagnosed with sepsis. Results: The area under the receiver operating characteristic curve of VC-SEPS was 0.880, indicating its superiority over traditional scoring systems. The algorithm performance showed a consistent trend within 24 hours. On patients’ initial admission, the VC-SEPS was associated with the risk of developing sepsis, and the score accurately predicted sepsis by an average of 68.05 min compared with diagnosis time by an operational definition of sepsis. Discussion: VC-SEPS could assist medical staff with early diagnosis and intervention in clinical practice by providing a sepsis risk score. Prompt recognition assisting recognition can significantly help shorten the time between recognition and intervention in clinical decision-making processes. Conclusion: This study suggests that using a clinical decision support system can help improve hospital workflows as well as the quality of medical care.
Background: Acute deterioration of patients in general wards often leads to major adverse events (MAEs), including unplanned intensive care unit transfers, cardiac arrest, or death. Traditional early warning scores (EWSs) have shown limited predictive accuracy, with frequent false positives. We conducted a prospective observational external validation study of an artificial intelligence (AI)-based EWS, the VitalCare - Major Adverse Event Score (VC-MAES), at a tertiary medical center in the Republic of Korea. Methods: Adult patients from general wards, including internal medicine (IM) and obstetrics and gynecology (OBGYN)—the latter were rarely investigated in prior AI-based EWS studies—were included. The VC-MAES predictions were compared with National Early Warning Score (NEWS) and Modified Early Warning Score (MEWS) predictions using the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and logistic regression for baseline EWS values. False-positives per true positive (FPpTP) were assessed based on the power threshold. Results: Of 6,039 encounters, 217 (3.6%) had MAEs (IM: 9.5%, OBGYN: 0.26%). Six hours prior to MAEs, the VC-MAES achieved an AUROC of 0.918 and an AUPRC of 0.352, including the OBGYN subgroup (AUROC, 0.964; AUPRC, 0.388), outperforming the NEWS (0.797 and 0.124) and MEWS (0.722 and 0.079). The FPpTP was reduced by up to 71%. Baseline VC-MAES was strongly associated with MAEs (P<0.001). Conclusions: The VC-MAES significantly outperformed traditional EWSs in predicting adverse events in general ward patients. The robust performance and lower FPpTP suggest that broader adoption of the VC-MAES may improve clinical efficiency and resource allocation in general wards.
Background: Pneumonia-associated sepsis constitutes a significant portion of all sepsis cases and is a leading cause of sepsis-related morbidity and mortality. The clinical burden is especially pronounced in general ward settings, where delayed recognition can hinder timely intervention. This underscores the necessity for advanced tools that facilitate early detection. Methods: This retrospective, single-center study assessed an AI-driven deep learning model designed to predict in-hospital sepsis up to four hours in advance. We analyzed 7715 pneumonia cases identified through chest radiography or CT. The model’s performance was evaluated using AUROC, sensitivity, specificity, and lead time to sepsis onset and was compared against established scoring systems: NEWS, MEWS, SOFA, and qSOFA. Sepsis was defined according to the CDC Adult Sepsis Event criteria in alignment with Sepsis-3 guidelines. Results: The AI model exhibited strong performance in the early detection of sepsis among pneumonia patients, achieving an AUROC of 0.870, with a sensitivity of 76.7% and specificity of 84.1%. It significantly surpassed conventional scoring systems: NEWS (0.697), MEWS (0.661), SOFA (0.649), and qSOFA (0.678). Importantly, the model identified sepsis a median of 183 min earlier than recognition based on the operational definition. This lead-time advantage was consistent in the pneumonia cohort, where 18.3% of patients developed sepsis. Conclusions: The AI model demonstrated strong predictive capabilities for pneumonia-associated sepsis, facilitating earlier clinical decision-making. Integrating this model into EMR systems could be an effective strategy to enhance sepsis outcomes in general ward settings. Further prospective studies are needed to validate its effectiveness in real-time clinical applications.