21 January 2024 in International Journal of Medical Informatics
Aim to establish a multimodal model for predicting severe acute pancreatitis (SAP) using machine learning (ML) and deep learning (DL). In this multicentre retrospective study, patients diagnosed with acute pancreatitis at admission were enrolled from January 2017 to December 2021. Clinical information within 24 h and CT scans within 72 h of admission were collected. First, we trained Model α based on clinical features selected by least absolute shrinkage and selection operator analysis. Second, radiomics features were extracted from 3D-CT scans and Model β was developed on the features after dimensionality reduction using principal component analysis. Third, Model γ was trained on 2D-CT images. Lastly, a multimodal model, namely PrismSAP, was constructed based on aforementioned features in the training set. The predictive accuracy of PrismSAP was verified in the validation and internal test sets and further validated in the external test set. Model performance was evaluated using area under the curve (AUC), accuracy, sensitivity, specificity, recall, precision and F1-score. A total of 1,221 eligible patients were randomly split into a training set (n = 864), a validation set (n = 209) and an internal test set (n = 148). Data of 266 patients were for external testing. In the external test set, PrismSAP performed best with the highest AUC of 0.916 (0.873-0.960) among all models [Model α: 0.709 (0.618-0.800); Model β: 0.749 (0.675-0.824); Model γ: 0.687 (0.592-0.782); MCTSI: 0.778 (0.698-0.857); RANSON: 0.642 (0.559-0.725); BISAP: 0.751 (0.668-0.833); SABP: 0.710 (0.621-0.798)]. The proposed multimodal model outperformed any single-modality models and traditional scoring systems.
11 October 2023 in Journal of International Medical Research
Objective: Esophageal varix (EV) bleeding is a particularly serious complications of cirrhosis. Prediction of EV bleeding requires extensive endoscopy experience; it remains unreliable and inefficient. This retrospective cohort study evaluated the feasibility of using deep learning (DL) to predict the 12-month risk of EV bleeding based on endoscopic images. Methods: Six DL models were trained to perform binary classification of endoscopic images of EV bleeding. The models were subsequently validated using an external test dataset, then compared with classifications performed by two endoscopists. Results: In the validation dataset, EfficientNet had the highest accuracy (0.910), followed by ConvMixer (0.898) and Xception (0.875). In the test dataset, EfficientNet maintained the highest accuracy (0.893), which was better than the endoscopists (0.800 and 0.763). Notably, one endoscopist displayed higher recall (0.905), compared with EfficientNet (0.870). When their predictions were assisted by artificial intelligence, the accuracies of the two endoscopists increased by 17.3% and 19.0%. Moreover, statistical agreement among the models was dependent on model architecture. Conclusions: This study demonstrated the feasibility of using DL to predict the 12-month risk of EV bleeding based on endoscopic images. The findings suggest that artificial intelligence-aided diagnosis will be a useful addition to cirrhosis management.
28 September 2024 in Journal of International Medical Research
Objective: Artificial intelligence (AI) could help medical practitioners in analyzing radiological images to determine the presence and site of bowel obstruction. This retrospective diagnostic study proposed a series of deep learning (DL) models for diagnosing bowel obstruction on abdominal radiograph. Methods: A total of 2082 upright plain abdominal radiographs were retrospectively collected from four hospitals. The images were labeled as normal, small bowel obstruction and large bowel obstruction by three senior radiologists based on comprehensive examinations and interventions within 48 hours after admission. Gradient-weighted class activation mapping was used to visualize the inferential explanation. Results: In the validation set, the Xception-backboned model achieved the highest accuracy (0.863), surpassing the VGG16 (0.847) and ResNet models (0.836). In the test set, the Xception model (accuracy: 0.807) outperformed other models and a junior radiologist (0.780) but not a senior radiologist (0.840). In the AI-aided diagnostic framework, the junior and senior radiologists made their judgements while aware of the Xception model predictions. Their accuracy significantly improved to 0.887 and 0.913, respectively. Conclusions: We developed and validated DL-based computer vision models for diagnosing bowel obstruction on plain abdominal radiograph. DL-based computer-aided diagnostic systems could reduce medical practitioners’ workloads and improve diagnostic accuracy.
22 September 2025 in Journal of International Medical Research
Aims: This study aimed to develop and validate a multimodal predictive model for the risk of strangulation in adhesive small bowel obstruction by integrating deep learning–based computed tomography imaging features and clinical electronic health records. Methods: A retrospective, observational, multicenter study was conducted across three hospitals, with data from 225 patients used for model development and 123 patients for external validation. A three-dimensional convolutional neural network with a ResNet50 backbone was used to segment abdominal regions from computed tomography scans and classify strangulation risk. The multimodal model integrated deep learning predictions with top electronic health record features using the XGBoost algorithm; global and local interpretability were achieved through variable importance ranking and local interpretable model-agnostic explanations. Results: The multimodal model demonstrated superior performance in predicting strangulation within 7 days of admission, achieving an area under the curve of 0.915 in the training set and 0.912 in the test set, outperforming single-modality models. Calibration plots showed good alignment between predicted and observed outcomes, decision curve analysis demonstrated significant clinical utility, and net reclassification improvement confirmed that deep learning enhanced the model’s predictive ability. Conclusion: This study highlights the potential of multimodal artificial intelligence combined with clinical data to improve diagnostic accuracy and support clinical decision making in adhesive small bowel obstruction.
30 September 2025 in Journal of International Medical Research
Objective: To develop an explainable ResNet–long short-term memory model based on multifeature fusion for classifying bowel sound frequency—a key indicator of gastrointestinal motility. Accurate and objective classification of bowel sound activity levels holds significant clinical value in clinical settings. Methods: As a prospective multicenter study conducted across three medical institutions, the primary outcome involved three-way classification of bowel sounds as normoactive, hyperactive, or hypoactive. Bowel sounds were collected and segmented into 10-s clips. Audio features—Chroma, Filter Bank Energies, and Mel-Frequency Cepstral Coefficients—were extracted to train deep learning models using transfer learning with ResNet50 V2, followed by feature fusion and classification via long short-term memory and automated machine learning methods. Results: The independent test demonstrated superior performance of the long short-term memory model, achieving an accuracy of 0.927, Matthew’s correlation coefficient of 0.885, and weighted Cohen’s kappa of 0.930—outperforming both automated machine learning models and gastroenterologists. Additionally, the model was evaluated in two clinical scenarios: (a) feeding timing after general anesthesia and (b) bowel preparation for colonoscopy, showing high sensitivity and specificity. Local interpretable model-agnostic explanations were used to enhance model transparency. Conclusions: This framework offers a novel, accurate, and explainable approach for bowel sound classification, demonstrating strong potential for clinical applications in gastrointestinal function assessment.
13 January 2026 in Journal of International Medical Research
Objectives: This study aimed to develop a multimodal predictive model that integrates clinical data, radiomics, and three-dimensional deep learning to forecast acute respiratory distress syndrome in patients with acute pancreatitis. Methods: This retrospective study analyzed data from 759 patients with acute pancreatitis treated at three hospitals. Radiomics features were extracted from three-dimensional computed tomography images, and a three-dimensional deep learning model was developed using convolutional networks. These components were combined with clinical data using the XGBoost algorithm to construct a multimodal model. The performance of the model was compared with that of single-modal models and traditional scoring systems (Modified Computed Tomography Severity Index, Ranson score, and Bedside Index for Severity in Acute Pancreatitis), using area under the curve as the primary metric. Model interpretability was enhanced using variable importance analysis, SHapley Additive exPlanations, local interpretable model-agnostic explanations, calibration plots, and decision curve analysis. Results: The multimodal model achieved area under the curve values of 0.872 (training set) and 0.876 (test set), outperforming traditional scores (Modified Computed Tomography Severity Index: 0.747 and 0.759; Ranson score: 0.575 and 0.568; and Bedside Index for Severity in Acute Pancreatitis: 0.748 and 0.757, respectively) and single-modal models (radiomics: 0.638 and 0.727 and deep learning: 0.756 and 0.727, respectively). Conclusion: By integrating clinical tabular data, radiomics, and deep learning features, the multimodal model can predict the risk of acute respiratory distress syndrome in patients with acute pancreatitis at an early stage.