In this study, we present a fusion model for emotion recognition based on visual data. The proposed model uses video information as its input and generates emotion labels for each video sample. Based on the video data, we first choose the most significant face regions with the use of a face detection and selection step. Subsequently, we employ three CNN-based architectures to extract the high-level features of the face image sequence. Furthermore, we adjusted one additional module for each CNN-based architecture to capture the sequential information of the entire video dataset. The combination of the three CNN-based models in a late-fusion-based approach yields a competitive result when compared to the baseline approach while using two public datasets: AFEW 2016 and SAVEE.

The early detection and rapid quantification of acute ischemic lesions play pivotal roles in stroke management. We developed a deep learning algorithm for the automatic binary classification of the Alberta Stroke Program Early Computed Tomographic Score (ASPECTS) using diffusion-weighted imaging (DWI) in acute stroke patients. Three hundred and ninety DWI datasets with acute anterior circulation stroke were included. A classifier algorithm utilizing a recurrent residual convolutional neural network (RRCNN) was developed for classification between low (1–6) and high (7–10) DWI-ASPECTS groups. The model performance was compared with a pre-trained VGG16, Inception V3, and a 3D convolutional neural network (3DCNN). The proposed RRCNN model demonstrated higher performance than the pre-trained models and 3DCNN with an accuracy of 87.3%, AUC of 0.941, and F1-score of 0.888 for classification between the low and high DWI-ASPECTS groups. These results suggest that the deep learning algorithm developed in this study can provide a rapid assessment of DWI-ASPECTS and may serve as an ancillary tool that can assist physicians in making urgent clinical decisions.

The prediction of an occult invasive component in ductal carcinoma in situ (DCIS) before surgery is of clinical importance because the treatment strategies are different between pure DCIS without invasive component and upgraded DCIS. We demonstrated the potential of using deep learning models for differentiating between upgraded versus pure DCIS in DCIS diagnosed by core-needle biopsy. Preoperative axial dynamic contrast-enhanced magnetic resonance imaging (MRI) data from 352 lesions were used to train, validate, and test three different types of deep learning models. The highest performance was achieved by Recurrent Residual Convolutional Neural Network using Regions of Interest (ROIs) with an accuracy of 75.0% and area under the receiver operating characteristic curve (AUC) of 0.796. Our results suggest that the deep learning approach may provide an assisting tool to predict the histologic upgrade of DCIS and provide personalized treatment strategies to patients with underestimated invasive disease.

Purpose: This study utilized a radiomics approach combined with a machine learning algorithm to distinguish primary lung cancer (LC) from solitary lung metastasis (LM) in colorectal cancer (CRC) patients with a solitary pulmonary nodule (SPN). Materials and Methods: In a retrospective study, 239 patients who underwent chest computerized tomography (CT) at three different institutions between 2011 and 2019 and were diagnosed as primary LC or solitary LM were included. The data from the first institution were divided into training and internal testing datasets. The data from the second and third institutions were used as an external testing dataset. Radiomic features were extracted from the intra and perinodular regions of interest (ROI). After a feature selection process, Support vector machine (SVM) was used to train models for classifying between LC and LM. The performances of the SVM classifiers were evaluated with both the internal and external testing datasets. The performances of the model were compared to those of two radiologists who reviewed the CT images of the testing datasets for the binary prediction of LC versus LM. Results: The SVM classifier trained with the radiomic features from the intranodular ROI and achieved the sensitivity/specificity of 0.545/0.828 in the internal test dataset, and 0.833/0.964 in the external test dataset, respectively. The SVM classifier trained with the combined radiomic features from the intra- and perinodular ROIs achieved the sensitivity/specificity of 0.545/0.966 in the internal test dataset, and 0.833/1.000 in the external test data set, respectively. Two radiologists demonstrated the sensitivity/specificity of 0.545/0.966 and 0.636/0.828 in the internal test dataset, and 0.917/0.929 and 0.833/0.929 in the external test dataset, which were comparable to the performance of the model trained with the combined radiomics features. Conclusion: Our results suggested that the machine learning classifiers trained using radiomics features of SPN in CRC patients can be used to distinguish the primary LC and the solitary LM with a similar level of performance to radiologists.