BACKGROUND Thyroid nodules are extremely common and typically diagnosed with ultrasound whether benign or malignant. Imaging diagnosis assisted by Artificial Intelligence has attracted much attention in recent years. The aim of our study was to build an ensemble deep learning classification model to accurately differentiate benign and malignant thyroid nodules. MATERIAL AND METHODS Based on current advanced methods of image segmentation and classification algorithms, we proposed an ensemble deep learning classification model for thyroid nodules (EDLC-TN) after precise localization. We compared diagnostic performance with four other state-of-the-art deep learning algorithms and three ultrasound radiologists according to ACR TI-RADS criteria. Finally, we demonstrated the general applicability of EDLC-TN for diagnosing thyroid cancer using ultrasound images from multi medical centers. RESULTS The method proposed in this paper has been trained and tested on a thyroid ultrasound image dataset containing 26 541 images and the accuracy of this method could reach 98.51%. EDLC-TN demonstrated the highest value for area under the curve, sensitivity, specificity, and accuracy among five state-of-the-art algorithms. Combining EDLC-TN with models and radiologists could improve diagnostic accuracy. EDLC-TN achieved excellent diagnostic performance when applied to ultrasound images from another independent hospital. CONCLUSIONS Based on ensemble deep learning, the proposed approach in this paper is superior to other similar existing methods of thyroid classification, as well as ultrasound radiologists. Moreover, our network represents a generalized platform that potentially can be applied to medical images from multiple medical centers.
The number of studies on deep learning in artificial intelligence (AI)-assisted diagnosis of thyroid nodules is increasing. However, it is difficult to explain what the models actually learn in artificial intelligence-assisted medical research. Our aim is to investigate the visual interpretability of the computer-assisted diagnosis of malignant and benign thyroid nodules using ultrasound images. We designed and implemented 2 experiments to test whether our proposed model learned to interpret the ultrasound features used by ultrasound experts to diagnose thyroid nodules. First, in an anteroposterior/transverse (A/T) ratio experiment, multiple models were trained by changing the A/T ratio of the original nodules, and their classification, accuracy, sensitivity, and specificity were tested. Second, in a visualization experiment, class activation mapping used global average pooling and a fully connected layer to visualize the neural network to show the most important features. We also examined the importance of data preprocessing. The A/T ratio experiment showed that after changing the A/T ratio of the nodules, the accuracy of the neural network model was reduced by 9.24–30.45%, indicating that our neural network model learned the A/T ratio information of the nodules. The visual experiment results showed that the nodule margins had a strong influence on the prediction of the neural network. This study was an active exploration of interpretability in the deep learning classification of thyroid nodules. It demonstrated the neural network-visualized model focused on irregular nodule margins and the A/T ratio to classify thyroid nodules.
25 August 2020 in Medical & Biological Engineering & Computing
Background: Prolonged treatment of HER2+ breast cancer with lapatinib (LAP) causes cellular senescence and acquired drug resistance, which often associating with poor prognosis for patients. We aim to explore the correlation between cellular senescence and LAP resistance in HER2+ breast cancer, screen for molecular marker of reversible senescence, and construct targeted nanobubbles for ultrasound molecular imaging to dynamically evaluate LAP resistance.Methods and Results: In this study, we established a new cellular model of reversible cellular senescence using LAP and HER2+ breast cancer cells and found that reversible senescence contributed to LAP resistance in HER2+ breast cancer. Then, we identified ecto‐5′‐nucleotidase (NT5E) as a marker of reversible senescence in HER2+ breast cancer. Based on this, we constructed NT5E‐targeted nanobubbles (NT5E‐FITC‐NBs) as a new molecular imaging modality which could both target reversible senescent cells and be used for ultrasound imaging. NT5E‐FITC‐NBs showed excellent physical and imaging characteristics. As an ultrasound contrast agent, NT5E‐FITC‐NBs could accurately identify reversible senescent cells both in vitro and in vivo.Conclusions: Our data demonstrate that cellular senescence‐based ultrasound‐targeted imaging can identify reversible senescence and evaluate LAP resistance effectively in HER2+ breast cancer cells, which has the potential to improve cancer treatment outcomes by altering therapeutic strategies ahead of aggressive recurrences.