Elastography ultrasound (EUS) imaging is a vital ultrasound imaging modality. The current use of EUS faces many challenges, such as vulnerability to subjective manipulation, echo signal attenuation, and unknown risks of elastic pressure in certain delicate tissues. The hardware requirement of EUS also hinders the trend of miniaturization of ultrasound equipment. Here we show a cost-efficient solution by designing a deep neural network to synthesize virtual EUS (V-EUS) from conventional B-mode images. A total of 4580 breast tumor cases were collected from 15 medical centers, including a main cohort with 2501 cases for model establishment, an external dataset with 1730 cases and a portable dataset with 349 cases for testing. In the task of differentiating benign and malignant breast tumors, there is no significant difference between V-EUS and real EUS on high-end ultrasound, while the diagnostic performance of pocket-sized ultrasound can be improved by about 5% after V-EUS is equipped.
The differentiation between benign and malignant breast tumors extends beyond morphological structures to encompass functional alterations within the nodules. The combination of photoacoustic (PA) imaging and radiomics unveils functional insights and intricate details that are imperceptible to the naked eye. This study aims to assess the efficacy of PA imaging in breast cancer radiomics, focusing on the impact of peritumoral region size on radiomic model accuracy. From January 2022 to November 2023, data were collected from 358 patients with breast nodules, diagnosed via PA/US examination and classified as BI-RADS 3–5. The study used the largest lesion dimension in PA images to define the region of interest, expanded by 2 mm, 5 mm, and 8 mm, for extracting radiomic features. Techniques from statistics and machine learning were applied for feature selection, and logistic regression classifiers were used to build radiomic models. These models integrated both intratumoral and peritumoral data, with logistic regressions identifying key predictive features. The developed nomogram, combining 5 mm peritumoral data with intratumoral and clinical features, showed superior diagnostic performance, achieving an AUC of 0.950 in the training cohort and 0.899 in validation. This model outperformed those based solely on clinical features or other radiomic methods, with the 5 mm peritumoral region proving most effective in identifying malignant nodules. This research demonstrates the significant potential of PA imaging in breast cancer radiomics, especially the advantage of integrating 5 mm peritumoral with intratumoral features. This approach not only surpasses models based on clinical data but also underscores the importance of comprehensive radiomic analysis in accurately characterizing breast nodules.
We evaluated the diagnostic performance of a multimodal deep-learning (DL) model for ovarian mass differential diagnosis. This single-center retrospective study included 1,054 ultrasound (US)-detected ovarian tumors (699 benign and 355 malignant). Patients were randomly divided into training (n = 675), validation (n = 169), and testing (n = 210) sets. The model was developed using ResNet-50. Three DL-based models were proposed for benign-malignant classification of these lesions: single-modality model that only utilized US images; dual-modality model that used US images and menopausal status as inputs; and multi-modality model that integrated US images, menopausal status, and serum indicators. After 5-fold cross-validation, 210 lesions were tested. We evaluated the three models using the area under the curve (AUC), accuracy, sensitivity, and specificity. The multimodal model outperformed the single- and dual-modality models with 93.80% accuracy and 0.983 AUC. The Multimodal ResNet-50 DL model outperformed the single- and dual-modality models in identifying benign and malignant ovarian tumors.