Coronavirus disease 2019 (COVID-19) caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is spreading rapidly around the world, resulting in a massive death toll. Lung infection or pneumonia is the common complication of COVID-19, and imaging techniques, especially computed tomography (CT), have played an important role in diagnosis and treatment assessment of the disease. Herein, we review the imaging characteristics and computing models that have been applied for the management of COVID-19. CT, positron emission tomography - CT (PET/CT), lung ultrasound, and magnetic resonance imaging (MRI) have been used for detection, treatment, and follow-up. The quantitative analysis of imaging data using artificial intelligence (AI) is also explored. Our findings indicate that typical imaging characteristics and their changes can play crucial roles in the detection and management of COVID-19. In addition, AI or other quantitative image analysis methods are urgently needed to maximize the value of imaging in the management of COVID-19.

An artificial intelligence model based on the American College of Radiology Thyroid Imaging Reporting and Data System was developed to differentiate between malignant and benign nodules as well as ... Background US-based diagnosis of thyroid nodules is subjective and influenced by radiologists’ experience levels. Purpose To develop an artificial intelligence model based on American College of Ra...

Synthetic digital mammography (SDM), a 2D image generated from digital breast tomosynthesis (DBT), is used as a potential substitute for full-field digital mammography (FFDM) in clinic to reduce the radiation dose for breast cancer screening. Previous studies exploited projection geometry and fused projection data and DBT volume, with different post-processing techniques applied on re-projection data which may generate different image appearance compared to FFDM. To alleviate this issue, one possible solution to generate an SDM image is using a learning-based method to model the transformation from the DBT volume to the FFDM image using current DBT/FFDM combo images. In this study, we proposed to use a deep convolutional neural network (DCNN) to learn the transformation to generate SDM using current DBT/FFDM combo images. Gradient guided conditional generative adversarial networks (GGGAN) objective function was designed to preserve subtle MCs and the perceptual loss was exploited to improve the performance of the proposed DCNN on perceptual quality. We used various image quality criteria for evaluation, including preserving masses and MCs which are important in mammogram. Experiment results demonstrated progressive performance improvement of network using different objective functions in terms of those image quality criteria. The methodology we exploited in the SDM generation task to analyze and progressively improve image quality by designing objective functions may be helpful to other image generation tasks.

Objective. Whole slide images (WSIs) play a crucial role in histopathological analysis. The extremely high resolution of WSIs makes it laborious to obtain fine-grade annotations. Hence, classifying WSIs with only slide-level labels is often cast as a multiple instance learning (MIL) problem where a WSI is regarded as a bag and tiled into patches that are regarded as instances. The purpose of this study is to develop a novel MIL method for classifying WSIs with only slide-level labels in histopathology analysis. Approach. We propose a novel iterative MIL (IMIL) method for WSI classification where instance representations and bag representations are learned collaboratively. In particular, IMIL iteratively finetune the feature extractor with selected instances and corresponding pseudo labels generated by attention-based MIL pooling. Additionally, three procedures for robust training of IMIL are adopted: (1) the feature extractor is initialized by utilizing self-supervised learning methods on all instances, (2) samples for finetuning the feature extractor are selected according to the attention scores, and (3) a confidence-aware loss is applied for finetuning the feature extractor. Main results. Our proposed IMIL-SimCLR archives the optimal classification performance on Camelyon16 and KingMed-Lung. Compared with the baseline method CLAM, IMIL-SimCLR significantly outperforms it by 3.71% higher average area under curve (AUC) on Camelyon16 and 4.25% higher average AUC on KingMed-Lung. Additionally, our proposed IMIL-ImageNet achieve the optimal classification performance on TCGA-Lung with the average AUC of 96.55% and the accuracy of 96.76%, which significantly outperforms the baseline method CLAM by 1.65% higher average AUC and 2.09% higher average accuracy respectively. Significance. Experimental results on a public lymph node metastasis dataset, a public lung cancer diagnosis dataset and an in-house lung cancer diagnosis datasets show the effectiveness of our proposed IMIL method across different WSI classification tasks compared with other state-of-the-art MIL methods.

Fibroglandular tissue (FGT) segmentation is a crucial step for quantitative analysis of background parenchymal enhancement (BPE) in magnetic resonance imaging (MRI), which is useful for breast cancer risk assessment. In this study, we develop an automated deep learning method based on a generative adversarial network (GAN) to identify the FGT region in MRI volumes and evaluate its impact on a specific clinical application. The GAN consists of an improved U-Net as a generator to generate FGT candidate areas and a patch deep convolutional neural network (DCNN) as a discriminator to evaluate the authenticity of the synthetic FGT region. The proposed method has two improvements compared to the classical U-Net: (1) the improved U-Net is designed to extract more features of the FGT region for a more accurate description of the FGT region; (2) a patch DCNN is designed for discriminating the authenticity of the FGT region generated by the improved U-Net, which makes the segmentation result more stable and accurate. A dataset of 100 three-dimensional (3D) bilateral breast MRI scans from 100 patients (aged 22–78 years) was used in this study with Institutional Review Board (IRB) approval. 3D hand-segmented FGT areas for all breasts were provided as a reference standard. Five-fold cross-validation was used in training and testing of the models. The Dice similarity coefficient (DSC) and Jaccard index (JI) values were evaluated to measure the segmentation accuracy. The previous method using classical U-Net was used as a baseline in this study. In the five partitions of the cross-validation set, the GAN achieved DSC and JI values of 87.0 ± 7.0% and 77.6 ± 10.1%, respectively, while the corresponding values obtained through by the baseline method were 81.1 ± 8.7% and 69.0 ± 11.3%, respectively. The proposed method is significantly superior to the previous method using U-Net. The FGT segmentation impacted the BPE quantification application in the following manner: the correlation coefficients between the quantified BPE value and BI-RADS BPE categories provided by the radiologist were 0.46 ± 0.15 (best: 0.63) based on GAN segmented FGT areas, while the corresponding correlation coefficients were 0.41 ± 0.16 (best: 0.60) based on baseline U-Net segmented FGT areas. BPE can be quantified better using the FGT areas segmented by the proposed GAN model than using the FGT areas segmented by the baseline U-Net.