Objective. Lesions of COVID-19 can be clearly visualized using chest CT images, and hence provide valuable evidence for clinicians when making a diagnosis. However, due to the variety of COVID-19 lesions and the complexity of the manual delineation procedure, automatic analysis of lesions with unknown and diverse types from a CT image remains a challenging task. In this paper we propose a weakly-supervised framework for this task requiring only a series of normal and abnormal CT images without the need for annotations of the specific locations and types of lesions. Approach. A deep learning-based diagnosis branch is employed for classification of the CT image and then a lesion identification branch is leveraged to capture multiple types of lesions. Main Results. Our framework is verified on publicly available datasets and CT data collected from 13 patients of the First Affiliated Hospital of Shantou University Medical College, China. The results show that the proposed framework can achieve state-of-the-art diagnosis prediction, and the extracted lesion features are capable of distinguishing between lesions showing ground glass opacity and consolidation. Significance. The proposed approach integrates COVID-19 positive diagnosis and lesion analysis into a unified framework without extra pixel-wise supervision. Further exploration also demonstrates that this framework has the potential to discover lesion types that have not been reported and can potentially be generalized to lesion detection of other chest-based diseases.
We established a deep learning-based dynamic light scattering (DLS) microscopy sensing mitochondria dynamic for label-free identification of triple-negative breast cancer (TNBC) cells. The capacity of DLS microscopy to detect the intracellular motility of subcellular scatters was verified with the analysis of the autocorrelation function. We also conducted an in-depth examination of the impact of mitochondrial dynamics on DLS within TNBC cells, employing confocal fluorescent imaging to visualize the morphology of the mitochondria. Furthermore, we applied the DLS microscopy incorporating the two-stream deep learning method to differentiate the TNBC subtype and HER2 positive breast cancer subtype, with the classification accuracy achieving 0.89.
Objective . In digital breast tomosynthesis (DBT), architectural distortion (AD) is a breast lesion that is difficult to detect. Compared with typical ADs, which have radial patterns, identifying a typical ADs is more difficult. Most existing computer-aided detection (CADe) models focus on the detection of typical ADs. This study focuses on atypical ADs and develops a deep learning-based CADe model with an adaptive receptive field in DBT. Approach . Our proposed model uses a Gabor filter and convergence measure to depict the distribution of fibroglandular tissues in DBT slices. Subsequently, two-dimensional (2D) detection is implemented using a deformable-convolution-based deep learning framework, in which an adaptive receptive field is introduced to extract global features in slices. Finally, 2D candidates are aggregated to form the three-dimensional AD detection results. The model is trained on 99 positive cases with ADs and evaluated on 120 AD-positive cases and 100 AD-negative cases. Main results . A convergence-measure-based model and deep-learning model without an adaptive receptive field are reproduced as controls. Their mean true positive fractions (MTPF) ranging from 0.05 to 4 false positives per volume are 0.3846 ± 0.0352 and 0.6501 ± 0.0380, respectively. Our proposed model achieves an MTPF of 0.7148 ± 0.0322, which is a significant improvement ( p < 0.05) compared with the other two methods. In particular, our model detects more atypical ADs, primarily contributing to the performance improvement. Significance . The adaptive receptive field helps the model improve the atypical AD detection performance. It can help radiologists identify more ADs in breast cancer screening.
Objective. To mitigate the potential radiation risk, low-dose single photon emission computed tomography (SPECT) is of increasing interest. Numerous deep learning-based methods have been developed to perform low-dose imaging while maintaining image quality. However, most existing methods seldom explore the unique inner-structure inherent within sinograms. In addition, traditional supervised learning methods require large-scale labeled data, where the normal-dose data serves as annotation and is intractable to acquire in low-dose imaging. In this study, we aim to develop a novel sinogram inner-structure-aware semi-supervised framework for the task of low-dose SPECT sinogram restoration. Approach. The proposed framework retains the strengths of UNet, meanwhile introducing a sinogram-structure-based non-local neighbors graph neural network (SSN-GNN) module and a window-based K-nearest neighbors GNN (W-KNN-GNN) module to effectively exploit the inherent inner-structure within SPECT sinograms. Moreover, the proposed framework employs the mean teacher semi-supervised learning approach to leverage the information available in abundant unlabeled low-dose sinograms. Main results. The datasets exploited in this study were acquired from the (Extended Cardiac-Torso) XCAT anthropomorphic digital phantoms, which provide realistic images for imaging research of various modalities. Quantitative as well as qualitative results demonstrate that the proposed framework achieves superior performance compared to several state-of-the-art reconstruction methods. To further validate the effectiveness of the proposed framework, ablation and robustness experiments were also performed. The experimental results show that each component of the proposed framework effectively improves the model performance, and the framework exhibits superior robustness with respect to various noise levels. Besides, the proposed semi-supervised paradigm showcases the efficacy of incorporating supplementary unlabeled low-dose sinograms. Significance. The proposed framework improves the quality of low-dose SPECT reconstructed images by utilizing sinogram inner-structure and incorporating supplementary unlabeled data, which provides an important tool for dose reduction without sacrificing the image quality.
Single-photon emission computed tomography (SPECT) is a widely used diagnostic tool, but radioactive radiation during imaging poses potential health risks to subjects. Accurate low-dose single-photon emission computed tomography reconstruction is crucial in clinical applications of single-photon emission computed tomography. However, it remains a challenging problem due to the high noise and low spatial resolution of the low-dose reconstructed single-photon emission computed tomography images. The aim of the study is to develop a deep learning based framework for high quality low-dose single-photon emission computed tomography reconstruction. In the proposed framework, the conditional generative adversarial network (CGAN) was used as backbone structure and a Residual Attention CSwin Transformer (RACT) block was introduced as the basic building block for the generator of conditional generative adversarial network. The proposed residual attention CSwin transformer block has a dual-branch structure, which integrates the local modeling capability of CNN and the global dependency modeling capability of Transformer to improve the quality of single-photon emission computed tomography reconstructed images. More importantly, a novel loss term based on the geometric tight framelet (GTF) was designed to better suppress noise for the single-photon emission computed tomography reconstructed image while preserving the details of image to the greatest extent. Monte Carlo simulation software SIMIND was used to produce low-dose single-photon emission computed tomography images dataset to evaluate the performance of the proposed method. The simulation results showed that the proposed method can reduce more noise and preserve more details of various situations compared to several recent methods. To further validate the performance of the proposed method, we also verified the generalization ability of the proposed method, which is more adaptable to different noise level scenarios than other methods. Our results indicated that the proposed framework has the potential to reduce the tracer dose required for single-photon emission computed tomography imaging without compromising the quality of the reconstructed images.
The goal of this study is to develop a new computed tomography (CT) image reconstruction method, aiming at improving the quality of the reconstructed images of existing methods while reducing computational costs. Existing CT reconstruction is modeled by pixel-based piecewise constant approximations of the integral equation that describes the CT projection data acquisition process. Using these approximations imposes a bottleneck model error and results in a discrete system of a large size. We propose to develop a content-adaptive unstructured grid (CAUG) based regularized CT reconstruction method to address these issues. Specifically, we design a CAUG of the image domain to sparsely represent the underlying image, and introduce a CAUG-based piecewise linear approximation of the integral equation by employing a collocation method. We further apply a regularization defined on the CAUG for the resulting ill-posed linear system, which may lead to a sparse linear representation for the underlying solution. The regularized CT reconstruction is formulated as a convex optimization problem, whose objective function consists of a weighted least square norm based fidelity term, a regularization term and a constraint term. Here, the corresponding weighted matrix is derived from the simultaneous algebraic reconstruction technique (SART). We then develop a SART-type preconditioned fixed-point proximity algorithm to solve the optimization problem. Convergence analysis is provided for the resulting iterative algorithm. Numerical experiments demonstrate the superiority of the proposed method over several existing methods in terms of both suppressing noise and reducing computational costs. These methods include the SART without regularization and with the quadratic regularization, the traditional total variation (TV) regularized reconstruction method and the TV superiorized conjugate gradient method on the pixel grid.