Objective. Sparse-view computed tomography (SVCT), which can reduce the radiation doses administered to patients and hasten data acquisition, has become an area of particular interest to researchers. Most existing deep learning-based image reconstruction methods are based on convolutional neural networks (CNNs). Due to the locality of convolution and continuous sampling operations, existing approaches cannot fully model global context feature dependencies, which makes the CNN-based approaches less efficient in modeling the computed tomography (CT) images with various structural information. Approach. To overcome the above challenges, this paper develops a novel multi-domain optimization network based on convolution and swin transformer (MDST). MDST uses swin transformer block as the main building block in both projection (residual) domain and image (residual) domain sub-networks, which models global and local features of the projections and reconstructed images. MDST consists of two modules for initial reconstruction and residual-assisted reconstruction, respectively. The sparse sinogram is first expanded in the initial reconstruction module with a projection domain sub-network. Then, the sparse-view artifacts are effectively suppressed by an image domain sub-network. Finally, the residual assisted reconstruction module to correct the inconsistency of the initial reconstruction, further preserving image details. Main results . Extensive experiments on CT lymph node datasets and real walnut datasets show that MDST can effectively alleviate the loss of fine details caused by information attenuation and improve the reconstruction quality of medical images. Significance. MDST network is robust and can effectively reconstruct images with different noise level projections. Different from the current prevalent CNN-based networks, MDST uses transformer as the main backbone, which proves the potential of transformer in SVCT reconstruction.
Spectral computed tomography (CT) can divide collected photons into multi-energy channels and gain multi-channel projections synchronously by using photon-counting detectors. However, reconstructed images usually contain severe noise due to the limited number of photons in the corresponding energy channel. Tensor dictionary learning (TDL)-based methods have achieved better performance, but usually lose image edge information and details, especially from an under-sampling dataset. To address this problem, this paper proposes a method termed TDL with an enhanced sparsity constraint for spectral CT reconstruction. The proposed algorithm inherits the superiority of TDL by exploring the correlation of spectral CT images. Moreover, the method designs a regularization using the L0-norm of the image gradient to constrain images and the difference between images and a prior image in each energy channel simultaneously, further improving the ability to preserve edge information and subtle image details. The split-Bregman algorithm has been applied to address the proposed objective minimization model. Several numerical simulations and realistic preclinical mice are studied to assess the effectiveness of the proposed algorithm. The results demonstrate that the proposed method improves the quality of spectral CT images in terms of noise elimination, edge preservation, and image detail recovery compared to the several existing better methods.
2 September 2022 in IEEE Transactions on Computational Imaging
The prediction of the internal ballistic performance of solid rocket motors (SRMs) mainly depends on the observation of burning surface regression. The existing techniques have not yet achieved real-time, accurate and intuitive observations of the grain structural dynamic changes under hot conditions. Computed tomography (CT) imaging based on X-ray can be directly used to analyze the burning surface of SRM. However, neither the conventional CT imaging mode nor the current reconstruction algorithms, including full-view and sparse-view reconstruction methods, can be used in ignition tests. It is necessary to break through the limitation of sparse sampling and research ultra-sparse view reconstruction. Although computer vision technology has shown that 3D shapes can be estimated from very few 2D RGB images via deep learning, it remains challenging to reconstruct volumes from two 2D X-ray images. To tackle this issue here, we propose a 3D reconstruction network based on ultra-sparse projection views, namely X-ray2CTNet, which takes the 2D projections of any two orthogonal views as inputs to implement cross-dimensional inverse mapping from 2D (X-rays) to 3D (CT). In addition, to solve the insufficient dataset problem, training sets are constructed by simulating different models of grain regression for a certain type of propellant and utilizing a CT simulation platform. We pour fake grains that are the same as those of the simulation models to acquire the actual projections of two views for reconstructing the 3D volume. The obtained results prove the feasibility of our method. The proposed method provides a possibility for dynamic monitoring of burning surface regressions for SRMs in ground ignition tests.
26 February 2024 in Machine Learning: Science and Technology
Monitoring the burning surface regression in ground static ignition tests is crucial for predicting the internal ballistic performance of solid rocket motors (SRMs). A previously proposed ultra-sparse computed tomography imaging method provides a possibility for real-time monitoring. However, sample shortages of SRMs highlights the need for monitoring accuracy, especially given the high cost associated with the design and development of SRM systems. Therefore, constructing datasets via regression simulations to compensate for SRM sample shortages is critical. To address this issue, we recommend adopting the level-set method to dynamically track the burning surface by solving partial differential equations (PDEs). The computational cost of numerical solution is prohibitive for scientific applications involving large-scale spatiotemporal domains. The physics-informed neural network (PINN) and neural operator have been used to accelerate the solution of PDE, showing satisfactory prediction performance and high computational efficiency. We designed a physics-guided network, named LS-PhyNet, that couples the potential physical mechanisms of burning surface regression into the deep learning framework. The proposed method is capable of encoding well-established traditional numerical discretization methods into the network architecture to leverage prior knowledge of underlying physics, thus providing the model with enhanced expressive power and interpretability. Experimental results prove that LS-PhyNet can better reproduce the burning surfaces obtained by numerical solution with only small data regimes, providing a new paradigm for real-time monitoring of burning surface regression transients during static ignition tests.
The problem of sparse-view computed tomography (SVCT) reconstruction has become a popular research issue because of its significant capacity for radiation dose reduction. However, the reconstructed images often contain serious artifacts and noise from under-sampled projection data. Although the good results achieved by the prior image constrained compressed sensing (PICCS) method, there may be some unsatisfactory results in the reconstructed images because of the image gradient L1-norm used in the original PICCS model, which leads to the image suffering from step artifacts and over-smoothing of the edge as a result. To address the above-mentioned problem, this paper proposes a novel improved PICCS algorithm (NPICCS) for SVCT reconstruction. The proposed algorithm utilizes the advantages of PICCS, which could recover more details. Moreover, the algorithm introduces the L0-norm of image gradient regularization into the framework, which overcomes the disadvantage of conventional PICCS, and enhances the capability to retain edge and fine image detail. The split Bregman method has been used to resolve the proposed mathematical model. To verify the effectiveness of the proposed method, a large number of experiments with different angles are conducted. Final experimental results show that the proposed algorithm has advantages in edge preservation, noise suppression, and image detail recovery.