Spine parsing (i.e., multi-class segmentation of vertebrae and intervertebral discs (IVDs)) for volumetric magnetic resonance (MR) image plays a significant role in various spinal disease diagnoses and treatments of spine disorders, yet is still a challenge due to the inter-class similarity and intra-class variation of spine images. Existing fully convolutional network based methods failed to explicitly exploit the dependencies between different spinal structures. In this paper, we propose a novel two-stage framework named SpineParseNet to achieve automated spine parsing for volumetric MR images. The SpineParseNet consists of a 3D graph convolutional segmentation network (GCSN) for 3D coarse segmentation and a 2D residual U-Net (ResUNet) for 2D segmentation refinement. In 3D GCSN, region pooling is employed to project the image representation to graph representation, in which each node representation denotes a specific spinal structure. The adjacency matrix of the graph is designed according to the connection of spinal structures. The graph representation is evolved by graph convolutions. Subsequently, the proposed region unpooling module re-projects the evolved graph representation to a semantic image representation, which facilitates the 3D GCSN to generate reliable coarse segmentation. Finally, the 2D ResUNet refines the segmentation. Experiments on T2-weighted volumetric MR images of 215 subjects show that SpineParseNet achieves impressive performance with mean Dice similarity coefficients of 87.32 ± 4.75%, 87.78 ± 4.64%, and 87.49 ± 3.81% for the segmentations of 10 vertebrae, 9 IVDs, and all 19 spinal structures respectively. The proposed method has great potential in clinical spinal disease diagnoses and treatments.
The lumen of aortic dissection (AD) has important clinical value for preoperative diagnosis, interoperative intervention, and post-operative evaluation of AD diseases. AD segmentation is challenging because (i) fitting its irregular profile by using traditional models is difficult, and (ii) the size of the AD image is usually so big that many algorithms have to perform down-sampling to reduce the computational burden, thereby reducing the resolution of the result. In this paper, an automatic AD segmentation algorithm, in which a 3D mesh is gradually moved to the surface of AD based on the offset estimated by a deep mesh deformation module, is presented. AD morphology is used to constrain the initial mesh and guide the deformation, which improves the efficiency of the deep network and avoids down-sampling. Moreover, a stepwise regression strategy is introduced to solve the mesh folding problem and improve the uniformity of the mesh points. On an AD database that involves 35 images, the proposed method obtains the mean Dice of 94.12% and symmetric 95% Hausdorff distance of 2.85 mm, which outperforms five state-of-the-art AD segmentation methods. The average processing time is 16.6 s, and the memory used to train the network is only 0.36 GB, indicating that this method is easy to apply in clinical practice.
21 March 2019 in IEEE Transactions on Medical Imaging
Hippocampus segmentation plays a significant role in mental disease diagnoses, such as Alzheimer’s disease, epilepsy, and so on. Patch-based multi-atlas segmentation (PBMAS) approach is a popular method for hippocampus segmentation and has achieved a promising result. However, the PBMAS approach needs high computation cost due to registration and the segmentation accuracy is subject to the registration accuracy. In this paper, we propose a novel method based on iterative local linear mapping (ILLM) with representative and local structure-preserved feature embedding to achieve accurate and robust hippocampus segmentation with no need for registration. In the proposed approach, semi-supervised deep autoencoder (SSDA) exploits unsupervised deep autoencoder and local structure-preserved manifold regularization to nonlinearly transform the extracted magnetic resonance (MR) patch to embedded feature manifold, whose adjacent relationship is similar to the signed distance map (SDM) patch manifold. Local linear mapping is used to preliminarily predict SDM patch corresponding to the MR patch. Then a threshold segmentation generates a preliminary segmentation. ILLM refines the segmentation result iteratively by ensuring the local constraints of embedded feature manifold and SDM patch manifold using a space-constrained dictionary update. Thus a refined segmentation is obtained with no need for registration. Experiments on 135 subjects from ADNI dataset show that the proposed approach is superior to the state-of-the-art PBMAS and classification-based approaches with mean Dice similarity coefficients of 0.8852 ± 0.0203 and 0.8783 ± 0.0251 for bilateral hippocampus segmentation of 1.5T and 3.0T datasets respectively.
Objective: 3D reconstruction of lumbar intervertebral foramen (LIVF) has been beneficial in evaluating surgical trajectory. Still, the current methods of reconstructing the 3D LIVF model are mainly based on manual segmentation, which is laborious and time‐consuming. This study aims to explore the feasibility of automatically segmenting lumbar spinal structures and increasing the speed and accuracy of 3D lumbar intervertebral foramen (LIVF) reconstruction on magnetic resonance image (MRI) at the L4‐5 level.Methods: A total of 100 participants (mean age: 42.2 ± 14.0 years; 52 males and 48 females; mean body mass index, 22.7 ± 3.2 kg/m2), were enrolled in this prospective study between March and July 2020. All participants were scanned on L4‐5 level with a 3T MR unit using 3D T2‐weighted sampling perfection with application‐optimized contrast with various flip‐angle evolutions (SPACE) sequences. The lumbar spine's vertebra bone structures (VBS) and intervertebral discs (IVD) were manually segmented by skilled surgeons according to their anatomical outlines from MRI. Then all manual segmentation were saved and used for training. An automated segmentation method based on a 3D U‐shaped architecture network (3D‐UNet) was introduced for the automated segmentation of lumbar spinal structures. A number of quantitative metrics, including dice similarity coefficient (DSC), precision, and recall, were used to evaluate the performance of the automated segmentation method on MRI. Wilcoxon signed‐rank test was applied to compare morphometric parameters, including foraminal area, height and width of 3D LIVF models between automatic and manual segmentation. The intra‐class correlation coefficient was used to assess the test‐retest reliability and inter‐observer reliability of multiple measurements for these morphometric parameters of 3D LIVF models.Results: The automatic segmentation performance of all spinal structures (VBS and IVD) was found to be 0.918 (healthy levels: 0.922; unhealthy levels: 0.916) for the mean DSC, 0.922 (healthy levels: 0.927; unhealthy levels: 0.920) for the mean precision, and 0.917 (healthy levels: 0.918; unhealthy levels: 0.917) for the mean recall in the test dataset. It took approximately 2.5 s to achieve each automated segmentation, far less than the 240 min for manual segmentation. Furthermore, no significant differences were observed in the foraminal area, height and width of the 3D LIVF models between manual and automatic segmentation images (P > 0.05).Conclusion: A method of automated MRI segmentation based on deep learning algorithms was capable of rapidly generating accurate segmentation of spinal structures and can be used to construct 3D LIVF models from MRI at the L4‐5 level.