Ultrasound based estimation of fetal biometry is extensively used to diagnose prenatal abnormalities and to monitor fetal growth, for which accurate segmentation of the fetal anatomy is a crucial prerequisite. Although deep neural network-based models have achieved encouraging results on this task, inevitable distribution shifts in ultrasound images can still result in severe performance drop in real world deployment scenarios. In this paper, we propose a complete ultrasound fetal examination system to deal with this troublesome problem by repairing and screening the anatomically implausible results. Our system consists of three main components: a routine segmentation network, a fetal anatomical key points guided repair network, and a shape-coding based selective screener. Guided by the anatomical key points, our repair network has stronger cross-domain repair capabilities, which can substantially improve the outputs of the segmentation network. By quantifying the distance between an arbitrary segmentation mask to its corresponding anatomical shape class, the proposed shape-coding based selective screener can then effectively reject the entire implausible results that cannot be fully repaired. Extensive experiments demonstrate that our proposed framework has strong anatomical guarantee and outperforms other methods in three different cross-domain scenarios. We release source codes and datasets on our GitHub: https://github.com/gaojun0821/RepairNet .
8 August 2024 in IEEE Transactions on Medical Imaging
The recent advent of in-context learning (ICL) capabilities in large pre-trained models has yielded significant advancements in the generalization of segmentation models. By supplying domain-specific image-mask pairs, the ICL model can be effectively guided to produce optimal segmentation outcomes, eliminating the necessity for model fine-tuning or interactive prompting. However, current existing ICL-based segmentation models exhibit significant limitations when applied to medical segmentation datasets with substantial diversity. To address this issue, we propose a dual similarity checkup approach to guarantee the effectiveness of selected in-context samples so that their guidance can be maximally leveraged during inference. We first employ large pre-trained vision models for extracting strong semantic representations from input images and constructing a feature embedding memory bank for semantic similarity checkup during inference. Assuring the similarity in the input semantic space, we then minimize the discrepancy in the mask appearance distribution between the support set and the estimated mask appearance prior through similarity-weighted sampling and augmentation. We validate our proposed dual similarity checkup approach on eight publicly available medical segmentation datasets, and extensive experimental results demonstrate that our proposed method significantly improves the performance metrics of existing ICL-based segmentation models, particularly when applied to medical image datasets characterized by substantial diversity.
Accurate estimation of ultrasound Doppler spectrogram envelope is essential for clinical pathological diagnosis of various cardiovascular diseases. However, due to intrinsic spectral broadening in the power spectrum and speckle noise existing in ultrasound images, it is difficult to obtain the accurate maximum velocity. Each of the standard existing methods has their own limitations and does not work well in complicated recordings. This paper proposes a robust automatic spectral envelope estimation method that is more accurate in phantom recordings and various in-vivo recordings than the currently used methods. Comparisons were performed on phantom recordings of the carotid artery with varying noise and additional in-vivo recordings. The accuracy of the proposed method was on average 8% greater than the existing methods. The experimental results demonstrate the wide applicability under different blood conditions and the robustness of the proposed algorithm.
28 August 2020 in Computational and Mathematical Methods in Medicine
A novel adaptive beamformer named filtered-delay multiply and sum (F-DMAS) has recently been proposed. Compared to the delay and sum (DAS) beamforming algorithm, F-DMAS can efficiently improve the resolution and contrast. However, the DAS can still be seen in the expansion of DMAS. Therefore, we rearrange the pair-wised signals in terms of lag in DMAS and then synthesize a lot of new signals. Thanks to the relationship between the spatial coherence and lag, these new signals can be thought of as sorted by the spatial coherence. Thus, we apply two phase-related factors, the polarity-based factor (PF) and the sign coherence factor (SCF), which are evaluated based on new signals, to weight the output of DMAS. The two approaches are consequently referred to as LAG-DMAS-PF and LAG-DMAS-SCF, respectively. The results show that, compared to F-DMAS and DAS, our proposed methods can improve the resolution and contrast to some extent without increasing too much computational complexity. In the comparison between LAG-DMAS-PF and LAG-DMAS-SCF, the latter has better performance, but the former can better protect image details.
Speckle noise is a granular interference that degrades image quality in coherent imaging systems, including underwater sonar, Synthetic Aperture Radar (SAR), and medical ultrasound. This study aims to enhance speckle noise reduction through advanced deep learning techniques. We introduce the Deep Gradient-Guidance Network (DGGNet), which features an architecture comprising one encoder and two decoders—one dedicated to image recovery and the other to gradient preservation. Our approach integrates a gradient map and fractional-order total variation into the loss function to guide training. The gradient map provides structural guidance for edge preservation and directs the denoising branch to focus on sharp regions, thereby preventing over-smoothing. The fractional-order total variation mitigates detail ambiguity and excessive smoothing, ensuring rich textures and detailed information are retained. Extensive experiments yield an average Peak Signal-to-Noise Ratio (PSNR) of 31.52 dB and a Structural Similarity Index (SSIM) of 0.863 across various benchmark datasets, including McMaster, Kodak24, BSD68, Set12, and Urban100. DGGNet outperforms existing methods, such as RIDNet, which achieved a PSNR of 31.42 dB and an SSIM of 0.853, thereby establishing new benchmarks in speckle noise reduction.