Diffusion models have achieved impressive performance on various image generation tasks, including image super-resolution. Despite their impressive performance, diffusion models suffer from high computational costs due to the large number of denoising steps. In this paper, we proposed a novel accelerated diffusion model, termed Partial Diffusion Models (PDMs), for magnetic resonance imaging (MRI) super-resolution. We observed that the latents of diffusing a pair of low- and high-resolution images gradually converge and become indistinguishable after a certain noise level. This inspires us to use certain low-resolution latent to approximate corresponding high-resolution latent. With the approximation, we can skip part of the diffusion and denoising steps, reducing the computation in training and inference. To mitigate the approximation error, we further introduced ‘latent alignment’ that gradually interpolates and approaches the high-resolution latents from the low-resolution latents. Partial diffusion models, in conjunction with latent alignment, essentially establish a new trajectory where the latents, unlike those in original diffusion models, gradually transition from low-resolution to high-resolution images. Experiments on three MRI datasets demonstrate that partial diffusion models achieve competetive super-resolution quality with significantly fewer denoising steps than original diffusion models. In addition, they can be incorporated with recent accelerated diffusion models to further enhance the efficiency.
26 November 2024 in Computers in Biology and Medicine
Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) measures microvascular perfusion by capturing the temporal changes of an MRI contrast agent in a target tissue, and it provides valuable information for the diagnosis and prognosis of a wide range of tumors. Quantitative DCE-MRI analysis commonly relies on the nonlinear least square (NLLS) fitting of a pharmacokinetic (PK) model to concentration curves. However, the voxel-wise application of such nonlinear curve fitting is highly time-consuming. The arterial input function (AIF) needs to be utilized in quantitative DCE-MRI analysis. and in practice, a population-based arterial AIF is often used in PK modeling. The contribution of intravascular dispersion to the measured signal enhancement is assumed to be negligible. The MR dispersion imaging (MRDI) model was recently proposed to account for intravascular dispersion, enabling more accurate PK modeling. However, the complexity of the MRDI hinders its practical usability and makes quantitative PK modeling even more time-consuming. In this paper, we propose fast MR dispersion imaging (fMRDI) to effectively represent the intravascular dispersion and highly accelerated PK parameter estimation. We also propose a deep learning-based, two-stage framework to accelerate PK parameter estimation. We used a deep neural network (NN) to estimate PK parameters directly from enhancement curves. The estimation from NN was further refined using several steps of NLLS, which is significantly faster than performing NLLS from random initializations. A data synthesis module is proposed to generate synthetic training data for the NN. Two data-processing modules were introduced to improve the model’s stability against noise and variations. Experiments on our in-house clinical prostate MRI dataset demonstrated that our method significantly reduces the processing time, produces a better distinction between normal and clinically significant prostate cancer (csPCa) lesions, and is more robust against noise than conventional DCE-MRI analysis methods.
The prediction of microsatellite instability (MSI) and microsatellite stability (MSS) is essential in predicting both the treatment response and prognosis of gastrointestinal cancer. In clinical practice, a universal MSI testing is recommended, but the accessibility of such a test is limited. Thus, a more cost-efficient and broadly accessible tool is desired to cover the traditionally untested patients. In the past few years, deep-learning-based algorithms have been proposed to predict MSI directly from haematoxylin and eosin (H&E)-stained whole-slide images (WSIs). Such algorithms can be summarized as (1) patch-level MSI/MSS prediction, and (2) patient-level aggregation. Compared with the advanced deep learning approaches that have been employed for the first stage, only the naïve first-order statistics (e.g., averaging and counting) were employed in the second stage. In this paper, we propose a simple yet broadly generalizable patient-level MSI aggregation (MAg) method to effectively integrate the precious patch-level information. Briefly, the entire probabilistic distribution in the first stage is modeled as histogram-based features to be fused as the final outcome with machine learning (e.g., SVM). The proposed MAg method can be easily used in a plug-and-play manner, which has been evaluated upon five broadly used deep neural networks: ResNet, MobileNetV2, EfficientNet, Dpn and ResNext. From the results, the proposed MAg method consistently improves the accuracy of patient-level aggregation for two publicly available datasets. It is our hope that the proposed method could potentially leverage the low-cost H&E based MSI detection method. The code of our work has been made publicly available at https://github.com/Calvin-Pang/MAg.
Background and Objective: Micro-ultrasound (MicroUS) is an emerging high-resolution imaging modality for prostate cancer diagnosis and real-time biopsy guidance, but its automated analysis is limited by labor-intensive expert annotation. We aimed to develop and evaluate a foundation model for data-efficient MicroUS image analysis. Methods: We developed µ FM, a MicroUS-specific foundation model pretrained using DINOv2-style self-supervised learning on 1,736,391 unlabeled images from 780 patients. The model was fine-tuned and evaluated in three downstream cohorts for prostate capsule segmentation (public, 75 patients), urethra segmentation (institutional, 105 patients), and prostate cancer lesion localization (institutional, 190 patients). Under limited annotation, µ FM was compared with randomly initialized models and foundation models pretrained on natural, medical, and ultrasound images. Evaluation used the Dice scores and 95th-percentile Hausdorff distance (HD95) for segmentation and free-response receiver operating characteristic analysis for lesion localization. Key Findings and Limitations: µ FM improved performance across all three tasks, with the largest gains under limited annotation. With 10% of training scans, µ FM achieved Dice scores of 93.8% for prostate capsule segmentation and 58.4% for urethra segmentation, versus 87.9% and 47.0% for the strongest comparators. Corresponding HD95 values were 2.0 and 4.3 mm. For lesion localization, µ FM outperformed other models with approximately 0.75 sensitivity at two false-positive detections per 3D volume. Limitations include retrospective single-institution pretraining and lack of explicit 3D modeling. Conclusions and Clinical Implications: MicroUS-specific self-supervised pretraining improved data-efficient image analysis across prostate and urethra segmentation, and lesion localization. This approach may reduce annotation requirements for developing automated tools in MicroUS image analysis. Advancing Practice: What does the study add?: This study evaluates a deep learning model pretrained on a large-scale dataset of unlabeled prostate MicroUS images. The pretrained model was adapted to three clinically relevant image-analysis tasks: prostate capsule segmentation, urethra segmentation, and prostate cancer lesion localization. Substantial performance gains over other models were observed despite limited training data, suggesting that MicroUS-specific self-supervised pretraining may reduce expert annotation requirements for developing automated image-analysis tools. Patient Summary: We developed a foundation model that learns from unlabeled prostate MicroUS images. It performed better with limited labeled data but requires independent validation before clinical use.