1 October 2021 in Computer Methods and Programs in Biomedicine
Synthetic magnetic resonance imaging (MRI) is a low cost procedure that serves as a bridge between qualitative and quantitative MRI. However, the proposed methods require very specific sequences or private protocols which have scarcely found integration in clinical scanners. We propose a learning-based approach to compute T1, T2, and PD parametric maps from only a pair of T1- and T2-weighted images customarily acquired in the clinical routine. Our approach is based on a convolutional neural network (CNN) trained with synthetic data; specifically, a synthetic dataset with 120 volumes was constructed from the anatomical brain model of the BrainWeb tool and served as the training set. The CNN learns an end-to-end mapping function to transform the input T1- and T2-weighted images to their underlying T1, T2, and PD parametric maps. Then, conventional weighted images unseen by the network are analytically synthesized from the parametric maps. The network can be fine tuned with a small database of actual weighted images and maps for better performance. This approach is able to accurately compute parametric maps from synthetic brain data achieving normalized squared error values predominantly below 1%. It also yields realistic parametric maps from actual MR brain acquisitions with T1, T2, and PD values in the range of the literature and with correlation values above 0.95 compared to the T1 and T2 maps obtained from relaxometry sequences. Further, the synthesized weighted images are visually realistic; the mean square error values are always below 9% and the structural similarity index is usually above 0.90. Network fine tuning with actual maps improves performance, while training exclusively with a small database of actual maps shows a performance degradation. These results show that our approach is able to provide realistic parametric maps and weighted images out of a CNN that (a) is trained with a synthetic dataset and (b) needs only two inputs, which are in turn obtained from a common full-brain acquisition that takes less than 8 min of scan time. Although a fine tuning with actual maps improves performance, synthetic data is crucial to reach acceptable performance levels. Hence, we show the utility of our approach for both quantitative MRI in clinical viable times and for the synthesis of additional weighted images to those actually acquired.
23 January 2023 in Frontiers in Neuroimaging
Gadolinium-based contrast agents (GBCAs) have become a crucial part of MRI acquisitions in neuro-oncology for the detection, characterization and monitoring of brain tumors. However, contrast-enhanced (CE) acquisitions not only raise safety concerns, but also lead to patient discomfort, the need of more skilled manpower and cost increase. Recently, several proposed deep learning works intend to reduce, or even eliminate, the need of GBCAs. This study reviews the published works related to the synthesis of CE images from low-dose and/or their native —non CE— counterparts. The data, type of neural network, and number of input modalities for each method are summarized as well as the evaluation methods. Based on this analysis, we discuss the main issues that these methods need to overcome in order to become suitable for their clinical usage. We also hypothesize some future trends that research on this topic may follow.
21 May 2022 in NMR in Biomedicine
Glioblastoma is an aggressive and fast‐growing brain tumor with poor prognosis. Predicting the expected survival of patients with glioblastoma is a key task for efficient treatment and surgery planning. Survival predictions could be enhanced by means of a radiomic system. However, these systems demand high numbers of multicontrast images, the acquisitions of which are time consuming, giving rise to patient discomfort and low healthcare system efficiency. Synthetic MRI could favor deployment of radiomic systems in the clinic by allowing practitioners not only to reduce acquisition time, but also to retrospectively complete databases or to replace artifacted images. In this work we analyze the replacement of an actually acquired MR weighted image by a synthesized version to predict survival of glioblastoma patients with a radiomic system. Each synthesized version was realistically generated from two acquired images with a deep learning synthetic MRI approach based on a convolutional neural network. Specifically, two weighted images were considered for the replacement one at a time, a T2w and a FLAIR, which were synthesized from the pairs T1w and FLAIR, and T1w and T2w, respectively. Furthermore, a radiomic system for survival prediction, which can classify patients into two groups (survival >480 days and 480 days), was built. Results show that the radiomic system fed with the synthesized image achieves similar performance compared with using the acquired one, and better performance than a model that does not include this image. Hence, our results confirm that synthetic MRI does add to glioblastoma survival prediction within a radiomics‐based approach.
10 September 2018 in IEEE Journal of Biomedical and Health Informatics
Medical image processing is often limited by the computational cost of the involved algorithms. Whereas dedicated computing devices (GPUs in particular) exist and do provide significant efficiency boosts, they have an extra cost of use in terms of housekeeping tasks (device selection and initialization, data streaming, synchronization with the CPU and others), which may hinder developers from using them. This paper describes an OpenCL-based framework that is capable of handling dedicated computing devices seamlessly and that allows the developer to concentrate on image processing tasks. The framework handles automatically device discovery and initialization, data transfers to and from the device and the file system and kernel loading and compiling. Data structures need to be defined only once independently of the computing device; code is unique, consequently, for every device, including the host CPU. Pinned memory/buffer mapping is used to achieve maximum performance in data transfers. Code fragments included in the paper show how the computing device is almost immediately and effortlessly available to the users algorithms, so they can focus on productive work. Code required for device selection and initialization, data loading and streaming and kernel compilation is minimal and systematic. Algorithms can be thought of as mathematical operators (called processes), with input, output and parameters, and they may be chained one after another easily and efficiently. Also for efficiency, processes can have their initialization work split from their core workload, so process chains and loops do not incur in performance penalties. Algorithm code is independent of the device type targeted.
1 January 2025 in Quantitative Imaging in Medicine and Surgery
JHJuan Antonio Hernández-Tamames
Juan Antonio Hernández-Tamames
Background: Gadolinium-based contrast agents (GBCAs) are usually employed for glioma diagnosis. However, GBCAs raise safety concerns, lead to patient discomfort and increase costs. Parametric maps offer a potential solution by enabling quantification of subtle tissue changes without GBCAs, but they are not commonly used in clinical practice due to the need for specifically targeted sequences. This work proposes to predict post-contrast T1-weighted enhancement without GBCAs from pre-contrast conventional weighted images through synthetic parametric maps computed with generative artificial intelligence (deep learning). Methods: In this retrospective study, three datasets have been employed: (I) a proprietary dataset with 15 glioma patients (hereafter, GLIOMA dataset); (II) relaxometry maps from 5 healthy volunteers; and (III) UPenn-GBM, a public dataset with 493 glioblastoma patients. A deep learning method for synthesizing parametric maps from only two conventional weighted images is proposed. Particularly, we synthesize longitudinal relaxation time (T1), transversal relaxation time (T2), and proton density (PD) maps. The deep learning method is trained in a supervised manner with the GLIOMA dataset, which comprises weighted images and parametric maps obtained with magnetic resonance image compilation (MAGiC). Thus, MAGiC maps were used as references for the training. For testing, a leave-one-out scheme is followed. Finally, the synthesized maps are employed to predict T1-weighted enhancement without GBCAs. Our results are compared with those obtained by MAGiC; specifically, both the maps obtained with MAGiC and the synthesized maps are used to distinguish between healthy and abnormal tissue (ABN) and, particularly, tissues with and without T1-weighted enhancement. The generalization capability of the method was also tested on two additional datasets (healthy volunteers and the UPenn-GBM). Results: Parametric maps synthesized with deep learning obtained similar performance compared to MAGiC for discriminating normal from ABN (sensitivities: 88.37% vs. 89.35%) and tissue with and without T1-weighted enhancement (sensitivities: 93.26% vs. 87.29%) on the GLIOMA dataset. These values were comparable to those obtained on UPenn-GBM (sensitivities of 91.23% and 81.04% for each classification). Conclusions: Our results suggest the feasibility to predict T1-weighted-enhanced tissues from pre-contrast conventional weighted images using deep learning for the synthesis of parametric maps.