John Pauly

Prof. John Pauly


Research Focus & Metrics

Academic Career Length

30Years (1997-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 July 2018 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
MMMorteza Mardani
Morteza Mardani
EGEnhao Gong
Enhao Gong
JCJoseph Y. Cheng
Joseph Y. Cheng
SVShreyas S. Vasanawala
Shreyas S. Vasanawala
GZGreg Zaharchuk
Greg Zaharchuk
JPJohn Pauly
John Pauly
Undersampled magnetic resonance image (MRI) reconstruction is typically an ill-posed linear inverse task. The time and resource intensive computations require tradeoffs between accuracy and speed. In addition, state-of-the-art compressed sensing (CS) analytics are not cognizant of the image diagnostic quality. To address these challenges, we propose a novel CS framework that uses generative adversarial networks (GAN) to model the (low-dimensional) manifold of high-quality MR images. Leveraging a mixture of least-squares (LS) GANs and pixel-wise ℓ 1 /ℓ 2 cost, a deep residual network with skip connections is trained as the generator that learns to remove the aliasing artifacts by projecting onto the image manifold. The LSGAN learns the texture details, while the ℓ 1 /ℓ 2 cost suppresses high-frequency noise. A discriminator network, which is a multilayer convolutional neural network (CNN), plays the role of a perceptual cost that is then jointly trained based on high-quality MR images to score the quality of retrieved images. In the operational phase, an initial aliased estimate (e.g., simply obtained by zero-filling) is propagated into the trained generator to output the desired reconstruction. This demands a very low computational overhead. Extensive evaluations are performed on a large contrast-enhanced MR dataset of pediatric patients. Images rated by expert radiologists corroborate that GANCS retrieves higher quality images with improved fine texture details compared with conventional Wavelet-based and dictionary-learning-based CS schemes as well as with deep-learning-based schemes using pixel-wise training. In addition, it offers reconstruction times of under a few milliseconds, which are two orders of magnitude faster than the current state-of-the-art CS-MRI schemes.

1 September 2011 in American Journal of Roentgenology
Verified
Journal Article
Closed access
BHBrian A. Hargreaves
Brian A. Hargreaves
PWPauline W. Worters
Pauline W. Worters
KPKim Butts Pauly
Kim Butts Pauly
JPJohn Pauly
John Pauly
KKKevin Koch
Kevin Koch
GGGarry E. Gold
Garry E. Gold
OBJECTIVE. The purpose of this article is to review some of the basic principles of imaging and how metal-induced susceptibility artifacts originate in MR images. We will describe common ways to re...

3 June 2022 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
LSLiyue Shen
Liyue Shen
JPJohn Pauly
John Pauly
Lei XingLei Xing
Lei Xing
Image reconstruction is an inverse problem that solves for a computational image based on sampled sensor measurement. Sparsely sampled image reconstruction poses additional challenges due to limited measurements. In this work, we propose a methodology of implicit Neural Representation learning with Prior embedding (NeRP) to reconstruct a computational image from sparsely sampled measurements. The method differs fundamentally from previous deep learning-based image reconstruction approaches in that NeRP exploits the internal information in an image prior and the physics of the sparsely sampled measurements to produce a representation of the unknown subject. No large-scale data is required to train the NeRP except for a prior image and sparsely sampled measurements. In addition, we demonstrate that NeRP is a general methodology that generalizes to different imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI). We also show that NeRP can robustly capture the subtle yet significant image changes required for assessing tumor progression.

17 January 2020 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
CSChristopher M. Sandino
Christopher M. Sandino
JCJoseph Y. Cheng
Joseph Y. Cheng
FCFeiyu Chen
Feiyu Chen
MMMorteza Mardani
Morteza Mardani
JPJohn Pauly
John Pauly
SVShreyas S. Vasanawala
Shreyas S. Vasanawala
Compressed sensing (CS) reconstruction methods leverage sparse structure in underlying signals to recover high-resolution images from highly undersampled measurements. When applied to magnetic resonance imaging (MRI), CS has the potential to dramatically shorten MRI scan times, increase diagnostic value, and improve the overall patient experience. However, CS has several shortcomings that limit its clinical translation. These include 1) artifacts arising from inaccurate sparse modeling assumptions, 2) extensive parameter tuning required for each clinical application, and 3) clinically infeasible reconstruction times. Recently, CS has been extended to incorporate deep neural networks as a way of learning complex image priors from historical exam data. Commonly referred to as unrolled neural networks, these techniques have proven to be a compelling and practical approach to address the challenges of sparse CS. In this tutorial, we review the classical CS formulation and outline steps needed to transform this formulation into a deep-learning-based reconstruction framework. Supplementary open-source code in Python is used to demonstrate this approach with open databases. Further, we discuss considerations in applying unrolled neural networks in the clinical setting.

29 December 2020 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
VEVineet Edupuganti
Vineet Edupuganti
MMMorteza Mardani
Morteza Mardani
SVShreyas Vasanawala
Shreyas Vasanawala
JPJohn Pauly
John Pauly
Reliable MRI is crucial for accurate interpretation in therapeutic and diagnostic tasks. However, undersampling during MRI acquisition as well as the overparameterized and non-transparent nature of deep learning (DL) leaves substantial uncertainty about the accuracy of DL reconstruction. With this in mind, this study aims to quantify the uncertainty in image recovery with DL models. To this end, we first leverage variational autoencoders (VAEs) to develop a probabilistic reconstruction scheme that maps out (low-quality) short scans with aliasing artifacts to the diagnostic-quality ones. The VAE encodes the acquisition uncertainty in a latent code and naturally offers a posterior of the image from which one can generate pixel variance maps using Monte-Carlo sampling. Accurately predicting risk requires knowledge of the bias as well, for which we leverage Stein's Unbiased Risk Estimator (SURE) as a proxy for mean-squared-error (MSE). A range of empirical experiments is performed for Knee MRI reconstruction under different training losses (adversarial and pixel-wise) and unrolled recurrent network architectures. Our key observations indicate that: 1) adversarial losses introduce more uncertainty; and 2) recurrent unrolled nets reduce the prediction uncertainty and risk.

28 May 2008 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
MLMichael Lustig
Michael Lustig
SKSeung-Jean Kim
Seung-Jean Kim
JPJohn Pauly
John Pauly
A fast and simple algorithm for designing time-optimal waveforms is presented. The algorithm accepts a given arbitrary multidimensional k -space trajectory as the input and outputs the time-optimal gradient waveform that traverses k-space along that path in minimum time. The algorithm is noniterative, and its run time is independent of the complexity of the curve, i.e., the number of switches between slew-rate limited acceleration, slew-rate limited deceleration, and gradient amplitude limited regions. The key in the method is that the gradient amplitude is designed as a function of arc length along the k-space trajectory, rather than as a function of time. Several trajectory design examples are presented.