Jo Schlemper

Jo Schlemper

Auto-generated profile, based on publicly available information

Jo Schlemper

Biomedical Image Analysis Group Imperial College London UK

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2019 in Medical Image Analysis
Verified
Journal Article
Open access
JSJo Schlemper
Jo Schlemper
OOOzan Oktay
Ozan Oktay
MSMichiel Schaap
Michiel Schaap
MHMattias Heinrich
Mattias Heinrich
BKBernhard Kainz
Bernhard Kainz
DRDaniel Rueckert
Daniel Rueckert
We propose a novel attention gate (AG) model for medical image analysis that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules when using convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN models such as VGG or U-Net architectures with minimal computational overhead while increasing the model sensitivity and prediction accuracy. The proposed AG models are evaluated on a variety of tasks, including medical image classification and segmentation. For classification, we demonstrate the use case of AGs in scan plane detection for fetal ultrasound screening. We show that the proposed attention mechanism can provide efficient object localisation while improving the overall prediction performance by reducing false positives. For segmentation, the proposed architecture is evaluated on two large 3D CT abdominal datasets with manual annotations for multiple organs. Experimental results show that AG models consistently improve the prediction performance of the base architectures across different datasets and training sizes while preserving computational efficiency. Moreover, AGs guide the model activations to be focused around salient regions, which provides better insights into how model predictions are made. The source code for the proposed AG models is publicly available.

1 February 2018 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Open access
JSJo Schlemper
Jo Schlemper
JCJose Caballero
Jose Caballero
JHJoseph V. Hajnal
Joseph V. Hajnal
APAnthony N. Price
Anthony N. Price
DRDaniel Rueckert
Daniel Rueckert
Inspired by recent advances in deep learning, we propose a framework for reconstructing dynamic sequences of 2D cardiac magnetic resonance (MR) images from undersampled data using a deep cascade of convolutional neural networks (CNNs) to accelerate the data acquisition process. In particular, we address the case where data is acquired using aggressive Cartesian undersampling. Firstly, we show that when each 2D image frame is reconstructed independently, the proposed method outperforms state-of-the-art 2D compressed sensing approaches such as dictionary learning-based MR image reconstruction, in terms of reconstruction error and reconstruction speed. Secondly, when reconstructing the frames of the sequences jointly, we demonstrate that CNNs can learn spatio-temporal correlations efficiently by combining convolution and data sharing approaches. We show that the proposed method consistently outperforms state-of-the-art methods and is capable of preserving anatomical structure more faithfully up to 11-fold undersampling. Moreover, reconstruction is very fast: each complete dynamic sequence can be reconstructed in less than 10s and, for the 2D case, each image frame can be reconstructed in 23ms, enabling real-time applications.

1 January 2019 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
CQChen Qin
Chen Qin
JSJo Schlemper
Jo Schlemper
JCJose Caballero
Jose Caballero
APAnthony N. Price
Anthony N. Price
JHJoseph V. Hajnal
Joseph V. Hajnal
DRDaniel Rueckert
Daniel Rueckert
Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning communities over the last decades. The key ingredient to the problem is how to exploit the temporal correlations of the MR sequence to resolve aliasing artefacts. Traditionally, such observation led to a formulation of an optimisation problem, which was solved using iterative algorithms. Recently, however, deep learning based-approaches have gained significant popularity due to their ability to solve general inverse problems. In this work, we propose a unique, novel convolutional recurrent neural network (CRNN) architecture which reconstructs high quality cardiac MR images from highly undersampled k-space data by jointly exploiting the dependencies of the temporal sequences as well as the iterative nature of the traditional optimisation algorithms. In particular, the proposed architecture embeds the structure of the traditional iterative algorithms, efficiently modelling the recurrence of the iterative reconstruction stages by using recurrent hidden connections over such iterations. In addition, spatio-temporal dependencies are simultaneously learnt by exploiting bidirectional recurrent hidden connections across time sequences. The proposed method is able to learn both the temporal dependency and the iterative reconstruction process effectively with only a very small number of parameters, while outperforming current MR reconstruction methods in terms of reconstruction accuracy and speed.

23 May 2017
Verified
Book Chapter
Closed access
PDF file
JSJo Schlemper
Jo Schlemper
JCJose Caballero
Jose Caballero
JHJoseph V. Hajnal
Joseph V. Hajnal
APAnthony Price
Anthony Price
DRDaniel Rueckert
Daniel Rueckert

23 January 2019 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Open access
JDJinming Duan
Jinming Duan
GBGhalib Bello
Ghalib Bello
JSJo Schlemper
Jo Schlemper
WBWenjia Bai
Wenjia Bai
TDTimothy J. W. Dawes
Timothy J. W. Dawes
DRDaniel Rueckert
Daniel Rueckert
Deep learning approaches have achieved state-of-the-art performance in cardiac magnetic resonance (CMR) image segmentation. However, most approaches have focused on learning image intensity features for segmentation, whereas the incorporation of anatomical shape priors has received less attention. In this paper, we combine a multi-task deep learning approach with atlas propagation to develop a shape-refined bi-ventricular segmentation pipeline for short-axis CMR volumetric images. The pipeline first employs a fully convolutional network (FCN) that learns segmentation and landmark localization tasks simultaneously. The architecture of the proposed FCN uses a 2.5D representation, thus combining the computational advantage of 2D FCNs networks and the capability of addressing 3D spatial consistency without compromising segmentation accuracy. Moreover, a refinement step is designed to explicitly impose shape prior knowledge and improve segmentation quality. This step is effective for overcoming image artifacts (e.g., due to different breath-hold positions and large slice thickness), which preclude the creation of anatomically meaningful 3D cardiac shapes. The pipeline is fully automated, due to network's ability to infer landmarks, which are then used downstream in the pipeline to initialize atlas propagation. We validate the pipeline on 1831 healthy subjects and 649 subjects with pulmonary hypertension. Extensive numerical experiments on the two datasets demonstrate that our proposed method is robust and capable of producing accurate, high-resolution, and anatomically smooth bi-ventricular 3D models, despite the presence of artifacts in input CMR volumes.

10 June 2021 in Magnetic Resonance in Medicine
Verified
Journal Article
Open access
PDF file
KHKerstin Hammernik
Kerstin Hammernik
JSJo Schlemper
Jo Schlemper
CQChen Qin
Chen Qin
JDJinming Duan
Jinming Duan
RSRonald M. Summers
Ronald M. Summers
DRDaniel Rueckert
Daniel Rueckert
Purpose: To systematically investigate the influence of various data consistency layers and regularization networks with respect to variations in the training and test data domain, for sensitivity‐encoded accelerated parallel MR image reconstruction.Theory and Methods: Magnetic resonance (MR) image reconstruction is formulated as a learned unrolled optimization scheme with a down‐up network as regularization and varying data consistency layers. The proposed networks are compared to other state‐of‐the‐art approaches on the publicly available fastMRI knee and neuro dataset and tested for stability across different training configurations regarding anatomy and number of training samples.Results: Data consistency layers and expressive regularization networks, such as the proposed down‐up networks, form the cornerstone for robust MR image reconstruction. Physics‐based reconstruction networks outperform post‐processing methods substantially for R = 4 in all cases and for R = 8 when the training and test data are aligned. At R = 8, aligning training and test data is more important than architectural choices.Conclusion: In this work, we study how dataset sizes affect single‐anatomy and cross‐anatomy training of neural networks for MRI reconstruction. The study provides insights into the robustness, properties, and acceleration limits of state‐of‐the‐art networks, and our proposed down‐up networks. These key insights provide essential aspects to successfully translate learning‐based MRI reconstruction to clinical practice, where we are confronted with limited datasets and various imaged anatomies.