Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https:// learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods.

Multiparametric magnetic resonance imaging (mpMRI) interpreted by experts is a powerful tool for diagnosing prostate cancer. However, the generalizability of published results across radiologists of varying expertise has not been verified. To assess variability in mpMRI reporting and diagnostic accuracy across radiologists of varying experience in routine clinical care. Men who underwent mpMRI and MR-fusion biopsy between 2014-2016. Each MRI scan was read by one of nine radiologists using the Prostate Imaging Reporting and Data System (PIRADS) and was not re-read before biopsy. Biopsy histopathology was the reference standard. Outcomes were the PIRADS score distribution and diagnostic accuracy across nine radiologists. We evaluated the association between age, prostate-specific antigen, PIRADS score, and radiologist in predicting clinically significant cancer (Gleason ≥7) using multivariable logistic regression. We conducted sensitivity analyses for case volume and changes in accuracy over time. We analyzed data for 409 subjects with 503 MRI lesions. While the number of lesions (mean 1.2 lesions/patient) did not differ across radiologists, substantial variation existed in PIRADS distribution and cancer yield. The significant cancer detection rate was 3-27% for PIRADS 3 lesions, 23-65% for PIRADS 4, and 40-80% for PIRADS 5 across radiologists. Some 13-60% of men with a PIRADS score of <3 on MRI harbored clinically significant cancer. The area under the receiver operating characteristic curve varied from 0.69 to 0.81 for detection of clinically significant cancer. PIRADS score (p<0.0001) and radiologist (p=0.042) were independently associated with cancer in multivariable analysis. Neither individual radiologist volume nor study period impacted the results. MRI scans were not retrospectively re-read by all radiologists, precluding measurement of inter-observer agreement. We observed considerable variability in PIRADS score assignment and significant cancer yield across radiologists. We advise internal evaluation of mpMRI accuracy before widespread adoption. We evaluated the interpretation of multiparametric magnetic resonance imaging of the prostate in routine clinical care. Diagnostic accuracy depends on the Prostate Imaging Reporting and Data System score and the radiologist.

Transrectal ultrasound and photoacoustic imaging simultaneously provide structural and molecular contrasts of normal and cancerous human prostates.

Magnetic resonance imaging (MRI) is an increasingly important tool for the diagnosis and treatment of prostate cancer. However, interpretation of MRI suffers from high inter-observer variability across radiologists, thereby contributing to missed clinically significant cancers, overdiagnosed low-risk cancers, and frequent false positives. Interpretation of MRI could be greatly improved by providing radiologists with an answer key that clearly shows cancer locations on MRI. Registration of histopathology images from patients who had radical prostatectomy to pre-operative MRI allows such mapping of ground truth cancer labels onto MRI. However, traditional MRI-histopathology registration approaches are computationally expensive and require careful choices of the cost function and registration hyperparameters. This paper presents ProsRegNet, a deep learning-based pipeline to accelerate and simplify MRI-histopathology image registration in prostate cancer. Our pipeline consists of image preprocessing, estimation of affine and deformable transformations by deep neural networks, and mapping cancer labels from histopathology images onto MRI using estimated transformations. We trained our neural network using MR and histopathology images of 99 patients from our internal cohort (Cohort 1) and evaluated its performance using 53 patients from three different cohorts (an additional 12 from Cohort 1 and 41 from two public cohorts). Results show that our deep learning pipeline has achieved more accurate registration results and is at least 20 times faster than a state-of-the-art registration algorithm. This important advance will provide radiologists with highly accurate prostate MRI answer keys, thereby facilitating improvements in the detection of prostate cancer on MRI. Our code is freely available at https://github.com/pimed//ProsRegNet.

A multitude of studies have explored the role of artificial intelligence (AI) in providing diagnostic support to radiologists, pathologists, and urologists in prostate cancer detection, risk-stratification, and management. This review provides a comprehensive overview of relevant literature regarding the use of AI models in (1) detecting prostate cancer on radiology images (magnetic resonance and ultrasound imaging), (2) detecting prostate cancer on histopathology images of prostate biopsy tissue, and (3) assisting in supporting tasks for prostate cancer detection (prostate gland segmentation, MRI-histopathology registration, MRI-ultrasound registration). We discuss both the potential of these AI models to assist in the clinical workflow of prostate cancer diagnosis, as well as the current limitations including variability in training data sets, algorithms, and evaluation criteria. We also discuss ongoing challenges and what is needed to bridge the gap between academic research on AI for prostate cancer and commercial solutions that improve routine clinical care.

In this paper, we consider image quality assessment (IQA) as a measure of how images are amenable with respect to a given downstream task, or task amenability. When the task is performed using machine learning algorithms, such as a neural-network-based task predictor for image classification or segmentation, the performance of the task predictor provides an objective estimate of task amenability. In this work, we use an IQA controller to predict the task amenability which, itself being parameterised by neural networks, can be trained simultaneously with the task predictor. We further develop a meta-reinforcement learning framework to improve the adaptability for both IQA controllers and task predictors, such that they can be fine-tuned efficiently on new datasets or meta-tasks. We demonstrate the efficacy of the proposed task-specific, adaptable IQA approach, using two clinical applications for ultrasound-guided prostate intervention and pneumonia detection on X-ray images.