Michael Roberts

Michael Roberts

Auto-generated profile, based on publicly available information

Michael Roberts

University of Cambridge

Research Focus & Metrics

Academic Career Length

26Years (2001-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 March 2021 in Nature Machine Intelligence
Verified
Journal Article
Open access
PDF file
MRMichael Roberts
Michael Roberts
DDDerek Driggs
Derek Driggs
MTMatthew Thorpe
Matthew Thorpe
JGJulian Gilbey
Julian Gilbey
MYMichael Yeung
Michael Yeung
CSCarola-Bibiane Schönlieb
Carola-Bibiane Schönlieb
Machine learning methods offer great promise for fast and accurate detection and prognostication of coronavirus disease 2019 (COVID-19) from standard-of-care chest radiographs (CXR) and chest computed tomography (CT) images. Many articles have been published in 2020 describing new machine learning-based models for both of these tasks, but it is unclear which are of potential clinical utility. In this systematic review, we consider all published papers and preprints, for the period from 1 January 2020 to 3 October 2020, which describe new machine learning models for the diagnosis or prognosis of COVID-19 from CXR or CT images. All manuscripts uploaded to bioRxiv, medRxiv and arXiv along with all entries in EMBASE and MEDLINE in this timeframe are considered. Our search identified 2,212 studies, of which 415 were included after initial screening and, after quality screening, 62 studies were included in this systematic review. Our review finds that none of the models identified are of potential clinical use due to methodological flaws and/or underlying biases. This is a major weakness, given the urgency with which validated COVID-19 models are needed. To address this, we give many recommendations which, if followed, will solve these issues and lead to higher-quality model development and well-documented manuscripts.

3 May 2024 in Science Advances
Verified
Journal Article
Open access
SKSayash Kapoor
Sayash Kapoor
ECEmily M. Cantrell
Emily M. Cantrell
KPKenny Peng
Kenny Peng
TPThanh Hien Pham
Thanh Hien Pham
CBChristopher A. Bail
Christopher A. Bail
ANArvind Narayanan
Arvind Narayanan
Machine learning (ML) methods are proliferating in scientific research. However, the adoption of these methods has been accompanied by failures of validity, reproducibility, and generalizability. These failures can hinder scientific progress, lead to false consensus around invalid claims, and undermine the credibility of ML-based science. ML methods are often applied and fail in similar ways across disciplines. Motivated by this observation, our goal is to provide clear recommendations for conducting and reporting ML-based science. Drawing from an extensive review of past literature, we present the REFORMS checklist (recommendations for machine-learning-based science). It consists of 32 questions and a paired set of guidelines. REFORMS was developed on the basis of a consensus of 19 researchers across computer science, data science, mathematics, social sciences, and biomedical sciences. REFORMS can serve as a resource for researchers when designing and implementing a study, for referees when reviewing papers, and for journals when enforcing standards for transparency and reproducibility.

15 April 2021 in Nature Biomedical Engineering
Verified
Journal Article
Closed access
PDF file
GWGuangyu Wang
Guangyu Wang
XLXiaohong Liu
Xiaohong Liu
JSJun Shen
Jun Shen
CWChengdi Wang
Chengdi Wang
ZLZhihuan Li
Zhihuan Li
Tianxin LinTianxin Lin
Tianxin Lin

6 October 2023 in Communications Medicine
Verified
Journal Article
Open access
PDF file
TSTolou Shadbahr
Tolou Shadbahr
MRMichael Roberts
Michael Roberts
JSJan Stanczuk
Jan Stanczuk
JGJulian Gilbey
Julian Gilbey
PTPhilip Teare
Philip Teare
CSCarola-Bibiane Schönlieb
Carola-Bibiane Schönlieb
Background: Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods, followed by classification of the now complete samples. The focus of the machine learning researcher is to optimise the classifier’s performance. Methods: We utilise three simulated and three real-world clinical datasets with different feature types and missingness patterns. Initially, we evaluate how the downstream classifier performance depends on the choice of classifier and imputation methods. We employ ANOVA to quantitatively evaluate how the choice of missingness rate, imputation method, and classifier method influences the performance. Additionally, we compare commonly used methods for assessing imputation quality and introduce a class of discrepancy scores based on the sliced Wasserstein distance. We also assess the stability of the imputations and the interpretability of model built on the imputed data. Results: The performance of the classifier is most affected by the percentage of missingness in the test data, with a considerable performance decline observed as the test missingness rate increases. We also show that the commonly used measures for assessing imputation quality tend to lead to imputed data which poorly matches the underlying data distribution, whereas our new class of discrepancy scores performs much better on this measure. Furthermore, we show that the interpretability of classifier models trained using poorly imputed data is compromised. Conclusions: It is imperative to consider the quality of the imputation when performing downstream classification as the effects on the classifier can be considerable.

14 June 2024 in Patterns
Verified
Journal Article
Open access
FZFan Zhang
Fan Zhang
DKDaniel Kreuter
Daniel Kreuter
YCYichen Chen
Yichen Chen
SDSören Dittmer
Sören Dittmer
STSamuel Tull
Samuel Tull
CSCarola-Bibiane Schönlieb
Carola-Bibiane Schönlieb
For healthcare datasets, it is often impossible to combine data samples from multiple sites due to ethical, privacy, or logistical concerns. Federated learning allows for the utilization of powerful machine learning algorithms without requiring the pooling of data. Healthcare data have many simultaneous challenges, such as highly siloed data, class imbalance, missing data, distribution shifts, and non-standardized variables, that require new methodologies to address. Federated learning adds significant methodological complexity to conventional centralized machine learning, requiring distributed optimization, communication between nodes, aggregation of models, and redistribution of models. In this systematic review, we consider all papers on Scopus published between January 2015 and February 2023 that describe new federated learning methodologies for addressing challenges with healthcare data. We reviewed 89 papers meeting these criteria. Significant systemic issues were identified throughout the literature, compromising many methodologies reviewed. We give detailed recommendations to help improve methodology development for federated learning in healthcare.

15 December 2021 in Nature Machine Intelligence
Verified
Journal Article
Open access
PDF file
XBXiang Bai
Xiang Bai
HWHanchen Wang
Hanchen Wang
LMLiya Ma
Liya Ma
YXYongchao Xu
Yongchao Xu
JGJiefeng Gan
Jiefeng Gan
TXTian Xia
Tian Xia
Artificial intelligence provides a promising solution for streamlining COVID-19 diagnoses; however, concerns surrounding security and trustworthiness impede the collection of large-scale representative medical data, posing a considerable challenge for training a well-generalized model in clinical practices. To address this, we launch the Unified CT-COVID AI Diagnostic Initiative (UCADI), where the artificial intelligence (AI) model can be distributedly trained and independently executed at each host institution under a federated learning framework without data sharing. Here we show that our federated learning framework model considerably outperformed all of the local models (with a test sensitivity/specificity of 0.973/0.951 in China and 0.730/0.942 in the United Kingdom), achieving comparable performance with a panel of professional radiologists. We further evaluated the model on the hold-out (collected from another two hospitals without the federated learning framework) and heterogeneous (acquired with contrast materials) data, provided visual explanations for decisions made by the model, and analysed the trade-offs between the model performance and the communication costs in the federated training process. Our study is based on 9,573 chest computed tomography scans from 3,336 patients collected from 23 hospitals located in China and the United Kingdom. Collectively, our work advanced the prospects of utilizing federated learning for privacy-preserving AI in digital health.