Although machine learning (ML) has shown promise across disciplines, out-of-sample generalizability is concerning. This is currently addressed by sharing multi-site data, but such centralization is challenging/infeasible to scale due to various limitations. Federated ML (FL) provides an alternative paradigm for accurate and generalizable ML, by only sharing numerical model updates. Here we present the largest FL study to-date, involving data from 71 sites across 6 continents, to generate an automatic tumor boundary detector for the rare disease of glioblastoma, reporting the largest such dataset in the literature (n = 6, 314). We demonstrate a 33% delineation improvement for the surgically targetable tumor, and 23% for the complete tumor extent, over a publicly trained model. We anticipate our study to: 1) enable more healthcare studies informed by large diverse data, ensuring meaningful results for rare diseases and underrepresented populations, 2) facilitate further analyses for glioblastoma by releasing our consensus model, and 3) demonstrate the FL effectiveness at such scale and task-complexity as a paradigm shift for multi-site collaborations, alleviating the need for data-sharing.

The MRI community is using quantitative mapping techniques to complement qualitative imaging. For quantitative imaging to reach its full potential, it is necessary to analyze measurements across systems and longitudinally. Clinical use of quantitative imaging can be facilitated through adoption and use of a standard system phantom, a calibration/standard reference object, to assess the performance of an MRI machine. The International Society of Magnetic Resonance in Medicine AdHoc Committee on Standards for Quantitative Magnetic Resonance was established in February 2007 to facilitate the expansion of MRI as a mainstream modality for multi‐institutional measurements, including, among other things, multicenter trials. The goal of the Standards for Quantitative Magnetic Resonance committee was to provide a framework to ensure that quantitative measures derived from MR data are comparable over time, between subjects, between sites, and between vendors. This paper, written by members of the Standards for Quantitative Magnetic Resonance committee, reviews standardization attempts and then details the need, requirements, and implementation plan for a standard system phantom for quantitative MRI. In addition, application‐specific phantoms and implementation of quantitative MRI are reviewed. Magn Reson Med 79:48–61, 2018. © 2017 International Society for Magnetic Resonance in Medicine.

Purpose: A standard MRI system phantom has been designed and fabricated to assess scanner performance, stability, comparability and assess the accuracy of quantitative relaxation time imaging. The phantom is unique in having traceability to the International System of Units, a high level of precision, and monitoring by a national metrology institute. Here, we describe the phantom design, construction, imaging protocols, and measurement of geometric distortion, resolution, slice profile, signal‐to‐noise ratio (SNR), proton‐spin relaxation times, image uniformity and proton density.Methods: The system phantom, designed by the International Society of Magnetic Resonance in Medicine ad hoc committee on Standards for Quantitative MR, is a 200 mm spherical structure that contains a 57‐element fiducial array; two relaxation time arrays; a proton density/SNR array; resolution and slice‐profile insets. Standard imaging protocols are presented, which provide rapid assessment of geometric distortion, image uniformity, T₁ and T₂ mapping, image resolution, slice profile, and SNR.Results: Fiducial array analysis gives assessment of intrinsic geometric distortions, which can vary considerably between scanners and correction techniques. This analysis also measures scanner/coil image uniformity, spatial calibration accuracy, and local volume distortion. An advanced resolution analysis gives both scanner and protocol contributions. SNR analysis gives both temporal and spatial contributions.Conclusions: A standard system phantom is useful for characterization of scanner performance, monitoring a scanner over time, and to compare different scanners. This type of calibration structure is useful for quality assurance, benchmarking quantitative MRI protocols, and to transition MRI from a qualitative imaging technique to a precise metrology with documented accuracy and uncertainty.

BACKGROUND AND PURPOSE: Precision medicine is an approach to disease diagnosis, treatment, and prevention that relies on quantitative biomarkers that minimize the variability of individual patient measurements. The aim of this study was to assess the intersite variability after harmonization of a high-angular-resolution 3T diffusion tensor imaging protocol across 13 scanners at the 11 academic medical centers participating in the Transforming Research and Clinical Knowledge in Traumatic Brain Injury multisite study. MATERIALS AND METHODS: Diffusion MR imaging was acquired from a novel isotropic diffusion phantom developed at the National Institute of Standards and Technology and from the brain of a traveling volunteer on thirteen 3T MR imaging scanners representing 3 major vendors (GE Healthcare, Philips Healthcare, and Siemens). Means of the DTI parameters and their coefficients of variation across scanners were calculated for each DTI metric and white matter tract. RESULTS: For the National Institute of Standards and Technology diffusion phantom, the coefficients of variation of the apparent diffusion coefficient across the 13 scanners was <3.8% for a range of diffusivities from 0.4 to 1.1 × 10⁻⁶ mm²/s. For the volunteer, the coefficients of variations across scanners of the 4 primary DTI metrics, each averaged over the entire white matter skeleton, were all <5%. In individual white matter tracts, large central pathways showed good reproducibility with the coefficients of variation consistently below 5%. However, smaller tracts showed more variability, with the coefficients of variation of some DTI metrics reaching 10%. CONCLUSIONS: The results suggest the feasibility of standardizing DTI across 3T scanners from different MR imaging vendors in a large-scale neuroimaging research study.