Bjoern Menze

Bjoern Menze

Auto-generated profile, based on publicly available information

Bjoern Menze

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 October 2015 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Open access
BMBjoern H. Menze
Bjoern H. Menze
AJAndrás Jakab
András Jakab
SBStefan Bauer
Stefan Bauer
JKJayashree Kalpathy-Cramer
Jayashree Kalpathy-Cramer
KFKeyvan Farahani
Keyvan Farahani
KLKoen Van Leemput
Koen Van Leemput
In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients - manually annotated by up to four raters - and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

15 July 2022 in Nature Communications
Verified
Journal Article
Open access
PDF file
MAMichela Antonelli
Michela Antonelli
ARAnnika Reinke
Annika Reinke
Spyridon BakasSpyridon Bakas
Spyridon Bakas
KFKeyvan Farahani
Keyvan Farahani
AKAnnette Kopp-Schneider
Annette Kopp-Schneider
MCM. Jorge Cardoso
M. Jorge Cardoso
International challenges have become the de facto standard for comparative assessment of image analysis algorithms. Although segmentation is the most widely investigated medical image processing task, the various challenges have been organized to focus only on specific clinical tasks. We organized the Medical Segmentation Decathlon (MSD)—a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities to investigate the hypothesis that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. MSD results confirmed this hypothesis, moreover, MSD winner continued generalizing well to a wide range of other clinical problems for the next two years. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to scientists that are not versed in AI model training.

10 July 2009 in BMC Bioinformatics
Verified
Journal Article
Open access
PDF file
BMBjoern H Menze
Bjoern H Menze
BKB Michael Kelm
B Michael Kelm
RMRalf Masuch
Ralf Masuch
UHUwe Himmelreich
Uwe Himmelreich
PBPeter Bachert
Peter Bachert
FHFred A Hamprecht
Fred A Hamprecht
Background: Regularized regression methods such as principal component or partial least squares regression perform well in learning tasks on high dimensional spectral data, but cannot explicitly eliminate irrelevant features. The random forest classifier with its associated Gini feature importance, on the other hand, allows for an explicit feature elimination, but may not be optimally adapted to spectral data due to the topology of its constituent classification trees which are based on orthogonal splits in feature space.Results: We propose to combine the best of both approaches, and evaluated the joint use of a feature selection based on a recursive feature elimination using the Gini importance of random forests' together with regularized classification methods on spectral data sets from medical diagnostics, chemotaxonomy, biomedical analytics, food science, and synthetically modified spectral data. Here, a feature selection using the Gini feature importance with a regularized classification by discriminant partial least squares regression performed as well as or better than a filtering according to different univariate statistical tests, or using regression coefficients in a backward feature elimination. It outperformed the direct application of the random forest classifier, or the direct application of the regularized classifiers on the full set of features.Conclusion: The Gini importance of the random forest provided superior means for measuring feature relevance on spectral data, but – on an optimal subset of features – the regularized classifiers might be preferable over the random forest classifier, in spite of their limitation to model linear dependencies only. A feature selection based on Gini importance, however, may precede a regularized linear classification to identify this optimal subset of features, and to earn a double benefit of both dimensionality reduction and the elimination of noise from the classification task.

12 February 2024 in Nature Methods
Verified
Journal Article
Open access
PDF file
LMLena Maier-Hein
Lena Maier-Hein
ARAnnika Reinke
Annika Reinke
PGPatrick Godau
Patrick Godau
MTMinu D. Tizabi
Minu D. Tizabi
FBFlorian Buettner
Florian Buettner
PJPaul F. Jäger
Paul F. Jäger
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. In biomedical image analysis, chosen performance metrics often do not reflect the domain interest, and thus fail to adequately measure scientific progress and hinder translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Developed by a large international consortium in a multistage Delphi process, it is based on the novel concept of a problem fingerprint—a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), dataset and algorithm output. On the basis of the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as classification tasks at image, object or pixel level, namely image-level classification, object detection, semantic segmentation and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases.

1 January 2017 in Medical Image Analysis
Verified
Journal Article
Open access
OMOskar Maier
Oskar Maier
BMBjoern H. Menze
Bjoern H. Menze
JGJanina von der Gablentz
Janina von der Gablentz
LHLevin Häni
Levin Häni
MHMattias P. Heinrich
Mattias P. Heinrich
MRMauricio Reyes
Mauricio Reyes
Ischemic stroke is the most common cerebrovascular disease, and its diagnosis, treatment, and study relies on non-invasive imaging. Algorithms for stroke lesion segmentation from magnetic resonance imaging (MRI) volumes are intensely researched, but the reported results are largely incomparable due to different datasets and evaluation schemes. We approached this urgent problem of comparability with the Ischemic Stroke Lesion Segmentation (ISLES) challenge organized in conjunction with the MICCAI 2015 conference. In this paper we propose a common evaluation framework, describe the publicly available datasets, and present the results of the two sub-challenges: Sub-Acute Stroke Lesion Segmentation (SISS) and Stroke Perfusion Estimation (SPES). A total of 16 research groups participated with a wide range of state-of-the-art automatic segmentation algorithms. A thorough analysis of the obtained data enables a critical evaluation of the current state-of-the-art, recommendations for further developments, and the identification of remaining challenges. The segmentation of acute perfusion lesions addressed in SPES was found to be feasible. However, algorithms applied to sub-acute lesion segmentation in SISS still lack accuracy. Overall, no algorithmic characteristic of any method was found to perform superior to the others. Instead, the characteristics of stroke lesion appearances, their evolution, and the observed challenges should be studied in detail. The annotated ISLES image datasets continue to be publicly available through an online evaluation system to serve as an ongoing benchmarking resource (www.isles-challenge.org).

2 October 2016
Verified
Book Chapter
Closed access
PDF file
PCPatrick Ferdinand Christ
Patrick Ferdinand Christ
MEMohamed Ezzeldin A. Elshaer
Mohamed Ezzeldin A. Elshaer
FEFlorian Ettlinger
Florian Ettlinger
STSunil Tatavarty
Sunil Tatavarty
MBMarc Bickel
Marc Bickel
BMBjoern H. Menze
Bjoern H. Menze