Kevin B. W. Groot Lipman

Kevin B. W. Groot Lipman

Auto-generated profile, based on publicly available information

Kevin B. W. Groot Lipman

Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 January 2024 in Insights into Imaging
Verified
Journal Article
Open access
PDF file
BKBurak Kocak
Burak Kocak
TDTugba Akinci D'Antonoli
Tugba Akinci D'Antonoli
NMNathaniel Mercaldo
Nathaniel Mercaldo
AAAngel Alberich-Bayarri
Angel Alberich-Bayarri
BBBettina Baeßler
Bettina Baeßler
Renato CuocoloRenato Cuocolo
Renato Cuocolo
Purpose: To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies. Methods: We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated. Result: In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community. Conclusion: In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers. Critical relevance statement: A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning. Key points: • A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score (https://metricsscore.github.io/metrics/METRICS.html) and a repository created to collect feedback from the radiomics community (https://github.com/metricsscore/metrics). Graphical

25 October 2024 in European Radiology
Verified
Journal Article
Open access
PDF file
JSJoão Santinha
João Santinha
Daniel Pinto dos SantosDaniel Pinto dos Santos
Daniel Pinto dos Santos
FLFabian Laqua
Fabian Laqua
JVJacob Visser
Jacob Visser
KLKevin B. W. Groot Lipman
Kevin B. W. Groot Lipman
TDTugba Akinci D'Antonoli
Tugba Akinci D'Antonoli
Radiomics is a method to extract detailed information from diagnostic images that cannot be perceived by the naked eye. Although radiomics research carries great potential to improve clinical decision-making, its inherent methodological complexities make it difficult to comprehend every step of the analysis, often causing reproducibility and generalizability issues that hinder clinical adoption. Critical steps in the radiomics analysis and model development pipeline—such as image, application of image filters, and selection of feature extraction parameters—can greatly affect the values of radiomic features. Moreover, common errors in data partitioning, model comparison, fine-tuning, assessment, and calibration can reduce reproducibility and impede clinical translation. Clinical adoption of radiomics also requires a deep understanding of model explainability and the development of intuitive interpretations of radiomic features. To address these challenges, it is essential for radiomics model developers and clinicians to be well-versed in current best practices. Proper knowledge and application of these practices is crucial for accurate radiomics feature extraction, robust model development, and thorough assessment, ultimately increasing reproducibility, generalizability, and the likelihood of successful clinical translation. In this article, we have provided researchers with our recommendations along with practical examples to facilitate good research practices in radiomics. Key Points: Radiomics’ inherent methodological complexity should be understood to ensure rigorous radiomic model development to improve clinical decision-making. Adherence to radiomics-specific checklists and quality assessment tools ensures methodological rigor. Use of standardized radiomics tools and best practices enhances clinical translation of radiomics models.

3 August 2025 in European Radiology
Verified
Journal Article
Open access
PDF file
Michail KlontzasMichail Klontzas
Michail Klontzas
KLKevin B. W. Groot Lipman
Kevin B. W. Groot Lipman
TDTugba Akinci D'Antonoli
Tugba Akinci D'Antonoli
AAAnna Andreychenko
Anna Andreychenko
Renato CuocoloRenato Cuocolo
Renato Cuocolo
MHMerel Huisman
Merel Huisman
This article provides radiologists with practical recommendations for evaluating AI performance in radiology, ensuring alignment with clinical goals and patient safety. It outlines key performance metrics, including overlap metrics for segmentation, test-based metrics (e.g., sensitivity, specificity, and area under the receiver operating characteristic curve), and outcome-based metrics (e.g., precision, negative predictive value, F1-score, Matthews correlation coefficient, and area under the precision-recall curve). Key recommendations emphasize local validation using independent datasets, selecting task-specific metrics, and considering deployment context to ensure real-world performance matches claimed efficacy. Common pitfalls, such as overreliance on a single metric, misinterpretation in low-prevalence settings, and failure to account for clinical workflow, are addressed with mitigation strategies. Additional guidance is provided on threshold selection, prevalence-adjusted evaluation, and AI-generated image quality assessment. This guide equips radiologists to critically evaluate both commercially available and in-house developed AI tools, ensuring their safe and effective integration into clinical practice. Clinical relevance statement: This review provides guidance on selecting and interpreting AI performance metrics in radiology, ensuring clinically meaningful evaluation and safe deployment of AI tools. By addressing common pitfalls and promoting standardized reporting, it supports radiologists in making informed decisions, ultimately improving diagnostic accuracy and patient outcomes. Key Points: Radiologists must evaluate performance metrics as they reflect acceptable performance in specific datasets but do not guarantee clinical utility. Independent evaluation tailored to the clinical setting is essential . Performance metrics must align with the intended task of the AI application—segmentation, detection, or classification—and be selected based on domain knowledge and clinical context . Sensitivity, specificity, area under the ROC curve, and accuracy must be interpreted with prevalence-dependent metrics (e.g., precision, F1 score, and Matthew’s correlation coefficient) calculated for the target population to ensure safe and effective clinical use .

5 April 2024 in Journal of Magnetic Resonance Imaging
Verified
Journal Article
Closed access
RGRoberto Lo Gullo
Roberto Lo Gullo
JBJoren Brunekreef
Joren Brunekreef
EMEric Marcus
Eric Marcus
LHLynn K. Han
Lynn K. Han
SESarah Eskreis‐Winkler
Sarah Eskreis‐Winkler
Katja Pinker-DomenigKatja Pinker-Domenig
Katja Pinker-Domenig

13 August 2025 in Insights into Imaging
Verified
Journal Article
Open access
BKBurak Kocak
Burak Kocak
Angela AmmirabileAngela Ammirabile
Angela Ammirabile
IAIlaria Ambrosini
Ilaria Ambrosini
TDTugba Akinci D'Antonoli
Tugba Akinci D'Antonoli
ABAlessandra Borgheresi
Alessandra Borgheresi
Renato CuocoloRenato Cuocolo
Renato Cuocolo
Radiomics research has been hindered by inconsistent and often poor methodological quality, limiting its potential for clinical translation. To address this challenge, the METhodological RadiomICs Score (METRICS) was recently introduced as a tool for systematically assessing study rigor. However, its effective application requires clearer guidance. The METRICS-E3 (Explanation and Elaboration with Examples) resource was developed by the European Society of Medical Imaging Informatics—Radiomics Auditing Group in response. This international initiative provides comprehensive support for users by offering detailed rationales, interpretive guidance, scoring recommendations, and illustrative examples for each METRICS item and condition. Each criterion includes positive examples from peer-reviewed, open-access studies and hypothetical negative examples. In total, the finalized METRICS-E3 includes over 200 examples. The complete resource is publicly available through an interactive website. Critical relevance statement: METRICS-E3 offers deeper insights into each METRICS item and condition, providing concrete examples with accompanying commentary and recommendations to enhance the evaluation of methodological quality in radiomics research. Key Points: As a complementary initiative to METRICS, METRICS-E3 is intended to support stakeholders in evaluating the methodological aspects of radiomics studies. In METRICS-E3, each METRICS item and condition is supplemented with interpretive guidance, positive literature-based examples, hypothetical negative examples, and scoring recommendations. The complete METRICS-E3 explanation and elaboration resource is accessible at its interactive website. Graphical

22 May 2025 in European Radiology
Verified
Journal Article
Open access
PDF file
KCKalina Chupetlovska
Kalina Chupetlovska
TDTugba Akinci D’aNtonoli
Tugba Akinci D’aNtonoli
ZBZuhir Bodalal
Zuhir Bodalal
MAMohamed A. Abdelatty
Mohamed A. Abdelatty
HEHendrik Erenstein
Hendrik Erenstein
KLKevin B. W. Groot Lipman
Kevin B. W. Groot Lipman
High-quality segmentation is important for AI-driven radiological research and clinical practice, with the potential to play an even more prominent role in the future. As medical imaging advances, accurately segmenting anatomical and pathological structures is increasingly used to obtain quantitative data and valuable insights. Segmentation and volumetric analysis could enable more precise diagnosis, treatment planning, and patient monitoring. These guidelines aim to improve segmentation accuracy and consistency, allowing for better decision-making in both research and clinical environments. Practical advice on planning and organization is provided, focusing on quality, precision, and communication among clinical teams. Additionally, tips and strategies for improving segmentation practices in radiology and radiation oncology are discussed, as are potential pitfalls to avoid. Key Points: As AI continues to advance, volumetry will become more integrated into clinical practice, making it essential for radiologists to stay informed about its applications in diagnosis and treatment planning . There is a significant lack of practical guidelines and resources tailored specifically for radiologists on technical topics like segmentation and volumetric analysis . Establishing clear rules and best practices for segmentation can streamline volumetric assessment in clinical settings, making it easier to manage and leading to more accurate decision-making for patient care .