Tobias Rueckert

Tobias Rueckert

Auto-generated profile, based on publicly available information

Tobias Rueckert

OTH Regensburg

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 January 2024 in Computers in Biology and Medicine
Verified
Journal Article
Open access
TRTobias Rueckert
Tobias Rueckert
DRDaniel Rueckert
Daniel Rueckert
Christoph PalmChristoph Palm
Christoph Palm
In the field of computer- and robot-assisted minimally invasive surgery, enormous progress has been made in recent years based on the recognition of surgical instruments in endoscopic images and videos. In particular, the determination of the position and type of instruments is of great interest. Current work involves both spatial and temporal information, with the idea that predicting the movement of surgical tools over time may improve the quality of the final segmentations. The provision of publicly available datasets has recently encouraged the development of new methods, mainly based on deep learning. In this review, we identify and characterize datasets used for method development and evaluation and quantify their frequency of use in the literature. We further present an overview of the current state of research regarding the segmentation and tracking of minimally invasive surgical instruments in endoscopic images and videos. The paper focuses on methods that work purely visually, without markers of any kind attached to the instruments, considering both single-frame semantic and instance segmentation approaches, as well as those that incorporate temporal information. The publications analyzed were identified through the platforms Google Scholar, Web of Science, and PubMed. The search terms used were "instrument segmentation", "instrument tracking", "surgical tool segmentation", and "surgical tool tracking", resulting in a total of 741 articles published between 01/2015 and 07/2023, of which 123 were included using systematic selection criteria. A discussion of the reviewed literature is provided, highlighting existing shortcomings and emphasizing the available potential for future developments.

14 January 2026 in Medical Image Analysis
Verified
Journal Article
Open access
TRTobias Rueckert
Tobias Rueckert
DRDavid Rauber
David Rauber
RMRaphaela Maerkl
Raphaela Maerkl
LKLeonard Klausmann
Leonard Klausmann
SYSuemeyye R. Yildiran
Suemeyye R. Yildiran
Christoph PalmChristoph Palm
Christoph Palm
Reliable recognition and localization of surgical instruments in endoscopic video recordings are foundational for a wide range of applications in computer- and robot-assisted minimally invasive surgery (RAMIS), including surgical training, skill assessment, and autonomous assistance. However, robust performance under real-world conditions remains a significant challenge. Incorporating surgical context - such as the current procedural phase - has emerged as a promising strategy to improve robustness and interpretability. To address these challenges, we organized the Surgical Procedure Phase, Keypoint, and Instrument Recognition (PhaKIR) sub-challenge as part of the Endoscopic Vision (EndoVis) challenge at MICCAI 2024. We introduced a novel, multi-center dataset comprising thirteen full-length laparoscopic cholecystectomy videos collected from three distinct medical institutions, with unified annotations for three interrelated tasks: surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation. Unlike existing datasets, ours enables joint investigation of instrument localization and procedural context within the same data while supporting the integration of temporal information across entire procedures. We report results and findings in accordance with the BIAS guidelines for biomedical image analysis challenges. The PhaKIR sub-challenge advances the field by providing a unique benchmark for developing temporally aware, context-driven methods in RAMIS and offers a high-quality resource to support future research in surgical scene understanding.

9 February 2024 in Computers in Biology and Medicine
Verified
Journal Article
Closed access
TRTobias Rueckert
Tobias Rueckert
DRDaniel Rueckert
Daniel Rueckert
CPChristoph Palm
Christoph Palm

9 November 2025 in arXiv
Verified
Preprint
Open access
PDF file
TRTobias Rueckert
Tobias Rueckert
RMRaphaela Maerkl
Raphaela Maerkl
DRDavid Rauber
David Rauber
LKLeonard Klausmann
Leonard Klausmann
MGMax Gutbrod
Max Gutbrod
Christoph PalmChristoph Palm
Christoph Palm
Robotic- and computer-assisted minimally invasive surgery (RAMIS) is increasingly relying on computer vision methods for reliable instrument recognition and surgical workflow understanding. Developing such systems often requires large, well-annotated datasets, but existing resources often address isolated tasks, neglect temporal dependencies, or lack multi-center variability. We present the Surgical Procedure Phase, Keypoint, and Instrument Recognition (PhaKIR) dataset, comprising eight complete laparoscopic cholecystectomy videos recorded at three medical centers. The dataset provides frame-level annotations for three interconnected tasks: surgical phase recognition (485,875 frames), instrument keypoint estimation (19,435 frames), and instrument instance segmentation (19,435 frames). PhaKIR is, to our knowledge, the first multi-institutional dataset to jointly provide phase labels, instrument pose information, and pixel-accurate instrument segmentations, while also enabling the exploitation of temporal context since full surgical procedure sequences are available. It served as the basis for the PhaKIR Challenge as part of the Endoscopic Vision (EndoVis) Challenge at MICCAI 2024 to benchmark methods in surgical scene understanding, thereby further validating the dataset's quality and relevance. The dataset is publicly available upon request via the Zenodo platform.

10 August 2026 in Data in Brief
Verified
Journal Article
Open access
TRTobias Rueckert
Tobias Rueckert
RMRaphaela Maerkl
Raphaela Maerkl
DRDavid Rauber
David Rauber
LKLeonard Klausmann
Leonard Klausmann
MGMax Gutbrod
Max Gutbrod
Christoph PalmChristoph Palm
Christoph Palm

11 June 2025 in International Journal of Computer Assisted Radiology and Surgery
Verified
Journal Article
Open access
PDF file
RMRaphaela Maerkl
Raphaela Maerkl
TRTobias Rueckert
Tobias Rueckert
DRDavid Rauber
David Rauber
MGMax Gutbrod
Max Gutbrod
DNDanilo Weber Nunes
Danilo Weber Nunes
Christoph PalmChristoph Palm
Christoph Palm
Purpose: Recognizing previously unseen classes with neural networks is a significant challenge due to their limited generalization capabilities. This issue is particularly critical in safety-critical domains such as medical applications, where accurate classification is essential for reliability and patient safety. Zero-shot learning methods address this challenge by utilizing additional semantic data, with their performance relying heavily on the quality of the generated embeddings. Methods: This work investigates the use of full descriptive sentences, generated by a Sentence-BERT model, as class representations, compared to simpler category-based word embeddings derived from a BERT model. Additionally, the impact of z-score normalization as a post-processing step on these embeddings is explored. The proposed approach is evaluated on a multi-label generalized zero-shot learning task, focusing on the recognition of surgical instruments in endoscopic images from minimally invasive cholecystectomies. Results: The results demonstrate that combining sentence embeddings and z-score normalization significantly improves model performance. For unseen classes, the AUROC improves from 43.9 % to 64.9 %, and the multi-label accuracy from 26.1 % to 79.5 %. Overall performance measured across both seen and unseen classes improves from 49.3 % to 64.9 % in AUROC and from 37.3 % to 65.1 % in multi-label accuracy, highlighting the effectiveness of our approach. Conclusion: These findings demonstrate that sentence embeddings and z-score normalization can substantially enhance the generalization performance of zero-shot learning models. However, as the study is based on a single dataset, future work should validate the method across diverse datasets and application domains to establish its robustness and broader applicability.