19 March 2021 in Journal of Field Robotics
AVAlejandro Fontan Villacampa
Alejandro Fontan Villacampa
+6
Planetary rovers increasingly rely on vision‐based components for autonomous navigation and mapping. Developing and testing these components requires representative optical conditions, which can be achieved by either field testing at planetary analog sites on Earth or using prerecorded data sets from such locations. However, the availability of representative data is scarce and field testing in planetary analog sites requires a substantial financial investment and logistical overhead, and it entails the risk of damaging complex robotic systems. To address these issues, we use our compact human‐portable DLR Sensor Unit for Planetary Exploration Rovers (SUPER) in the Moroccan desert to show resource‐efficient field testing and make the resulting Morocco‐Acquired data set of Mars‐Analog eXploration (MADMAX) publicly accessible. The data set consists of 36 different navigation experiments, captured at eight Mars analog sites of widely varying environmental conditions. Its longest trajectory covers 1.5 km and the combined trajectory length is 9.2 km. The data set contains time‐stamped recordings from monochrome stereo cameras, a color camera, omnidirectional cameras in stereo configuration, and from an inertial measurement unit. Additionally, we provide the ground truth in position and orientation together with the associated uncertainties, obtained by a real‐time kinematic‐based algorithm that fuses the global navigation satellite system data of two body antennas. Finally, we run two state‐of‐the‐art navigation algorithms, ORB‐SLAM2 and VINS‐mono, on our data to evaluate their accuracy and to provide a baseline, which can be used as a performance reference of accuracy and robustness for other navigation algorithms. The data set can be accessed at https://rmc.dlr.de/morocco2018.
2 March 2023 in IEEE Robotics and Automation Letters
This work presents SID-SLAM, a complete SLAM framework for RGB-D cameras. Our main contribution is a semi-direct approach that, for the first time, combines tightly and indistinctly photometric and feature-based image measurements. Additionally, SID-SLAM uses information metrics to reduce the state size with a minimal impact in the accuracy. Our evaluation on several public datasets shows that we achieve state-of-the-art performance regarding accuracy, robustness and computational footprint in CPU real time. In order to facilitate research on semi-direct SLAM, we record the Minimal Texture dataset, composed by RGB-D sequences challenging for current baselines and in which our pipeline excels.
21 December 2022 in Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization
In ureteroscopy a flexible ureteroscope is used to inspect the kidneys and the ureters. In this context, we investigate robotic solutions that leverage recent developments from Simultaneous Localization and Mapping (SLAM) to provide a 3D map of the organ to be explored and the ureteroscope’s pose. With this aid, the surgeoncan navigate through the organ more precisely. Additionally, for the final organ inspection, the risk of missing certain regions of the organ is minimized. In this paper, we propose a visual, monocular SLAM system based on ORB-SLAM3 that is able to estimate the pose of the ureteroscope’s tip. In order to fulfill this task, we introduce two pre-processing steps. The first one aims at increasing the contrast of the image and the second one helps to avoid detecting features in non-desired regions (e.g. reflections). Additionally, we extend ORB-SLAM3 with A-KAZE and SuperPoint features and compare their performances to ORB features. The proposed method is evaluated in two experiments. The first experiment shows that we are able to estimate the trajectory of the ureteroscope and the map of a synthetic kidney with low errors. The second experiment shows that the method also gives promising results in cystoscopy.
13 January 2022 in IEEE Robotics and Automation Letters
In this work, we derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups. The core of our approach is the formulation of the residual covariances as a combination of geometric and photometric noise sources. And our key novel contribution is the derivation of a term modelling how local 2D patches suffer from perspective deformation when imaging 3D surfaces around a point. Together, these add up to an efficient and general formulation which not only improves the accuracy of both feature-based and direct methods, but can also be used to estimate more accurate measures of the state entropy and hence better founded point visibility thresholds. We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment, improving their accuracy with a negligible overhead.
27 March 2024 in IEEE Robotics and Automation Letters
In flexible ureteroscopy (fURS) for kidney stones, the renal collecting system is inspected and stones are removed with a flexible ureteroscope (FU). One alternative to the fragmentation of stones and their removal with the help of graspers or extraction baskets is the dusting of stones with laser light. To support a single surgeon during a fURS procedure, in particular with the fine manipulation during dusting, we developed the CoFlex TOP system for the teleoperation of a handheld FU with three degrees of freedom. This paper describes the overall structure of the system, its kinematics and the hardware and software components. Subsequently, the system properties and its position repeatability are investigated and the system's feasibility for a tip positioning task in virtual reality is evaluated in a user study. Finally, we discuss the implications of the evaluation and sketch possible foci of a user study with urology surgeons.