Mobile mapping vehicles, equipped with cameras, laser scanners (in this paper referred to as light detection and ranging, LiDAR), and positioning systems are limited to acquiring surface data. However, in this paper, a method to fuse both LiDAR and 3D ground penetrating radar (GPR) data into consistent georeferenced point clouds is presented, allowing imaging both the surface and subsurface. Objects such as pipes, cables, and wall structures are made visible as point clouds by thresholding the GPR signal’s Hilbert envelope. The results are verified with existing utility maps. Varying soil conditions, clutter, and noise complicate a fully automatized approach. Topographic correction of the GPR data, by using the LiDAR data, ensures a consistent ground height. Moreover, this work shows that the LiDAR point cloud, as a reference, increases the interpretability of GPR data and allows measuring distances between above ground and subsurface structures.

Sewer infrastructure is vital for flood prevention, environmental protection, and public health. As part of sewer infrastructure, sewer systems are prone to degradation. Traditional maintenance methods for sewer systems are largely manual and reactive and rely on inconsistent data, leading to inefficient maintenance. The KaSyTwin research project addresses the urgent need for efficient and resilient sewer system management methods in Germany, aiming to develop a methodology for the semi-automated development and utilization of digital twins of sewer systems to enhance data availability and operational resilience. Using advanced multi-sensor robotic platforms equipped with scanning and imaging systems, i.e., laser scanners and cameras, as well as artificial intelligence (AI), the KaSyTwin research project focuses on generating digital twin-enabled representations of sewer systems in real time. As a project report, this work outlines the research framework and proposed methodologies in the KaSyTwin research project. Digital twins of sewer systems integrated with AI technologies are expected to facilitate proactive maintenance, resilience forecasting against extreme weather events, and real-time damage detection. Furthermore, the KaSyTwin research project aspires to advance the digital management of sewer systems, ensuring long-term functionality and public welfare via on-demand structural health monitoring and non-destructive testing.

Bridge inspection is a time-consuming, expensive, but indispensable task. In this work, a new semi-automatic workflow for a concrete bridge condition assessment system is developed and discussed. The workflow consists of three main parts merged in the new methodology. The elements are the data acquisition with cameras, the automated damage detection and localization using a neural network, and the resulting engineering condition assessment. Furthermore, a CAD model serves as a base for the later calculations for the condition assessment. Camera images are used for both sub-millimeter crack detection using semantic segmentation by an artificial neural network and a crack localization based on a combination of a photogrammetric workflow including structure from motion (SfM) and the projection as imprinted points directly onto the as-planned CAD mesh. Moreover, an approach for crack width derivation is given. The captured crack width, crack position, and the date of detection represent the input values for subsequent crack monitoring. Thereby, this new concept is proposed as an essential step towards a time-efficient and objective life-cycle assessment of reinforced concrete structures.

This work explores the possibility of automating the aerial survey of bridges to generate high-resolution images necessary for digital damage inspection. High-quality unmanned aerial vehicle (UAV) based 3D reconstruction of bridges is an important step towards autonomous infrastructure inspection. However, the calculation of optimal camera poses remains challenging due to the complex structure of bridges and is therefore often conducted manually. This process is time-consuming and can lead to quality losses. Research in this field to automate this process is yet sparse and often requires high informative models of the bridge as the base for calculations, which are not given widely. Therefore, this paper proposes an automated camera pose calculation method solely based on an easily accessible polygon mesh of the bridge. For safe operation, point cloud data of the environment are used for automated ground detection and obstacle avoidance including vegetation. First, an initial set of camera poses is generated based on a voxelized mesh created in respect to the quality requirements for 3D reconstruction using defined camera specification. Thereafter, camera poses not fulfilling safety distances are removed and specific camera poses are added to increase local coverage quality. Evaluations of three bridges show that for diverse bridge types, near-complete coverage was achieved. Due to the low computational effort of the voxel approach, the runtime was kept to a minimum, even for large bridges. The subsequent algorithm is able to find alternative camera poses even in areas where the optimal pose could not be placed due to obstacles.

The automated inspection and mapping of engineering structures are mainly based on photogrammetry and laser scanning. Mobile robotic platforms like unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs), but also handheld platforms, allow efficient automated mapping. Engineering structures like bridges shadow global navigation satellite system (GNSS), which complicates precise localization. Simultaneous localization and mapping (SLAM) algorithms offer a sufficient solution, since they do not require GNSS. However, testing and comparing SLAM algorithms in GNSS-denied areas is difficult due to missing ground truth data. This work presents an approach to measuring the performance of SLAM in indoor and outdoor GNSS-denied areas using a terrestrial scanner Leica RTC360 and a tachymeter to acquire point cloud and trajectory information. The proposed method is independent of time synchronization between robot and tachymeter and also works on sparse SLAM point clouds. For the evaluation of the proposed method, three LiDAR-based SLAM algorithms called KISS-ICP, SC-LIO-SAM, and MA-LIO are tested using a UGV equipped with two light detection and ranging (LiDAR) sensors and an inertial measurement unit (IMU). KISS-ICP is based solely on a single LiDAR scanner and SC-LIO-SAM also uses an IMU. MA-LIO, which allows multiple (different) LiDAR sensors, is tested on a horizontal and vertical one and an IMU. Time synchronization between the tachymeter and SLAM data during post-processing allows calculating the root mean square (RMS) absolute trajectory error, mean relative trajectory error, and the mean point cloud to reference point cloud distance. It shows that the proposed method is an efficient approach to measure the performance of SLAM in GNSS-denied areas. Additionally, the method shows the superior performance of MA-LIO in four of six test tracks with 5 to 7 cm RMS trajectory error, followed by SC-LIO-SAM and KISS-ICP in last place. SC-LIO-SAM reaches the lowest point cloud to reference point cloud distance in four of six test tracks, with 4 to 12 cm.