The transition from film imaging to digital imaging in photogrammetric data capture is opening interesting possibilities for photogrammetric processes. A great advantage of digital sensors is their radiometric potential. This article presents a state-of-the-art review on the radiometric aspects of digital photogrammetric images. The analysis is based on a literature research and a questionnaire submitted to various interest groups related to the photogrammetric process. An important contribution to this paper is a characterization of the photogrammetric image acquisition and image product generation systems. The questionnaire revealed many weaknesses in current processes, but the future prospects of radiometrically quantitative photogrammetry are promising.
Unmanned aerial vehicles (UAV) are increasingly used for topographic mapping. The camera calibration for UAV image blocks can be performed a priori or during the bundle block adjustment (self-calibration). For an area of interest with flat scene and corridor configuration, the focal length of camera is highly correlated with the height of the camera. Furthermore, systematic errors of camera calibration accumulate on the longer dimension and cause deformation. Therefore, special precautions must be taken when estimating camera calibration parameters. In order to better investigate the impact of camera calibration errors, a synthetic, error-free aerial image block is generated to simulate several issues of interest. Firstly, the erroneous focal length in the case of camera pre-calibration is studied. Nadir images are not able to prevent camera poses from drifting to compensate for the erroneous focal length, whereas the inclusion of oblique images brings significant improvement. Secondly, the case where the focal length varies gradually (e.g., when the camera subject to temperature changes) is investigated. The neglect of this phenomenon can substantially degrade the 3D measurement accuracy. Different flight configurations and flight orders are analyzed, the combination of oblique and nadir images shows better performance. At last, the rolling shutter effect is investigated. The influence of camera rotational motion on the final accuracy is negligible compared to that of the translational motion. The acquisition configurations investigated are not able to mitigate the degradation introduced by the rolling shutter effect. Other solutions such as correcting image measurements or including camera motion parameters in the bundle block adjustment should be exploited.
Images acquired with a long exposure time using a camera embedded on UAVs (Unmanned Aerial Vehicles) exhibit motion blur due to the erratic movements of the UAV. The aim of the present work is to be able to acquire several images with a short exposure time and use an image processing algorithm to produce a stacked image with an equivalent long exposure time. Our method is based on the feature point image registration technique. The algorithm is implemented on the light-weight IGN (Institut national de l’information géographique) camera, which has an IMU (Inertial Measurement Unit) sensor and an SoC (System on Chip)/FPGA (Field-Programmable Gate Array). To obtain the correct parameters for the resampling of the images, the proposed method accurately estimates the geometrical transformation between the first and the N-th images. Feature points are detected in the first image using the FAST (Features from Accelerated Segment Test) detector, then homologous points on other images are obtained by template matching using an initial position benefiting greatly from the presence of the IMU sensor. The SoC/FPGA in the camera is used to speed up some parts of the algorithm in order to achieve real-time performance as our ultimate objective is to exclusively write the resulting image to save bandwidth on the storage device. The paper includes a detailed description of the implemented algorithm, resource usage summary, resulting processing time, resulting images and block diagrams of the described architecture. The resulting stacked image obtained for real surveys does not seem visually impaired. An interesting by-product of this algorithm is the 3D rotation estimated by a photogrammetric method between poses, which can be used to recalibrate in real time the gyrometers of the IMU. Timing results demonstrate that the image resampling part of this algorithm is the most demanding processing task and should also be accelerated in the FPGA in future work.
Photogrammetric processing is available in various software solutions and can easily deliver 3D pointclouds as accurate as 1 pixel. Certain applications, e.g., very accurate shape reconstruction in industrial metrology or change detection for deformation studies in geosciences, require results of enhanced accuracy. The tie-point extraction step is the opening in the photogrammetric processing chain and therefore plays a key role in the quality of the subsequent image orientation, camera calibration and 3D reconstruction. Improving its precision will have an impact on the obtained 3D. In this research work we describe a method which aims at enhancing the accuracy of image orientation by adding a second iteration photogrammetric processing. The result from the classical processing is used as a priori information to guide the extraction of refined tie-points of better photogrammetric quality. Evaluated on indoor and UAV acquisitions, the proposed methodology shows a significant improvement on the obtained 3D point accuracy.
1 November 2022 in Journal of Structural Engineering
Structural health monitoring (SHM) based on global navigation satellite systems (GNSS) is an interesting solution to provide absolute positions at different locations of a structure in a global reference frame. In particular, low-cost GNSS stations for large-scale bridge monitoring have gained increasing attention these last years because recent experiments showed the ability to achieve a subcentimeter accuracy for continuous monitoring with adequate combinations of antennas and receivers. Technical solutions now allow displacement monitoring of long bridges with a cost-effective deployment of GNSS sensing networks. In particular, the redundancy of observations within the GNSS network with various levels of correlations between the GNSS time series makes such monitoring solution a good candidate for anomaly detection based on machine learning models, using several predictive models for each sensor (based on environmental conditions, or other sensors as input data). This strategy is investigated in this paper based on GNSS time series, and an anomaly indicator is proposed to detect and locate anomalous structural behavior. The proposed concepts are applied to a cable-stayed bridge for illustration, and the comparison between multiple tools highlights recurrent neural networks (RNN) as an effective regression tool. Coupling this tool with the proposed anomaly detection strategy enables one to identify and localize both real and simulated anomalies in the considered data set.