Unmanned aerial vehicles (UAV) are increasingly used for topographic mapping. The camera calibration for UAV image blocks can be performed a priori or during the bundle block adjustment (self-calibration). For an area of interest with flat scene and corridor configuration, the focal length of camera is highly correlated with the height of the camera. Furthermore, systematic errors of camera calibration accumulate on the longer dimension and cause deformation. Therefore, special precautions must be taken when estimating camera calibration parameters. In order to better investigate the impact of camera calibration errors, a synthetic, error-free aerial image block is generated to simulate several issues of interest. Firstly, the erroneous focal length in the case of camera pre-calibration is studied. Nadir images are not able to prevent camera poses from drifting to compensate for the erroneous focal length, whereas the inclusion of oblique images brings significant improvement. Secondly, the case where the focal length varies gradually (e.g., when the camera subject to temperature changes) is investigated. The neglect of this phenomenon can substantially degrade the 3D measurement accuracy. Different flight configurations and flight orders are analyzed, the combination of oblique and nadir images shows better performance. At last, the rolling shutter effect is investigated. The influence of camera rotational motion on the final accuracy is negligible compared to that of the translational motion. The acquisition configurations investigated are not able to mitigate the degradation introduced by the rolling shutter effect. Other solutions such as correcting image measurements or including camera motion parameters in the bundle block adjustment should be exploited.
Images acquired with a long exposure time using a camera embedded on UAVs (Unmanned Aerial Vehicles) exhibit motion blur due to the erratic movements of the UAV. The aim of the present work is to be able to acquire several images with a short exposure time and use an image processing algorithm to produce a stacked image with an equivalent long exposure time. Our method is based on the feature point image registration technique. The algorithm is implemented on the light-weight IGN (Institut national de l’information géographique) camera, which has an IMU (Inertial Measurement Unit) sensor and an SoC (System on Chip)/FPGA (Field-Programmable Gate Array). To obtain the correct parameters for the resampling of the images, the proposed method accurately estimates the geometrical transformation between the first and the N-th images. Feature points are detected in the first image using the FAST (Features from Accelerated Segment Test) detector, then homologous points on other images are obtained by template matching using an initial position benefiting greatly from the presence of the IMU sensor. The SoC/FPGA in the camera is used to speed up some parts of the algorithm in order to achieve real-time performance as our ultimate objective is to exclusively write the resulting image to save bandwidth on the storage device. The paper includes a detailed description of the implemented algorithm, resource usage summary, resulting processing time, resulting images and block diagrams of the described architecture. The resulting stacked image obtained for real surveys does not seem visually impaired. An interesting by-product of this algorithm is the 3D rotation estimated by a photogrammetric method between poses, which can be used to recalibrate in real time the gyrometers of the IMU. Timing results demonstrate that the image resampling part of this algorithm is the most demanding processing task and should also be accelerated in the FPGA in future work.