25 March 2020 in IEEE Transactions on Industrial Electronics
The tracking and measurement methods of drogue in autonomous aerial refueling which based 2D image, because of the loss of depth information, are susceptible to light changes, occlusion, etc., resulting in false tracking and the failure of position and orientation of drogue measurement, which may lead to collision of drones. In order to solve these problems, this paper intends to introduce 3D information to solve the position and orientation of drogue based on the original 2D image tracking method. The method mainly includes two parts, tracking and measurement algorithms, using the decision function to effectively combine the two algorithms. The tracking algorithm provides a positioning area for the measurement algorithm, thereby reducing the amount of measurement operation data. The 3D measurement result of the measurement algorithm based on stereo vision is used for measuring the drogue's position and orientation, and fed back to the tracking algorithm, which eliminates the candidate area and reduces the error rate to improve accuracy of the tracking algorithm. The measurement algorithm can still be realized stably high-precision under occlusion and no cooperation markers, which is not available in traditional 2D image-based methods. We perform semi-physical simulation experiments to verify the effectiveness of the proposed method
1 October 2016 in Sensors and Actuators A: Physical
13 June 2023 in Optics Express
Large-field-of-view stereo vision system lacks flexible and high-precision calibration methods. To this end, we proposed a new distance-related distortion model based calibration method combining 3D points and checkerboards. The experiment indicates that the proposed method has a root mean square of fewer than 0.08 pixels for the reprojection error on the calibration dataset, and the mean relative error of length measurement in a volume of 5.0 m × 2.0 m × 16.0 m is 3.6‰. Compared with other distance-related models, the proposed model has the lowest reprojection error on the test dataset. Besides, in contrast to other calibration methods, our method offers enhanced accuracy and greater flexibility.
4 October 2022 in IEEE Transactions on Instrumentation and Measurement
A novel high-performance vision measurement method is proposed in this article. Via single-direction pixel binning, a traditional area-array camera is converted into an equivalent narrow area-array camera, and then a reasonable combination of these three cameras is used to realize precise spatial position and attitude measurements. This method, whose imaging is between area-array imaging and linear-array imaging, is able to overcome the shortcomings of the binocular stereovision measurement system (BSMS) based on area-array cameras, which has limited acquisition speed, insufficient sensitivity at a high frame rate, and a large amount of data. And it also overcomes the disadvantages of the multiple linear-array-camera-based measurement system (MLMS) using cylindrical lenses, which are easy to be disturbed by ambient light, and has weak multi-target capabilities. Simulation and physical experiments validate that, the measurement accuracy of the method in this article is at the same level as BSMS, when the sampling speed is increased by up to 8 times, and the amount of data is reduced to 3/16.
12 September 2017 in Journal of the Optical Society of America A
In order to detect the position of the cutting shield at the head of a double shield tunnel boring machine (TBM) during the excavation, this paper develops a combined measurement system which is mainly composed of several optical feature points, a monocular vision sensor, a laser target sensor, and a total station. The different elements of the combined system are mounted on the TBM in suitable sequence, and the position of the cutting shield in the reference total station frame is determined by coordinate transformations. Subsequently, the structure of the feature points and matching technique for them are expounded, the position measurement method based on monocular vision is presented, and the calibration methods for the unknown relationships among different parts of the system are proposed. Finally, a set of experimental platforms to simulate the double shield TBM is established, and accuracy verification experiments are conducted. Experimental results show that the mean deviation of the system is 6.8 mm, which satisfies the requirements of double shield TBM guidance.
5 May 2023 in Optics Express
In order to expand the field of view and measuremenst range, the camera is often mounted on a two-axis turntable to perform various visual tasks. And the calibration of the position and attitude relationship between the mounted camera and the two-axis turntable is a prerequisite for visual measurement. The turntable is considered an ideal orthogonal two-axis turntable in conventional methods. However, the rotation axes of the actual two-axis turntable may be neither vertical nor intersecting, and the optical center of the mounted camera is not always located in the rotation center of the turntable even for orthogonal two-axis turntables. The quite difference between the actual physical model of the two-axis turntable and the ideal model can cause large errors. Therefore, what we believe to be a novel position and attitude calibration method between a non-orthogonal two-axis turntable and the mounted camera is proposed. This method describes the spatial hetero-planar lines relationship between the azimuth axis and pitch axis of the turntable accurately. By the geometric invariant characteristics of the mounted camera in motion, the axes of turntable are recovered and the base coordinate system is established, and the position and attitude of the camera are calibrated. Simulation and experiments verify the correctness and effectiveness of our proposed method.