25 September 2020 in IEEE Transactions on Instrumentation and Measurement
Vision measurement plays a significant role in robot automatic assembly. In this study, a new measurement method for robot peg-in-hole pre-alignment via a combined two-level vision system is proposed. The assembly system and a global coordinate system calibration procedure based on a dynamic coordinate system are developed to construct the accurate transformation between the coordinate systems. The subsequent hole pose is obtained with the proposed image processing method and hole edge matching method, followed by the 3-D hole reconstruction and spatial circle fitting algorithm. A low-cost pose determination is proposed based on hole edge point selection. The experiment and analysis indicate that the hybrid measurement system has high precision in the local hole pose and global robot pose measurement accuracy. The peg-in-hole assembly results verify the measurement and calibration accuracy sideways. Our hybrid measurement system enhances the vision measurement range and local accuracy, and robot automation.
13 August 2020 in IEEE Transactions on Instrumentation and Measurement
The combination of a large-field-of-view visual positioning system and a local scanning sensor affords an effective approach to the three-dimensional measurement of meter-scale objects and has been actively investigated by researchers. The calibration of such an integrated measurement system is essential to establishing the overall measurement accuracy. This paper proposes calculating the transformation relationship between the local system and the transfer target through the determination of the scales of the combined system. The principle and implementation of this tracking-based combined measurement system are described in this paper, as well as the use of the respective scales of the combined system to establish a model of the applicable geometrical relationships. The Kronecker product was used to solve the model equations, after which homogenous transformation matrix optimization was performed. An error model of the camera-based measurement system was also established based on a combination of the image distortion and the working volume. The two- and three-dimensional errors of the local and global sensors were further quantitatively simulated and visualized to demonstrate the calibration accuracy. Standard plane and complex large object measurement experiments were performed to verify the accuracy of the proposed measurement system and its use for the reconstruction of a large shape.
7 December 2022 in IEEE Transactions on Instrumentation and Measurement
This paper describes a pose measurement and tracking strategy for an automatic tracking-based scanning system through developing a ball-shaped target. The target structure is introduced. Then, to determine the target pose, a coded marker and accurate center extraction method is proposed using subpixel and cross-ratio invariance principle. Furthermore, the target coordinate system is established by vision-based target calibration. A confidence-based tracker is proposed, enabling higher tracking confidence and accuracy, and keeping a high tracking speed. The stereo vision estimates the 3D position and orientation of the moving target in real-time. The trajectory is smoothed dynamically based on the Kalman filter. Experiments are implemented to verify the tracking speed, accuracy, and spatial accessibility in robot tracking applications. Additionally, the proposed target and strategy have good performance in full-space and fall-orientation tracking.
16 January 2017 in Rapid Prototyping Journal
Purpose: It is a challenge to print a model with the size that is larger than the working volume of a three-dimensional (3D) printer. The purpose of this paper is to present a feasible approach to divide a large model into small printing parts to fit the volume of a printer and then assemble these parts into the final model. Design/methodology/approach: The proposed approach is based on the skeletonization and the minima rule. The skeleton of a printing model is first extracted using the mesh contraction and the principal component analysis. The 3D model is then partitioned preliminarily into many smaller parts using the space sweep method and the minima rule. The preliminary partition is finally optimized using the greedy algorithm. Findings: The skeleton of a 3D model can effectively represent a simplified version of the geometry of the 3D model. Using a model’s skeleton to partition the model is an efficient way. As it is generally desirable to have segmentations at concave creases and seams, the cutting position should be located in the concave region. The proposed approach can partition large models effectively to well retain the integrity of meaningful parts. Originality/value: The proposed approach is new in the rapid prototyping field using the model skeletonization and the minima rule. Based on the authors’ knowledge, there is no method that concerns the integrity of meaningful parts for partitioning. The proposed method can achieve satisfactory results by the integrity of meaningful parts and assemblability for most 3D models.
31 July 2019 in Journal of Modern Optics
Nonlinearities in the application of fringe projection metrology make it very difficult to acquire perfect 3D data. This paper describes a six-step phase-shifting technique for a structured light measurement system with an off-the-shelf projector. First, the phase error is analysed and a gamma model is established by deriving the relative expression between the wrapped phase and input images. This is then expressed in matrix form to derive a unique solution, which is used for the gamma solver. The complex gamma calibration and projector error compensation can be removed once the gamma value of the off-the-shelf projector has been determined. The ideal model reconstruction results are obtained through simulations and experiments, and the standard deviation of the phase error is found to be only 0.0039 radians. Hence, the proposed method eliminates the nonlinear errors associated with fringe projection technology using existing projectors and improves the overall image reconstruction quality.
17 December 2019 in International Journal of Precision Engineering and Manufacturing