2 December 2021 in IEEE Transactions on Instrumentation and Measurement
Circle detection is a critical issue in computer vision and image processing. Whether in natural images or industrial images, the accuracy of circle detection has a significant impact on advanced vision applications. Conventional methods, such as circle Hough transform, random circle detection, and EDCircles, only reach pixel-level edge accuracy. This article proposes a subpixel circle detection method based on subpixel edges with accuracy of one-tenth of one pixel. All candidate circles are first detected by EDCircles. The circle scoring formula based on polarity, radius, and contour is then proposed to sort the detected circles, and the circle with the highest score is selected as the target. The 2-D subpixel calculation problem is transformed into the 1-D fitting problem, and the subpixel edge region is selected according to the gradient direction of the circular edge. To reduce the error of the step model and the real edge, the blurred edge model is proposed to fit the region. Subsequently, the parameters of the edge model are transformed into subpixel coordinates. To solve the problem that the traditional $L2$ -loss function is not robust to outliers, the Huber loss function is finally applied to the circle fitting, and the gradient descent method is adopted to calculate the circle parameters. Experiments on natural and industrial images show that the proposed method has good performance on robustness and accuracy.
11 March 2022 in IEEE Transactions on Industrial Informatics
Vision-based location of industrial chips is crucial for high-speed and high-precision mounting in surface mount technology (SMT) applications. The conventional general location method requires numerous details of the chips’ physical characteristics, making it unsuitable for unknown chip locations and offline learning. In this article, we propose a general chip detection algorithm based on subpixel features from accelerated segment test (FAST) points that offers strong applicability, high precision, and high speed. The core part of our method is the extraction of subpixel boundary FAST points. The conventional subpixel calculation method uses a single-edge model that results in large deviations between calculated and actual positions when applied to actual FAST points. We propose a dual-edge subpixel model containing two groups of edges to reduce this error. Compared with the iterative calculation method in OpenCV, this method has a closing solution and faster performance. We determine model parameters using spatial moments, and present the relationship between the model and subpixel positions. Our experiments on the SMT hardware platform demonstrate that our method is robust to noise, illumination, position, and chip type, and is faster, more accurate, and more reliable than the Hanwha SM481-Plus placement machine and point registration method.
19 June 2023 in IEEE Transactions on Instrumentation and Measurement
Structured light-based micro three-dimensional (3D) imaging technology is widely used in industrial applications. Using a well-calibrated camera and a projector, it is easy to obtain 3D surface topography of objects. However, single camera-projector pairs suffer from problems caused by shadows and their accuracy is limited due to the restricted field of view. To overcome these issues, this article proposes a multi-projector vision system consisting of a central camera and four surrounding projectors. The global geometry constraint scheme is applied to ensure consistency and stability across multiple projectors, which is achieved by board-to-board pose optimization. In addition, instead of directly using the iso-phase fringe line, geometric plane constraints are used in the calibration process to estimate corresponding projector pixel coordinates. Finally, a triangulation-based 3D reconstruction and data fusion approach is proposed to obtain high precision and shadow-reduced 3D surface topography. Experimental results are presented and discussed that demonstrate the good consistency and measurement accuracy of the proposed approach. The global geometry constraint scheme allows relative standard deviation and root-mean-square error in the measurements to be significantly reduced.
14 November 2024 in IEEE Transactions on Industrial Informatics
In mounting machines, vision measurement of surface mount devices (SMDs) is a crucial task, widely used for size calculation and defect detection. However, current vision measurement methods focus on specific SMDs, such as quad flat packages. There is no unified method for measuring all kinds of rectangular-pin components, which account for more than half of the SMDs processed in mounting machines. This article presents an automatic and universal method for measuring with subpixel accuracy the parameters of rectangular-pin SMDs, which can be applied to different types of SMDs. First, an edge gradient model is proposed in the form of asymmetric Gaussian function. After that, line segments of SMDs are extracted and a line adjacency matrix is obtained that describes the relationship between lines. Then, segments are combined into long lines by searching through the line adjacency matrix. Finally, pixel line pairs are refined to subpixel level. Experimental results on the surface mount hardware platform for different components under different angles and light conditions demonstrate the high accuracy and strong robustness of the proposed method.
23 May 2025 in IEEE Transactions on Instrumentation and Measurement
Structured light illumination is a remarkable technique for active three-dimensional measurements. However, global or indirect light transport degrades the accuracy of phase calculation. This article describes an efficient phase correction and fusion framework for microscopic measurements. It targets a multi-projector system consisting of one camera coupled with multiple digital projectors. The phase-to-depth relationship is determined by using the native geometric model, taking lens distortion into consideration. By exploiting spatial consistency across multiple views, the phase from different projectors can be transformed into a unified view space. In this context, a reliability metric for unified phases is proposed to identify erroneous phase regions. Using preserved consistent views and the weighted histogram of the local neighborhood, phase error is first coarsely compensated by rectifying the doubtful period order. In addition, a novel hybrid weighting factor integrating signal and geometric reliability is proposed to further reduce measurement error. Experimental results from both qualitative and quantitative evaluation demonstrate the feasibility and usefulness of the proposed framework.
13 August 2025 in IEEE Transactions on Instrumentation and Measurement
Utilizing visual techniques for the accurate and reliable identification of ball grid array (BGA) components that have tightly packed and intricate pin configurations in surface mount technology (SMT) presents a significant challenge. We present a novel visual detection method for accurately measuring and aligning solder balls, enhancing the accuracy and stability of BGA recognition. The method involves extracting key dimensions and shape features of solder balls using the connected region analysis and geometric screening methods. We also provide a new interpolation method for estimating subpixel edge positions and an improved Hampel method for weighting solder ball edges to improve circle fitting accuracy. Furthermore, we propose a new approach for measuring the pitch and subsequently detecting balls in the X- and Y-directions. Experiments on SMT hardware setup demonstrate that our method offers superior measurement accuracy and stability compared to the existing methods.