Deflection measurement is the research focus of health monitoring for bridges during the operation period. This study develops a contactless measurement technique to monitor the bridge deflection, leveraging visual information from a team of unmanned aerial vehicles (UAVs). On the basis of the collinearity of the laser spots projected on the plane by the coplanar laser indicator, we can eliminate the motion of UAV, and calculate the vertical displacement of the position to be measured relative to the bridge pier. In the proposed method, the center of the laser spot is extracted through a method based on deep learning, and an algorithm based on scale-invariant features registration was developed to track the feature points of the bridge in the image sequence. According to the algorithm, we demonstrate the accuracy and feasibility of our approach through simulation and simulated bridge experiments. The result shows that the root mean squared error (RMSE) of measurement through our technique is less than 0.5 mm in the laboratory conditions. In addition, the limits and scalability of the presented method have been explored through a field experiment.
26 September 2023 in Journal of Intelligent Manufacturing
In the manufacturing of chips, the accurate and effective detection of internal bubble defects of chips is essential to maintain product reliability. In general, the inspection is performed manually by viewing X-ray images, which is time-consuming and less reliable. To solve the above problems, an improved bubble defect detection model YOLO-Xray based on the YOLOv5 algorithm for chip X-ray images is proposed. First, the chip X-ray images are preprocessed by image segmentation to construct the chip X-ray defect dataset, namely, CXray. Then, in the input stage, the K-means++ algorithm is used to re-cluster the CXray dataset to generate the anchors suitable for our dataset. In the backbone network, a micro-scale detection head is added to improve the capabilities for small defect detection. In the neck network, the bi-direction feature fusion idea of BiFPN is used to construct a new feature fusion network based on the improved backbone to fuse the semantic features of different layers. In addition, the Quality Focal Loss function is used to replace the cross-entropy loss function to solve the imbalance of positive and negative samples. The experimental results show that the mean average precision (mAP) of the YOLO-Xray algorithm on the CXray dataset reaches 93.5%, which is 5.1% higher than the original YOLOv5. Meanwhile, the YOLO-Xray algorithm achieves state-of-the-art detection accuracy and speed compared with other mainstream object detection models. This shows the proposed YOLO-Xray algorithm can provide technical support for bubble defect detection in chip X-ray images. The CXray dataset is also open and available at CXray.
18 June 2021 in IEEE Geoscience and Remote Sensing Letters
In space-based observations, there are large numbers of targets with large size ranges and intensities in a given image. However, the current detection studies mostly emphasize the saliency of targets but neglect their distribution characteristics, which may result in incorrect or missed detection results. In this letter, an effective detection algorithm based on target characteristics is proposed to pursue good multitarget detection performance. First, a space target model is studied to obtain its characteristics. Next, operators are applied to reduce the influence and search for suspected target-center points. Then, local regions around these points are extracted and normalized to reduce the intensity differences among targets and the influence of light conditions. Finally, three features are designed to confirm these suspected regions and their scale information. Furthermore, the threshold setting process is intuitive and significant while keeping the developed method robust in different cases. Compared with other current algorithms, the proposed algorithm achieves superior detection performance in terms of the number of detected targets, accuracy rate, false alarm rate, and computational cost.