17 October 2024 in Applied Optics
Element segmentation is a key step in nondestructive testing of printed circuit boards (PCBs) based on computed tomography (CT) technology. In recent years, there has been rapid development of self-supervised pretraining technology that can obtain general image features without labeled samples and then uses a small amount of labeled samples to solve downstream tasks, which has good potential in PCB element segmentation. At present, a masked image modeling (MIM) pretraining model has been initially applied in PCB CT image element segmentation. However, due to the small and regular size of PCB elements such as vias, wires, and pads, the global visual field has redundancy for a single-element reconstruction, which may damage the performance of the model. Based on this issue, we propose an efficient pretraining model based on multi-scale local visual field feature reconstruction for PCB CT image element segmentation (EMLR-seg). In this model, the teacher-guided MIM pretraining model is introduced into PCB CT image element segmentation for the first time, to our knowledge, and a multi-scale local visual field extraction (MVE) module is proposed to reduce redundancy by focusing on local visual fields. At the same time, a simple four-Transformer-blocks decoder is used. Experiments show that EMLR-seg can achieve 88.6% mIoU on the PCB CT image dataset we proposed, which exceeds 1.2% by the baseline model, and the training time is reduced by 29.6 h, a reduction of 17.4% under the same experimental condition, which reflects the advantage of EMLR-seg in terms of performance and efficiency.
24 December 2024 in Journal of X-Ray Science and Technology
Background: Computed Tomography (CT) technology is commonly used to realize non-destructive testing of Printed Circuit Board (PCB), and element segmentation is the key link in the process. Although the pretraining and finetuning paradigm alleviates the problem of labeling, PCB CT images are easily affected by uneven grayscale and layer penetration. This leads to difficult segmentation of boundaries and affect semantic understanding, resulting in jagged boundaries and even missing elements. Objective: This paper aims to solve the problem of poor boundary segmentation in PCB CT image element segmentation. Methods: To this end, we propose PCB CT image element segmentation model based on boundary-attention-guided finetuning. An improved boundary detection algorithm is proposed to enhance boundary sensing ability. In order to achieve non-fixed weight feature fusion, the Attention Feature Fusion module is designed to help boundary features better assist segmentation through attention mechanism. Results: Experiments show that BAG-FTseg can achieve 89.5% mIoU on our PCB CT dataset, exceeding the baseline model by 0.9%, and the boundary-mIoU reaches 69.5%, 5.3% higher than the baseline model. Conclusion: This method improves the accuracy of boundary segmentation of PCB elements and the efficiency of feature fusion through attention mechanism, which has practical significance.