When deep learning methods are used to detect rail surface defects, the training accuracy declines due to small defects and an insufficient number of samples. This paper investigates the problem of rail surface defect detection by using an improved feature pyramid network (FPN) and the metric learning approach. Firstly, the FPN is improved by adding deformable convolution and convolutional block attention modules to improve the accuracy of detecting defects of different scales, and it is pretrained on the MS COCO dataset. Secondly, a new model is established to extract network features based on the transfer learning model and learned network parameters. Thirdly, a multimodal network structure is constructed, and the distance between each modal representative and the embedded feature vector is calculated to classify the defects. Finally, experiments are carried out on the miniImageNet dataset and the rail surface defect dataset. The results show that the mAP (five-way five-shot) of our method is 73.42% on the miniImageNet dataset and 63.29% on the rail defect dataset. Our experiments show the effectiveness of the proposed method, and the results of the rail surface defect detection are satisfactory. As there are few sample classification studies of rail surface defects, this work provides a different approach and lays a foundation for further research.
1 November 2020 in International Journal of Advanced Robotic Systems
Surface defects affect the quality and safety of oil seals. It is a challenge to detect such defects in a vision system because of the unequal reflection property of oil seal surfaces and low contrast between the defect and the background. This article proposes a visual detection method (VDM) for oil seal surface defects and outlines two key issues of VDMs. First, we present a superpixel segmentation algorithm based on the significant gray level variation in the radial direction of an oil seal surface image. This image is then divided into several ring belts. Subsequently, considering the reflection inequality and low contrast, we propose a new circumferential background difference algorithm based on the small variation along the circumferential direction of the image. This algorithm eliminates the influence of the reflection inequality and improves the contrast distinction between the defects and the background. The experimental results verify the effectiveness of the proposed method with a recall and precision as high as 95.2% and 86.8%, respectively.
28 November 2024 in Journal of Real-Time Image Processing
Cored wire is easily distorted and leads to an irregular section profile because the contented material is relatively soft and cored wire is sometimes less filled. This will result in tangled wound wire and bad product quality. Our goal is to design an inexpensive automatic winding machine based on the image processing technique to meet the requirements of higher productivity. The technique such as image smoothing and gray enhancement are applied to improve the image quality, and image is segmented by dynamic threshold which is determined by OTSU avoiding the disturb from the illumination or the production equipment .The vertical edge of the gap is extracted through the difference algorithm. Width between wires is considered as the geometric feature in this algorithm, to recognize the gap and to drive the executive system to correct. This algorithm has experimented in the cored-wire manufacturing, and the validity and the practicability has been proved.