27 February 2024 in IEEE Transactions on Instrumentation and Measurement
An image-based real-time pantograph anomaly detection method is presented by combining unsupervised deep learning and nearest neighbor classification. The proposed method includes the following key steps. Firstly, an improved DeblurGAN-v2 deblurring algorithm is applied to the input pantograph image if there exists motion blur. Next, deep learning semantic segmentation with hybrid coding that combines lightweight convolutional neural network (CNN) and vision transformer (VIT) is employed to accurately segment the pantograph structure within the image. And multi-scale feature-dense aggregation network based on an attentional feature fusion (AFF) module has been designed to efficiently integrate information from different feature layers. Finally, a K-nearest neighbor classification algorithm with deep pre-trained features from the segmented pantograph mask image has been utilized to detect anomalies in the pantograph. Experimental results demonstrate that the proposed pantograph segmentation network outperforms several general segmentation algorithms, achieving high MIoU of 95.86% with parameter size of 7M and FPS of 81.7. And nearest neighbor classification with deep pre-trained features achieves excellent pantograph anomaly detection performance with area under the receiver operating characteristic curve of 0.987 and area under precision-recall curve of 0.998. It is verified that the proposed pantograph anomaly detection method does not rely on abnormal data, and can achieve a high anomaly detection accuracy of 98.75%.