The anomaly detection in photovoltaic (PV) cell electroluminescence (EL) image is of great significance for the vision-based fault diagnosis. Many researchers are committed to solving this problem, but a large-scale open-world dataset is required to validate their novel ideas. We build a PV EL Anomaly Detection (PVEL-AD 1, 2, 3 ) dataset for polycrystalline solar cell, which contains 36 543 near-infrared images with various internal defects and heterogeneous background. This dataset contains anomaly free images and anomalous images with ten different categories. Moreover, 37 380 ground truth bounding boxes are provided for eight types of defects. We also carry out a comprehensive evaluation of the state-of-the-art object detection methods based on deep learning. The evaluation results on this dataset provide the initial benchmark, which is convenient for follow-up researchers to conduct experimental comparisons. To the best of our knowledge, this is the first public dataset for PV solar cell anomaly detection that provides box-wise ground truth. Furthermore, this dataset can also be used for the evaluation of many computer vision tasks such as few-shot detection, one-class classification, and anomaly generation.
8 July 2020 in IEEE Transactions on Industrial Informatics
The automatic defects detection for solar cell electroluminescence (EL) images is a challenging task, due to the similarity of defect features and complex background features. To address this problem, a novel Complementary Attention Network (CAN) is designed by connecting the novel channel-wise attention subnetwork with spatial attention subnetwork sequentially, which adaptively suppresses the background noise features and highlights the defect features simultaneously by employing the complementary advantage of the channel features and spatial position features. In CAN, the novel channel-wise attention subnetwork applies convolution operation to integrate the concatenated and discriminative output features extracted by Global Average Pooling (GAP) layer and Global Max Pooling (GMP) layer, which can make fully use of these informative features. Furthermore, a Region Proposal Attention Network (RPAN) is proposed by embedding CAN into Region Proposal Network (RPN) in Faster R-CNN to extract more refined defective region proposals, which is used to construct a novel end-to-end Faster RPAN-CNN framework for detecting defects in raw EL image. Finally, some experimental results on a large-scale EL dataset including 3629 images, 2129 of which are defective, show that the proposed method performs much better than other methods in terms of defects classification and detection results in raw solar cell EL images.
7 April 2021 in IEEE Transactions on Industrial Electronics
The multiscale defect detection for photovoltaic (PV) cell electroluminescence (EL) images is a challenging task, due to the feature vanishing as network deepens. To address this problem, an attention-based top-down and bottom-up architecture is developed to accomplish multiscale feature fusion. This architecture, called bidirectional attention feature pyramid network (BAFPN), can make all layers of the pyramid share similar semantic features. In BAFPN, cosine similarity is employed to measure the importance of each pixel in the fused features. Furthermore, a novel object detector is proposed, called BAF-Detector, which embeds BAFPN into region proposal network in Faster RCNN+FPN. BAFPN improves the robustness of the network to scales, thus the proposed detector achieves a good performance in multiscale defects detection task. Finally, the experimental results on a large-scale EL dataset, including 3629 images, 2129 of which are defective, show that the proposed method achieves 98.70% (F-measure), 88.07% (mAP), and 73.29% (IoU) in terms of multiscale defects classification and detection results in raw PV cell EL images.
17 December 2018 in IEEE Transactions on Industrial Informatics
Automatic defect detection on strip steel surfaces is a challenging task in computer vision, owing to miscellaneous patterns of defects, disturbance of pseudo defects, and random arrangement of gray-level in background. In this paper, a novel template establishment is presented. Further, a simple guidance template-based algorithm for strip steel surface defect detection is proposed. Firstly, a large number of defect-free images are collected to obtain the statistical characteristic of normal textures. Secondly, for each given test image, the initial template is built according to the statistical characteristic and the size of test image. Then, a sorting operation is applied to the given test image. Further, by updating the initial template, a unique guidance template is generated based on specific intensity distribution of the sorted test image. So far, the background of each test image is approximately reconstructed in the guidance template. Finally, based on pixel-wise detection, the defects can be located accurately by subtraction operation between the guidance template and sorted test image, reverse sorting operation, and adaptive threshold determination. Experimental results show that the proposed method is both efficient and effective. It achieves a better average detection rate of 96.2% on a data set including 1500 test images.
20 March 2019 in IEEE Transactions on Instrumentation and Measurement