13 September 2021 in IEEE Transactions on Smart Grid
Non-intrusive load monitoring (NILM) can monitor the operating state and energy consumption of appliances without deploying sub-meters and is promising to be widely used in residential communities. With the rapid increase of electric loads in amount and type, constructing representative load signatures and designing effective classification models are becoming increasingly crucial for NILM. In this paper, temporal and spectral load signatures that preserve sufficient information are constructed from the monitored energy data. The fusion of these two types of load signatures can provide rich distinguishing features for improving the performance of appliance recognition in NILM. Benefiting from the development of deep learning, this study proposes the two-stream convolutional neural networks (TSCNN) to extract the features from the two types of load signatures and perform classification. Furthermore, this study introduces the affinity propagation clustering strategy to mitigate the negative impact of intra-class variety mainly caused by multi-state loads in appliance recognition. The experimental results on public NILM datasets demonstrate that the proposed method outperforms most of the existing methods based on the voltage-current trajectory or recurrence graph in the recognition accuracy of submetered and aggregated measurements.
12 October 2023 in IEEE Transactions on Automation Science and Engineering
In this paper, we introduce the novel state-of-the-art Dual-attention Transformer and Discriminative Flow (DADF) framework for visual anomaly detection. Based on only normal knowledge, visual anomaly detection has wide applications in industrial scenarios and has attracted significant attention. However, most existing methods fail to meet the requirements of logic defect detection under complex semantic conditions. In contrast, the proposed DADF presents a new paradigm: it firstly leverages a pre-trained network to acquire multi-scale prior embeddings, followed by the development of a vision Transformer with dual attention mechanisms, namely self-attention and memorial-attention, to achieve global-local two-level reconstruction for prior embeddings with the sequential and normality association. Additionally, we propose using normalizing flow to establish discriminative likelihood for the joint distribution of prior and reconstructions at each scale. The experimental results validate the effectiveness of the proposed DADF approach, as evidenced by the impressive performance metrics obtained across various benchmarks, especially for logic defects with complex semantics. Specifically, DADF achieves image-level and pixel-level AUROC scores of 98.3 and 98.4, respectively, on the Mvtec AD benchmark, and an image-level AUROC score of 83.7 and a pixel sPRO score of 67.4 on the Mvtec LOCO AD benchmark. Additionally, we applied DADF to a real-world Printed Circuit Board (PCB) industrial defect inspection task, further demonstrating its efficacy in practical scenarios. The source code of DADF is available at https://github.com/hmyao22/DADF. Note to Practitioners —Most of the current industrial visual inspection techniques can only detect structural defects under uncomplicated semantic settings. Detecting anomalies in products featuring intricate components and logical defects with high-level semantics remains a considerable challenge. The presented DADF is a robust model that can effectively identify defects in products with complex components, such as Printed Circuit Boards (PCBs). Furthermore, it can also accurately detect both structural and logical defects, which is of significant importance for practical industrial applications.
13 September 2023 in IEEE Transactions on Circuits and Systems for Video Technology
This paper presents a novel framework, named Global-Local Correspondence Framework (GLCF), for visual anomaly detection with logical constraints. Visual anomaly detection has become an active research area in various real-world applications, such as industrial anomaly detection and medical disease diagnosis. However, most existing methods focus on identifying local structural degeneration anomalies and often fail to detect high-level functional anomalies that involve logical constraints. To address this issue, we propose a two-branch approach that consists of a local branch for detecting structural anomalies and a global branch for detecting logical anomalies. To facilitate local-global feature correspondence, we introduce a novel semantic bottleneck enabled by the visual Transformer. Moreover, we develop feature estimation networks for each branch separately to detect anomalies. Our proposed framework is validated using various benchmarks, including industrial datasets, Mvtec AD, Mvtec Loco AD, the logical dataset DigitAnatomy, and the newly proposed Mvtec AAD dataset. Experimental results show that our method outperforms existing methods, particularly in detecting logical anomalies.
18 December 2023 in IEEE Transactions on Instrumentation and Measurement
In recent years, the field of industrial visual anomaly detection (VAD) has attracted significant attention in the context of advanced smart manufacturing systems. However, several limitations remain unresolved in existing approaches. While these methods can achieve satisfactory performance when training separate models for different categories, their scalability and performance suffer when faced with the challenge of simultaneous training for multiple categories. Reconstruction-based methods generally suffer from the identical mapping problem. To address these limitations, this study introduces the partial semantic aggregation vision transformer (PSA-VT), a scalable framework for industrial visual anomaly detection (VAD) that enables simultaneous multicategory anomaly detection using a single model. Our proposed PSA-VT framework adopts a hybrid design strategy. First, a pretrained convolutional neural network (CNN) is employed to extract multiscale discriminative local representation. Subsequently, the PSA-VT is introduced to perform representation reconstruction through long-range global semantic aggregation. Finally, the anomalous properties can be estimated by evaluating the reconstruction error of the representations. We conducted extensive experiments using the Mvtec AD industrial anomaly detection dataset, as well as the semantic anomaly detection datasets. The experimental results demonstrate that our method achieves state-of-the-art (SOTA) performance by capturing high-level semantics. Notably, PSA-VT surpasses other methods for the one-model-15-category anomaly detection tasks on the Mvtec AD dataset. Furthermore, we applied incremental learning techniques to enable the rapid deployment of PSA-VT in a real industrial scenario.
8 March 2025 in Computers in Industry
22 November 2025 in Knowledge-Based Systems