1 September 2020 in Neurocomputing
1 March 2022 in IEEE Transactions on Industrial Informatics
Fault diagnosis in an open world refers to the diagnosis tasks that need to cope with previously unknown faults in the online stage. It faces a great challenge yet to be addressed - that is, the online data of unknown faults may be classified as normal samples with a high probability. In this paper, we develop an effective solution for this challenge by using supervised contrastive learning to learn a discriminative and compact embedding for the known normal situation and fault situations. Specifically, in addition to contrasting a given sample with other instances as is the case in conventional contrastive learning methods, our training scheme contrasts the normal samples with negative augmentations of themselves. The negative out-of-distribution data is generated by the Soft Brownnian Offset sampling method to simulate the previously unknown faults. Computational experiments are conducted on the Tennessee Eastman Process benchmark dataset and a practical plasma etching process dataset. The proposed method achieves significant improvement compared with four existing methods under three open-set fault diagnosis circumstances, i.e., balanced open-set fault diagnosis, imbalanced fault diagnosis, few-shot fault diagnosis. This demonstrates its great potentials in real world fault diagnosis applications.
2 September 2023 in Expert Systems with Applications
20 September 2023 in IEEE Transactions on Neural Networks and Learning Systems
In real industrial processes, fault diagnosis methods are required to learn from limited fault samples since the procedures are mainly under normal conditions and the faults rarely occur. Although attention mechanisms have become increasingly popular for the task of fault diagnosis, the existing attention-based methods are still unsatisfying for the above practical applications. First, pure attention-based architectures like transformers need a substantial quantity of fault samples to offset the lack of inductive biases thus performing poorly under limited fault samples. Moreover, the poor fault classification dilemma further leads to the failure of the existing attention-based methods to identify the root causes. To develop a solution to the aforementioned problems, we innovatively propose a supervised contrastive convolutional attention mechanism (SCCAM) with ante-hoc interpretability, which solves the root cause analysis problem under limited fault samples for the first time. First, accurate classification results are obtained under limited fault samples. More specifically, we integrate the convolutional neural network (CNN) with attention mechanisms to provide strong intrinsic inductive biases of locality and spatial invariance, thereby strengthening the representational power under limited fault samples. In addition, we ulteriorly enhance the classification capability of the SCCAM method under limited fault samples by employing the supervised contrastive learning (SCL) loss. Second, a novel ante-hoc interpretable attention-based architecture is designed to directly obtain the root causes without expert knowledge. The convolutional block attention module (CBAM) is utilized to directly provide feature contributions behind each prediction thus achieving feature-level explanations. The proposed SCCAM method is testified on a continuous stirred tank heater (CSTH) and the Tennessee Eastman (TE) industrial process benchmark. Three common fault diagnosis scenarios are covered, including a balanced scenario for additional verification and two scenarios with limited fault samples (i.e., imbalanced scenario and long-tail scenario). The effectiveness of the presented SCCAM method is evidenced by the comprehensive results that show our method outperforms the state-of-the-art methods in terms of fault classification and root cause analysis.
4 July 2023 in IEEE Transactions on Automation Science and Engineering
Although convolution neural network (CNN) has achieved certain success in fault detection and diagnosis (FDD) tasks in the chemical engineering industry, the performance and credibility of CNN-based FDD methods are greatly limited by two factors. First, CNN relies upon strong temporal/spatial correlation in data, which is very difficult to obtain in generic chemical tabular data. Second, most CNN methods have poor interpretability due to the encapsulation mechanism of feature extraction, and thus there is great difficulty in identifying the root-cause features from the results obtained using these methods. To address these difficulties, we propose an order-invariant and interpretable dilated convolution neural network (OIDLCNN), which is composed of feature clustering, dilated convolution, and a deep Shapley additive explanations (SHAP) explainer. Specifically, the feature clustering technique is adopted to reorder the features thus those with strong correlations are placed to be adjacent to each other. The large receptive field of dilated convolution can capture long-range correlations so then it can further recover the feature correlations and improve the classification performance. Last but not least, the proposed method provides interpretability by including the SHAP values to quantify feature contribution and identify the root-cause feature as the one with the highest contribution. Computational experiments are conducted on the Tennessee Eastman chemical process benchmark dataset. Compared with the other state-of-the-art methods, the proposed OIDLCNN-SHAP method achieves better performance in capturing feature correlations, detecting faults, and identifying the root-cause features. Note to Practitioners —Fault detection and diagnosis (FDD) is significant for reducing maintenance costs and improving safety in chemical processes. In this paper, we investigate the difficulty in detecting faults and identifying the root-cause features in chemical multivariate processes. This work was motivated by the fact that the existing CNN-based FDD algorithms are not designed for generic chemical tabular data and fail to capture vital information about feature correlations. In addition, the commonly used bayesian network-based root cause analysis methods are expensive since they require much prior knowledge and expert rules. We present a novel framework to capture the unique feature correlations and obtain the root-cause features without any expert knowledge. The proposed method provides an automatic and low-cost way for chemical process FDD tasks. It can be further integrated into the condition monitoring system of real chemical processes to analyze potential faults and identify the corresponding root causes in real time.
15 February 2022 in IEEE Transactions on Instrumentation and Measurement
In this article, a new fault diagnosis problem is formulated, which involves a large number of normal samples and in which almost all the fault classes are few-shot classes. Although this problem is common in many industrial scenarios, it remains a challenge overlooked in previous studies. To develop a novel solution for addressing this challenge, we employ long-tailed distribution in this work and name this new task the long-tailed fault diagnosis accordingly. Specifically, we divide the long-tailed fault diagnosis procedure into representation learning and classification. On this basis, we propose a method using progressively balanced supervised contrastive learning (PBS-SCL) for representation learning and a learnable linear classifier (LLC) for classification. The designed scheme consists of two phases. In the first phase, PBS-SCL is utilized to learn a more discriminative deep representation. In the second phase, an LLC is combined with the learned representation for better classification. Experiments are conducted on both the Tennessee Eastman process (TEP) benchmark dataset and a practical plasma etching process dataset. The results obtained show that the proposed method achieves significantly improved long-tailed fault diagnosis performance compared with existing methods.