8 May 2019 in IEEE Transactions on Industrial Informatics
In recent years, machine learning algorithms have been successfully applied to industrial processes. However, the concurrent analysis of static and dynamic representations has not been comprehensively addressed for industrial process fault classification. In the current work, an enhanced random forest algorithm with a concurrent analysis of static and dynamic nodes is proposed to address this issue for fault classification. First, the standard slow feature analysis is modified by designing a new slowness index that is more suitable for a supervised fault classification problem. Second, a feature ranking process is conducted to determine the significant features. These features, which substitute the raw variables in the nodes, are used to build the enhanced random forest. Using this scheme, the significant static and dynamic nodes are selected to enhance the discriminative ability and interpretation. Additionally, the slow features that are uncorrelated are more suitable for training the forest than the initial correlated variables, and the dynamic characteristics of industrial processes are thus comprehensively addressed. The application of the proposed method to fault classification is evaluated by both the Tennessee Eastman benchmark and a real-world three-phase flow process. The experimental results show that the proposed method outperforms the traditional learning algorithms with remarkable accuracy and F1 score that both exceed 70% for the 16-class Tennessee Eastman process and exceed 99% for the 4-class three-phase flow process. The selected significant features reveal that both the static and dynamic information play important roles in fault classification.
6 January 2020 in IEEE Transactions on Automation Science and Engineering
While machine-learning techniques have been widely used in smart industrial fault diagnosis, there is a major assumption that the source domain data (where the diagnosis model is trained) and the future target data (where the model is applied) must have the same distribution. However, this assumption may not hold in real industrial applications due to the changing operating conditions or mechanical wear. Recent advances have embedded the adversarial-learning mechanism into deep neural networks to reduce the distribution discrepancy between different domains to learn domain-invariant features and perform fault diagnosis. However, they only aligned the distributions of domains and neglected the fault-discriminative structure underlying the target domain, which leads to a decline in the diagnostic performance. In this article, a new method termed the fine-grained adversarial network-based domain adaptation (FANDA) is proposed to address the cross-domain industrial fault diagnosis problem. Different from the existing domain adversarial adaptation methods considering the domain discrepancy only, the features in FANDA are learned by competing against multiple-domain discriminators, which enable both a global alignment for two domains and a fine-grained alignment for each fault class across two domains. Thus, the fault-discriminative structure underlying two domains can be preserved in the adaptation process and the fault classification ability learned on the source domain can remain effective on the target data. Experiments on a mechanical bearing case and an industrial three-phase flow process case demonstrate the effectiveness of the proposed method.
15 June 2021 in IEEE Transactions on Neural Networks and Learning Systems
Soft sensors have been extensively developed and applied in the process industry. One of the main challenges of the data-driven soft sensors is the lack of labeled data and the need to absorb the knowledge from a related source operating condition to enhance the soft sensing performance on the target application. This article introduces deep transfer learning to soft sensor modeling and proposes a deep probabilistic transfer regression (DPTR) framework. In DPTR, a deep generative regression model is first developed to learn Gaussian latent feature representations and model the regression relationship under the stochastic gradient variational Bayes framework. Then, a probabilistic latent space transfer strategy is designed to reduce the discrepancy between the source and target latent features such that the knowledge from the source data can be explored and transferred to enhance the target soft sensor performance. Besides, considering the missing values in the process data in the target operating condition, the DPTR is further extended to handle the missing data problem utilizing the strong generation and reconstruction capability of the deep generative model. The effectiveness of the proposed method is validated through an industrial multiphase flow process.
14 April 2021 in IEEE Transactions on Neural Networks and Learning Systems
With the aid of neural networks, this article develops two data-driven designs of fault detection (FD) for dynamic systems. The first neural network is constructed for generating residual signals in the so-called finite impulse response (FIR) filter-based form, and the second one is designed for recursively generating residual signals. By theoretical analysis, we show that two proposed neural networks via self-organizing learning can find their optimal architectures, respectively, corresponding to FIR filter and recursive observer for FD purposes. Additional contributions of this study lie in that we establish bridges that link model- and neural-network-based methods for detecting faults in dynamic systems. An experiment on a three-tank system is adopted to illustrate the effectiveness of two proposed neural network-aided FD algorithms.
25 May 2021 in IEEE Transactions on Cybernetics
Unsupervised cross-domain fault diagnosis has been actively researched in recent years. It learns transferable features that reduce distribution inconsistency between source and target domains without target supervision. Most of the existing cross-domain fault diagnosis approaches are developed based on the consistency assumption of the source and target fault category sets. This assumption, however, is generally challenged in practice, as different working conditions can have different fault category sets. To solve the fault diagnosis problem under both domain and category inconsistencies, a multisource-refined transfer network is proposed in this article. First, a multisource-domain-refined adversarial adaptation strategy is designed to reduce the refined categorywise distribution inconsistency within each source–target domain pair. It avoids the negative transfer trap caused by conventional global-domainwise-forced alignments. Then, a multiple classifier complementation module is developed by complementing and transferring the source classifiers to the target domain to leverage different diagnostic knowledge existing in various sources. Different classifiers are complemented by the similarity scores produced by the adaptation module, and the complemented smooth predictions are used to guide the refined adaptation. Thus, the refined adversarial adaptation and the classifier complementation can benefit from each other in the training stage, yielding target-faults-discriminative and domain-refined-indistinguishable feature representations. Extensive experiments on two cases demonstrate the superiority of the proposed method when domain and category inconsistencies coexist.
11 March 2021 in IEEE Transactions on Cybernetics
Recently, canonical correlation analysis (CCA) has been explored to address the fault detection (FD) problem for industrial systems. However, most of the CCA-based FD methods assume both Gaussianity of measurement signals and linear relationships among variables. These assumptions may be improper in some practical scenarios so that direct applications of these CCA-based FD strategies are arguably not optimal. With the aid of neural networks, this work proposes a new nonlinear counterpart called a single-side CCA (SsCCA) to enhance FD performance. The contributions of this work are four-fold: 1) an objective function for the nonlinear CCA is first reformulated, based on which a generalized solution is presented; 2) for the practical implementation, a particular solution of SsCCA is developed; 3) an SsCCA-based FD algorithm is designed for nonlinear systems, whose optimal FD ability is illustrated via theoretical analysis; and 4) based on the difference in FD results between two test statistics, fault diagnosis can be directly achieved. The studies on a nonlinear three-tank system are carried out to verify the effectiveness of the proposed SsCCA method.