This study addresses the problem of fault detection in industrial processes by developing a time/frequency feature-driven ensemble learning method. In contrast to the current works based on time domain ensemble learning, this approach adequately integrates the critical frequency domain information. The frequency domain information can be used to effectively enhance the fault detection performance in ensemble learning. Here, the feature ensemble net (FENet) is chosen to capture the time domain feature. The power spectral density (PSD)-based frequency domain feature extraction network can capture the frequency domain features. Bayesian inference can then be used to combine the fault detection results that rely on time/frequency domain features. The simulations of the Tennessee Eastman Process (TEP) demonstrate that the proposed method significantly outperforms traditional methods. The average fault detection rate (FDR) of TEP faults 3, 5, 9, 15, 16, and 21 is 90.63%, much higher than that of 75% by FENet with one feature transformation layer, and those of about 4% by principal component analysis (PCA) and dynamic PCA (DPCA). This research provides a promising framework for more advanced and reliable fault detection in industrial applications.
With the increasing complexity of modern industrial processes, fault occurrences may lead to catastrophic consequences, making incipient fault detection crucial for industrial safety. This critical task confronts a key challenge: insufficient cross-domain generalization capacity. To overcome this challenge, a feature adaptive ensemble net (FAENet) is proposed by integrating transfer learning with ensemble learning. The framework comprises a feature adaptive extractor (FAE) utilizing convolutional neural networks (CNNs) with maximum mean discrepancy (MMD) for domain-invariant feature extraction, combined with an information entropy gain-based feature screening to filter out redundant and detrimental features. In addition, the famous benchmark Tennessee Eastman process (TEP) and Case Western Reserve University (CWRU) bearing datasets are adopted to demonstrate the performance of the proposed method. For incipient difficult faults 3, 5, 9, 15, 16, and 21 in the TEP, FAENet achieves 99.43% for average fault detection rates (FDRs), exceeding traditional methods of cross-domain fault detection (TCA, JDA, DANN, DTL) by more than 60%. For CWRU’s incipient bearing faults, FAENet achieves 99.4% for FDR, demonstrating significant superiority. This research holds significant practical implications for enhancing the safety and efficiency of industrial systems. It establishes a reliable framework for intelligent fault detection systems across diverse industrial environments, enabling early detection of potential faults to minimize operational risks.
Chemical process control systems are complex, and modeling the controlled object is the first task in automatic control and optimal design. Most chemical process modeling experiments require test signals to be applied to the process, which may lead to production interruptions or cause safety accidents. Therefore, this paper proposes an improved transformer model based on a self-attention mechanism for modeling industrial processes. Then, an evaluation mechanism based on root mean square error (RMSE) and Kullback–Leibler divergence (KLD) metrics is designed to obtain more appropriate model parameters. The Variational Auto-Encoder (VAE) network is used to compute the associated KLD. Finally, a real nonlinear dynamic process in the petrochemical industry is modeled and evaluated using the proposed methodology to predict the time series data of the process. This study demonstrates the validity of the proposed transformer model and illustrates the versatility of using an integrated modeling, evaluation, and prediction scheme for nonlinear dynamic processes in process industries. The scheme is of great importance for the field of industrial soft measurements as well as for deep learning-based time series prediction. In addition, the issue of a suitable time domain for the prediction is discussed.
This study addresses the problem of incipient fault detection in industrial processes by developing an enhanced dynamic inner principal component analysis (DiPCA) framework. This framework integrates a Transformer attention mechanism and a masked linear autoregressive moving average (ARMA) structure. In contrast to the original DiPCA, this approach can effectively characterize complex dynamic processes while maintaining the theoretical integrity of the original framework. Here, the sliding-window singular value decomposition is chosen to construct the dynamic feature matrix. The ARMA-Transformer network can capture the multi-step prediction features. A DiPCA-based dual monitoring system can then be used to establish dynamic and static residual statistics. The simulations of the Tennessee Eastman Process (TEP) demonstrate that the proposed method yields fault detection rates (FDRs) of 77.80% and 69.50% for incipient faults 3 and 9. These are higher than those of traditional DiPCA, ARMA, PCA, and DPCA by more than 40% on average. Validation on the Case Western Reserve University (CWRU) bearing dataset further shows an average FDR of 94.74% across 13 fault conditions. It thus offers an effective approach for early anomaly identification and safety monitoring in complex industrial processes.
Incipient fault detection in industrial processes remains challenging, particularly for notorious faults 3, 9, and 15 in a chemical process benchmark, namely the Tennessee Eastman process (TEP). This paper proposes a novel unsupervised framework, namely self-modulated KAN-enhanced direct cross-attention (SMK-DCA). It constructs heterogeneous features by integrating raw data, process-aware features, and sliding-window singular values. Kolmogorov–Arnold networks (KAN) enhance nonlinear expressiveness before a cyclic DCA mechanism enables comprehensive interactions among heterogeneous features. A feature-wise linear modulation (FiLM) adaptively calibrates representations, while a sparse autoencoder with multi-target reconstruction amplifies subtle fault signatures. By leveraging KAN’s superior approximation capability and cyclic multi-view fusion, the proposed method effectively captures incipient fault-induced variations often overlooked by conventional approaches. Extensive experiments on TEP demonstrate that SMK-DCA effectively detects incipient faults 3, 9, and 15, while obtaining the best average detection rate across all faults among the compared MSPM and deep learning methods. Furthermore, validation on real-world data from an IGBT power system confirms the generalization capability of the proposed method across different industrial domains.