12 December 2023 in IEEE Sensors Journal
Soft sensor modeling for dynamic processes has become a trending topic and a pending challenge in industrial data analysis, especially in limited labeled data scenarios. Alternatively, data augmentation strategies provide a way to address the deficiency of samples. However, current time-series data augmentation methods do not consider the spatiotemporal dependencies among samples during the data generation procedure. To address the issue, a time-series denoising diffusion probabilistic model (TimeDDPM) is proposed to construct soft sensor for finite time-series samples. Firstly, the long short-term memory (LSTM) units and one-dimensional convolutional neural networks are implemented in the noise prediction network of TimeDDPM to mine both temporal and spatial properties of samples. Then, virtual samples are reconstructed step by step in the reverse process to enlarge the sample space of insufficient data. Finally, based on the augmented samples, the LSTM network is constructed as a base model to evaluate the quality of new training data. Two cases are employed to demonstrate the superiorities of the proposed method in comparison to several cutting-edge methods.
20 April 2023 in IEEE Transactions on Neural Networks and Learning Systems
Quality prediction is beneficial to intelligent inspection, advanced process control, operation optimization, and product quality improvements of complex industrial processes. Most of the existing work obeys the assumption that training samples and testing samples follow similar data distributions. The assumption is, however, not true for practical multimode processes with dynamics. In practice, traditional approaches mostly establish a prediction model using the samples from the principal operating mode (POM) with abundant samples. The model is inapplicable to other modes with a few samples. In view of this, this article will propose a novel dynamic latent variable (DLV)-based transfer learning approach, called transfer DLV regression (TDLVR), for quality prediction of multimode processes with dynamics. The proposed TDLVR can not only derive the dynamics between process variables and quality variables in the POM but also extract the co-dynamic variations among process variables between the POM and the new mode. This can effectively overcome data marginal distribution discrepancy and enrich the information of the new mode. To make full use of the available labeled samples from the new mode, an error compensation mechanism is incorporated into the established TDLVR, termed compensated TDLVR (CTDLVR), to adapt to the conditional distribution discrepancy. Empirical studies show the efficacy of the proposed TDLVR and CTDLVR methods in several case studies, including numerical simulation examples and two real-industrial process examples.
26 May 2023 in IEEE Sensors Journal
As the acquisition of variables that measure quality is typically challenging, labeled samples for building a model for soft sensors are often inadequate. Additionally, owing to the installation of redundant sensors, high-dimensional process data with strong correlations are acquired. Therefore, in this study, a sample selection strategy for active learning, referred to as latent-enhanced variational adversarial active learning (LVAAL), is developed to enhance quality prediction performance with limited labeled data. The LVAAL method uses a minimax game to explore the latent representation of the original data. Specifically, a latent-enhanced variational autoencoder is used to deceive the adversarial network into predicting all samples, both labeled and unlabeled, as labeled. However, the adversarial network attempts to indicate the difference between latent representations. Subsequently, Gaussian process regression is adopted as a base model for LVAAL. With the proposed LVAAL selection strategy, informative unlabeled samples are incrementally selected, thereby enhancing the prediction performance. The application results for a numerical case and an industrial example demonstrate the advantages of LVAAL compared with existing active learning strategies.
18 January 2024 in IEEE Transactions on Control Systems Technology
Supervised latent variable regression methods such as partial least squares (PLS) and dynamic PLS have found wide applications in data analytics, quality prediction, and fault monitoring in various industries. In this article, we tackle the unbalanced data problem of sparse quality measurement and abundant process data in process control systems to make use of all data samples for modeling. A novel semi-supervised dynamic latent variable regression (SemiDLVR) method is proposed for quality prediction and quality-relevant fault monitoring. The proposed SemiDLVR method integrates Laplacian manifold regularization with dynamic regularized latent variable regression (DrLVR) to form a semi-supervised framework to efficiently model unlabeled data. A unified objective that combines DrLVR and the Laplacian matrix is proposed and the solution is provided. Statistical monitoring indices are, thereafter, defined for quality-relevant fault monitoring in the semi-supervised framework. Results from experimental studies on a numerical simulation, an industrial sulfur recovery unit (SRU), and the Tennessee Eastman (TE) process benchmark are presented to demonstrate the effectiveness of the proposed method.
12 May 2023 in IEEE Transactions on Industrial Informatics
Traditional data-driven quality prediction methods are mainly built from static models using clean data with a slow sampling rate, leaving the process dynamics unused. To make full use of dynamic process data collected at a fast sampling rate, this article proposes a novel deep learning-based robust dual-rate dynamic data modeling method for quality prediction of dynamic nonlinear processes. A new dynamic data denoising generative adversarial imputation network is first proposed for the missing value imputation among the dynamic process data. Then, a new hint convolutional neural network (HCNN) is established for dual-rate data based quality prediction. The proposed HCNN incorporates the information hint mechanism of channel expansion into the convolutional neural network to extract the dynamic features with definitive time and variable information. Finally, the proposed method is verified using the Dow distillation process dataset and Beijing multisite air quality dataset.
31 May 2024 in IEEE Transactions on Industrial Informatics
Process shift of multimode process involving data distribution and dynamic relation makes traditional transfer learning methods be intractable and even result in negative transfer. To tackle this issue, this article proposes a novel self-tuning transfer dynamic modeling method for quality prediction of multimode processes. First, in order to capture domain-invariant spatiotemporal (DIST) features, a transfer dynamic convolution autoencoder (TDCAE) with a feature decomposition structure is established. Meanwhile, a first-order vector autoregressive constraint is embedded to extract consistent inner dynamics for DIST features. Then, a shared regression network is established to extract the relations with quality variables. Furthermore, by making full use of private spatiotemporal information from target labeled samples in response to the process shift, the self-tuning TDCAE (STDCAE) aided by a fine-tuning strategy is established for online compensation. Finally, the efficacy of the proposed TDCAE and STDCAE is demonstrated by a comprehensive study of a three-phase flow facility process.