Gaussian mixture model (GMM) has been widely used for soft sensor modeling of multimode industrial processes. However, it has been recognized that the performance of GMM deteriorates with the presence of outliers which commonly exist in industrial datasets. In addition, samples with known labels in soft sensor applications are often rare because of expensive sampling equipment or time-consuming laboratory analysis. Shortage of labeled samples could lead GMM-based models to low prediction accuracy. To tackle such problems, A semi-supervised robust soft sensor modeling method called semi-supervised Student t mixture model (SsSMM) is proposed. Like the GMM, the SsSMM employs finite mixture models to learn data distributions; nevertheless, with the virtual of the long tail property of Student distribution, the SsSMM possesses stronger robustness against outliers compared with the GMM. Moreover, the semi-supervised model structure of SsSMM enables exploiting unlabeled samples of the SsSMM, such that the issues caused by insufficient labeled samples can be tackled. To identify model parameters of the SsSMM, we also develop an expectation maximization based training algorithm. Experimental results on numerical and industrial examples demonstrate that the proposed method is effective in: 1) modeling multimode characteristics; 2): exploiting unlabeled samples for performance improvement; 3) dealing with distinct outliers (in synthetic dataset) and indistinctive outliers (in industrial dataset).
12 October 2018 in IEEE Transactions on Industrial Electronics
Soft sensors based on Gaussian mixture models (GMM) have been widely used in industrial process systems for modeling the nonlinearity, non-Gaussianity and uncertainties. However, there are still some challenging issues in developing high-accuracy GMM-based soft sensors. Firstly, labeled samples are usually scarce due to technical or economical limitations, causing traditional supervised GMM-based soft sensing methods fail to provide satisfactory performance. Secondly, tremendous amounts of unlabeled samples are gathered, nevertheless, how to fully exploit those unlabeled samples in terms of improving both the predictive accuracy and computational efficiency remains unresolved. In this paper, in order to deal with these issues, two computationally efficient soft sensing methods, namely the parallel computing-based semisupervised Dirichlet process mixture models (P-S2DPMM) and stochastic gradient descent-based S2DPMM (SGD-S2DPMM), are proposed. The S2DPMM is first developed to mine information contained in both labeled and unlabeled samples for predictive accuracy enhancement, and subsequently is extended to the P-S2DPMM and SGD-S2DPMM to handle large-scale process data with sufficient and limited computing resources, respectively. Two case studies are carried out on real-world industrial processes, and the results obtained demonstrate the effectiveness of the proposed methods.
8 November 2019 in IEEE Transactions on Cybernetics
Soft sensors have been widely accepted for online estimating key quality-related variables in industrial processes. The Gaussian mixture models (GMM) is one of the most popular soft sensing methods for the non-Gaussian industrial processes. However, in industrial applications, the quantity of samples with known labels is usually quite limited because of the technical limitations or economical reasons. Traditional GMM-based soft sensor models solely depending on labeled samples may easily suffer from singular covariances, overfitting, and difficulties in model selection, which results in the performance deterioration. To tackle these issues, we propose a semisupervised Bayesian GMM (S²BGMM). In the S²BGMM, we first propose a semisupervised fully Bayesian model, which enables learning from both the labeled and unlabeled datasets for remedying the deficiency of infrequent labeled samples. Subsequently, a general framework of weighted variational inference is developed to train the S²BGMM, such that the rate of learning from unlabeled samples can be controlled by penalizing the unlabeled dataset. Case studies are carried out to evaluate the performance of the S²BGMM through a numerical example and two real-world industrial processes, which demonstrate the effectiveness and reliability of the proposed approach.
7 August 2018 in IEEE Transactions on Control Systems Technology
Gaussian mixture regression (GMR) is an effective tool in developing soft sensors for online estimating difficult-to-measure variables in industrial processes with multiple operating modes. However, the GMR usually requires a sufficient amount of labeled samples to guarantee accurate probability density function (PDF) estimations because of its supervised learning process. Unfortunately, in soft-sensor applications, labeled samples could be very infrequent due to technical or economic limitations, which may lead the GMR-based soft sensors to unreliable parameter estimation and model selection, resulting in poor prediction performance. To tackle this problem, a semisupervised GMR (S²GMR) was proposed, where both labeled and unlabeled samples were effective. In the S²GMR, the PDFs of Gaussian components in input space and the functional dependence between input and output variables were learned simultaneously based on the expectation-maximization algorithm. Moreover, the Bayesian information criterion was employed to automatically determine the number of Gaussians for the S²GMR. The S²GMR was first investigated by a numerical example, and then applied to a real-life ammonia synthesis process for estimating the oxygen concentration at the top of the primary reformer. The two case studies verified the effectiveness of the proposed method.
29 October 2019 in IEEE Transactions on Industrial Informatics
Just-in-time learning (JITL), which can deal with both process nonlinearities and time-varying characteristics, has become a widely used tool for industrial soft sensing. High performance of JITL lies in selecting accurate relevant sample set and developing good base learner, which, however, still have some issues unresolved. In this paper, a Bayesian JITL (BJTIL) is established to improve the performance of JITL-based soft sensor from both the two aspects. The BJITL has dual implications. First, a semisupervised relevant sample selection strategy with mixture of Mahalanobis distances based on fully Bayesian Dirichlet process mixture model is proposed, such that both labeled and unlabeled samples can be exploited and complicated non-Gaussian distributions (such as those with multi-peaks or severe asymmetry) can be accounted for. Second, a weighted fully Bayesian Gaussian regression model with randomized mean and covariance is proposed as the base learner training algorithm so as to deal with the overfitting and numerical issues. Two real-world industrial processes are employed to evaluate the performance of the BJITL when it is applied to soft sensor development. The results demonstrate that the BJITL can achieve higher predictive accuracy in contrast with some state-of-the-art schemes for relevant sample selection and base learner construction. In addition, it is shown that the BJTIL can provide better predictive uncertainties.
31 December 2019 in IEEE Transactions on Neural Networks and Learning Systems
For large-scale industrial plants, quality-related process monitoring is challenging because of the complex features of multiunit, multimode, high-dimension data. Hence, a hierarchical quality monitoring (HQM) algorithm based on the distributed parallel semisupervised Gaussian mixture model (dp-S²GMM) is proposed in this article. In HQM, a large-scale process is first decomposed into a group of unit blocks according to the process structure. Subsequently, in each block, a quality regression model with multimode big process data is built using the dp-S²GMM, which is derived from a scalable stochastic variational inference semisupervised GMM (SVI-S²GMM). With the regression model, a hierarchical fault detection and diagnosis scheme in both quality-related and quality-unrelated subspaces is proposed from the variable level, block level to plant-wide level. Finally, an industrial case study on the Tennessee Eastman process demonstrates the feasibility and effectiveness of the proposed HQM algorithm.