The arrival of the intelligent manufacturing and industrial internet era brings more and more opportunities and challenges to modern industry. Specifically, the revolution of the production mode of traditional manufacturing is undergoing thanks to the techniques including but not limited to digits, network, intelligence, and industrial automation fields. As the core link between intelligent manufacturing and industrial internet platform, industrial Big Data analytics has been paid more and more attention by academia and industry. The efficient mining of the high-value information covered under industrial Big Data and the utilization of the real-life industrial process are among the hottest topics at present. Meanwhile, with the advanced development of industrial automation toward knowledge automation, the learning paradigm of industrial Big Data analytics is also evolving accordingly. Therefore, starting from the perspective of industrial Big Data analytics and aiming at the corresponding industrial scenarios, this article actively explores the revolution of the learning paradigm under the background of industrial Big Data: 1) The evolution of the industry Big Data analytics paradigm is analyzed, that is, from isolated learning to lifelong learning, and their relationships are further summarized; 2) Mainstream directions of lifelong learning are listed, and their applications in industrial scenarios are discussed in detail; 3) Prospects and future directions are given.

Fault detection and fault identification are consecutive steps of multivariate statistical process monitoring. In recent years, increasing attention has been paid to process dynamics. For dynamic process modeling, canonical variate analysis (CVA) extracts process dynamics effectively. However, process noises are not well analyzed in traditional CVA and corresponding fault identification methods are less studied. To solve these issues, a variational Bayesian CVA (VBCVA) model is proposed for dynamic process monitoring. Through a probabilistic perspective, the inevitable noises in realistic industrial processes can be captured in the new model. Moreover, the proposed model is further extended in the variational Bayesian framework to overcome the common problems in probabilistic methods. Besides, an improved fault identification approach based on fault relevance is introduced, which avoids the smearing effect caused by data reconstruction. Finally, the feasibility of the proposed process monitoring scheme is verified on the TE benchmark and a real wastewater treatment process.

As an efficient feature engineering tool, principal component analysis (PCA) has been widely used for feature extraction in the past decades. While a deep form of PCA has been developed for performance enhancement, the numerical computation problem may cause collapsion to this method, restricting it to a limited model complexity. At the same time, the potential of residual subspace in the deep PCA model has not been well explored, which may have significant impacts on the performance of deep model. In this paper, the layer-by-layer information transformation is made upon the residual subspace of the deep model, which we term here as deep residual PCA. Based on this model structure, sufficient model complexity can be easily obtained, and the features in both principal component subspace and residual subspace can be fully explored. Besides, an additional PCA model is further constructed based on the augmentation of extracted features from different layers of the deep model. Several downstream tasks are carried out by using deep residual PCA as feature engineering, performances of which are evaluated through two industrial examples.

Just-in-time learning (JITL) has become a widely used industrial process modeling tool. With the advent of the industrial big data era, rich data information has brought new opportunities to JITL. Specifically, the completeness of data samples in the era of big data provides an important premise and support for the JITL method, prompting us to rethink the application value of JITL in the context of industrial big data. At the same time, the huge amount of data causes certain difficulties in data searching, which is a key issue for JITL. In this article, a parallel computing strategy is adopted to divide the entire computational searching task into several subtasks, and assign the subtasks to parallel computing nodes to complete parallel searching. In this way, not only the full advantage of big data information is effectively utilized, but also the search capability and efficiency under big data are improved. In addition, in order to improve the real-time nature of JITL, a model library management (MLM) strategy is adopted, and the query similar samples are used to operate with existing similar models. And by selectively adding new data, the database management (DBM) strategy is also developed, which not only alleviates the problem of information redundancy, but also reduces the search pressure caused by the increasingly large database. Obviously, MLM and DBM are particularly important as JITL auxiliary tools under industrial big data. Combining parallel computing, a parallel JITL (P-JITL) framework is proposed. As an example, the variational Bayesian factor regression model is transformed into the parallel Bayesian-JITL method for big process data modeling, which is further extended to a nonlinear form. To evaluate the feasibility and efficiency of the developed methods, a real industrial case is demonstrated.