Junyao Xie

Junyao Xie

orcid

Research Focus & Metrics

Academic Career Length

35Years (1992-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 January 2024 in IEEE/CAA Journal of Automatica Sinica
Verified
Journal Article
Closed access
ODOguzhan Dogru
Oguzhan Dogru
Junyao XieJunyao Xie
Junyao Xie
OPOm Prakash
Om Prakash
RCRanjith Chiplunkar
Ranjith Chiplunkar
JSJansen Soesanto
Jansen Soesanto
BHBiao Huang
Biao Huang
This survey paper provides a review and perspective on intermediate and advanced reinforcement learning (RL) techniques in process industries. It offers a holistic approach by covering all levels of the process control hierarchy. The survey paper presents a comprehensive overview of RL algorithms, including fundamental concepts like Markov decision processes and different approaches to RL, such as value-based, policy-based, and actor-critic methods, while also discussing the relationship between classical control and RL. It further reviews the wide-ranging applications of RL in process industries, such as soft sensors, low-level control, high-level control, distributed process control, fault detection and fault tolerant control, optimization, planning, scheduling, and supply chain. The survey paper discusses the limitations and advantages, trends and new applications, and opportunities and future prospects for RL in process industries. Moreover, it highlights the need for a holistic approach in complex systems due to the growing importance of digitalization in the process industries.

26 January 2021 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
Junyao XieJunyao Xie
Junyao Xie
BHBiao Huang
Biao Huang
Stevan DubljevicStevan Dubljevic
Stevan Dubljevic
Data-driven methods have been extensively utilized in establishing predictive models from historical data for process monitoring and prediction of quality variables. However, most data-driven approaches assume that training data and testing data come from steady-state operating regions and follow the same distribution, which may not be the case when it comes to complex industrial processes. To avoid these restrictive assumptions and account for practical implementation, a novel online transfer learning technique is proposed to dynamically learn cross-domain features based on the variational Bayesian inference in this work. Stemming from the probabilistic slow feature analysis, a transfer slow feature analysis (TSFA) technique is presented to transfer dynamic models learned from different source processes to enhance prediction performance in the target process. In particular, two weighting functions associated with transition and emission equations are introduced and updated dynamically to quantify the transferability from source domains to the target domain at each time instant. Instead of point estimation, a variational Bayesian inference scheme is designed to learn the parameters under probability distributions accounting for corresponding uncertainties. The effectiveness of the proposed technique with applications to soft sensor modelling is demonstrated by a simulation example, a public dataset and an industrial case study.


1 September 2019 in European Journal of Control
Verified
Journal Article
Closed access
Junyao XieJunyao Xie
Junyao Xie
QXQingqing Xu
Qingqing Xu
Dong NiDong Ni
Dong Ni
Stevan DubljevicStevan Dubljevic
Stevan Dubljevic

25 October 2022 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
Junyao XieJunyao Xie
Junyao Xie
JHJukka-Pekka Humaloja
Jukka-Pekka Humaloja
CKC. R. Koch
C. R. Koch
Stevan DubljevicStevan Dubljevic
Stevan Dubljevic
We address constrained output estimation of discrete-time linear distributed parameter systems in the presence of plant and measurement disturbances. Sufficient conditions are proposed for the strong stability of the proposed moving horizon estimator. We further show that the discrete-time estimation results can be linked to continuous-time infinite-dimensional systems described by partial differential equations (PDEs) with unbounded disturbance and output operators by using Cayley-Tustin transformation. The theoretical results are illustrated with numerical examples on a one-dimensional (1D) wave equation and a 1D diffusion.

2 December 2021 in AIChE Journal
Verified
Journal Article
Closed access
PDF file
LZLu Zhang
Lu Zhang
Junyao XieJunyao Xie
Junyao Xie
Stevan DubljevicStevan Dubljevic
Stevan Dubljevic