10 March 2022 in Computers & Chemical Engineering
29 January 2024 in IEEE/CAA Journal of Automatica Sinica
This survey paper provides a review and perspective on intermediate and advanced reinforcement learning (RL) techniques in process industries. It offers a holistic approach by covering all levels of the process control hierarchy. The survey paper presents a comprehensive overview of RL algorithms, including fundamental concepts like Markov decision processes and different approaches to RL, such as value-based, policy-based, and actor-critic methods, while also discussing the relationship between classical control and RL. It further reviews the wide-ranging applications of RL in process industries, such as soft sensors, low-level control, high-level control, distributed process control, fault detection and fault tolerant control, optimization, planning, scheduling, and supply chain. The survey paper discusses the limitations and advantages, trends and new applications, and opportunities and future prospects for RL in process industries. Moreover, it highlights the need for a holistic approach in complex systems due to the growing importance of digitalization in the process industries.
14 April 2021 in IEEE Transactions on Neural Networks and Learning Systems
With the aid of neural networks, this article develops two data-driven designs of fault detection (FD) for dynamic systems. The first neural network is constructed for generating residual signals in the so-called finite impulse response (FIR) filter-based form, and the second one is designed for recursively generating residual signals. By theoretical analysis, we show that two proposed neural networks via self-organizing learning can find their optimal architectures, respectively, corresponding to FIR filter and recursive observer for FD purposes. Additional contributions of this study lie in that we establish bridges that link model- and neural-network-based methods for detecting faults in dynamic systems. An experiment on a three-tank system is adopted to illustrate the effectiveness of two proposed neural network-aided FD algorithms.
1 August 2021 in Journal of Process Control
15 March 2023 in Computers & Chemical Engineering
12 October 2022 in IEEE Transactions on Cognitive and Developmental Systems
Multi-agent systems are usually large-scaled with a growing degree of intelligence and integration. Direct applications of traditional (centralized) methods will become incompetent for effective process monitoring of multi-agent systems. It necessitates the cognitive learning strategies that determine the effective interactions among subsystems or individuals. Therefore, in order to improve monitoring performance, this paper targets the development of a new distributed process monitoring method that has the cognitive learning ability by embedding an adaptive pickup rule. The proposed cognitive learning-based method can reduce the computation loads in both off-line and online phases because only necessary information exchange (or communication topology) is involved. Furthermore, the threshold used for system monitoring is obtained by developing a fast search algorithm based on statistical learning theory. Case studies on the wastewater treatment system, which can be regarded as a typical multi-agent system, demonstrate the superiority of the proposed distributed process-monitoring method.