Jialu Fan

Jialu Fan

Auto-generated profile, based on publicly available information

Jialu Fan

State Key Laboratory of Synthetical Automation for Process Industries and the International Joint Research Laboratory of Integrated Automation, Northeastern University, Shenyang, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 October 2017 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
YJYi Jiang
Yi Jiang
JFJialu Fan
Jialu Fan
TCTianyou Chai
Tianyou Chai
JLJinna Li
Jinna Li
FLFrank L. Lewis
Frank L. Lewis
This paper studies the operational optimal control problem for the industrial flotation process, a key component in the mineral processing concentrator line. A new model-free data-driven method is developed here for real-time solution of this problem. A novel formulation is given for optimal selection of the process control inputs that guarantees optimal tracking of the operational indices while maintaining the inputs within specified bounds. Proper tracking of prescribed operational indices, namely concentrate grade and tail grade, is essential in the proper economic operation of the flotation process. The difficulty in establishing an accurate mathematic model is overcome, and optimal controls are learned online in real time, using a novel form of reinforcement learning we call Interleaved Learning for online computation of the operational optimal control solution. Simulation experiments are provided to verify the effectiveness of the proposed Interleaved Learning method and to show that it performs significantly better than standard Policy Iteration.

20 April 2021 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
WXWenqian Xue
Wenqian Xue
PKPatrik Kolaric
Patrik Kolaric
JFJialu Fan
Jialu Fan
BLBosen Lian
Bosen Lian
TCTianyou Chai
Tianyou Chai
FLFrank L. Lewis
Frank L. Lewis
This article provides a novel inverse reinforcement learning (RL) algorithm that learns an unknown performance objective function for tracking control. The algorithm combines three steps: 1) an optimal control update; 2) a gradient descent correction step; and 3) an inverse optimal control (IOC) update. The new algorithm clarifies the relation between inverse RL and IOC. It is shown that the reward weight of an unknown performance objective that generates a target control policy may not be unique. We characterize the set of all weights that generate the same target control policy. We develop a model-based algorithm and, further, two model-free algorithms for systems with unknown model information. Finally, simulation experiments are presented to show the effectiveness of the proposed algorithms.

25 January 2019 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
YJYi Jiang
Yi Jiang
BKBahare Kiumarsi
Bahare Kiumarsi
JFJialu Fan
Jialu Fan
TCTianyou Chai
Tianyou Chai
JLJinna Li
Jinna Li
FLFrank L. Lewis
Frank L. Lewis
This paper presents a model-free optimal approach based on reinforcement learning for solving the output regulation problem for discrete-time systems under disturbances. This problem is first broken down into two optimization problems: 1) a constrained static optimization problem is established to find the solution to the output regulator equations (i.e., the feedforward control input) and 2) a dynamic optimization problem is established to find the optimal feedback control input. Solving these optimization problems requires the knowledge of the system dynamics. To obviate this requirement, a model-free off-policy algorithm is presented to find the solution to the dynamic optimization problem using only measured data. Then, based on the solution to the dynamic optimization problem, a model-free approach is provided for the static optimization problem. It is shown that the proposed algorithm is insensitive to the probing noise added to the control input for satisfying the persistence of excitation condition. Simulation results are provided to verify the effectiveness of the proposed approach.

4 December 2017 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
YJYi Jiang
Yi Jiang
JFJialu Fan
Jialu Fan
TCTianyou Chai
Tianyou Chai
FLFrank L. Lewis
Frank L. Lewis
JLJinna Li
Jinna Li
This paper develops a new method for solving the optimal control tracking problem for networked control systems (NCSs), where network-induced dropout can occur and the system dynamics are unknown. First, a novel dropout Smith predictor is designed to predict the current state based on historical data measurements over the communication network. Then, it is shown that the quadratic form of the performance index is preserved even with dropout, and the optimal tracker solution with dropout is given based on a novel dropout generalized algebraic Riccati equation. New algorithms for off-line policy iteration (PI), online PI, and Q-learning PI are presented for NCS with dropout. The Q-learning algorithm adaptively learns the optimal control online using data measured over the communication network based on reinforcement learning, including dropout, without requiring any knowledge of the system dynamics. Simulation results are provided to show that the proposed approaches give proper optimal tracking performance for the NCS with unknown dynamics and dropout.

15 August 2017 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
Huan ZhouHuan Zhou
Huan Zhou
VLVictor C. M. Leung
Victor C. M. Leung
CZChunsheng Zhu
Chunsheng Zhu
SXShouzhi Xu
Shouzhi Xu
JFJialu Fan
Jialu Fan
In this paper, we predict nodes' social contact patterns from the temporal perspective, and propose a novel approach to improve the performance of data forwarding in opportunistic mobile networks (OMNs). Specifically, considering both the average separating time and the variance of the separating time, we first introduce the definition of temporal closeness and temporal centrality. Then, several intuitive prediction methods are designed to predict nodes' future temporal social contact patterns based on the observations from extensive real trace-driven simulation results. Afterward, based on the predicted temporal social contact patterns, we propose an efficient temporal closeness and centrality-based data forwarding strategy named TCCB for OMNs. The core idea of TCCB is to capture and utilize the temporal correlations to infer the future temporal social contact patterns in the remaining valid time of the data. Finally, extensive real trace-driven simulations are conducted to evaluate the performance of TCCB. The results show that TCCB is close to Epidemic in terms of delivery ratio but with significantly reduced delivery cost. Furthermore, TCCB performs much better than Bubble Rap and Prophet in terms of delivery ratio, but the delivery cost of TCCB is very close to that of Bubble Rap.

23 July 2018 in IEEE Transactions on Industrial Electronics
Verified
Journal Article
Closed access
YJYi Jiang
Yi Jiang
JFJialu Fan
Jialu Fan
TCTianyou Chai
Tianyou Chai
FLFrank L. Lewis
Frank L. Lewis
This paper studies the two-timescales operational optimal control (OOC) problem for flotation industrial process (FIP) with unknown operational model in the presence of setpoint constraints on the device layer. A novel dual-rate data-driven algorithm based on lifting technology and reinforcement learning (RL) is proposed. First, a dual-rate flotation process model including the device layer and the operational models is formulated. Then a proportional integral (PI) controller for device layer is designed, by using lifting technology, a unified timescale controlled plant model with partially unknown dynamics is established. Based on such a model, an online learning algorithm using neural network (NN) is presented so that the operational indices namely concentrate and tail grades can be kept in the target range while maintain the setpoints of the device layer within the specified bounds. At last, emulation experiments in a hardware-in-the-loop system are used to verify the effectiveness of the proposed method.