Jingwei Lu

Dr. Jingwei Lu


Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 March 2023 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Closed access
JLJingwei Lu
Jingwei Lu
LHLiyuan Han
Liyuan Han
QWQinglai Wei
Qinglai Wei
XWXiao Wang
Xiao Wang
XDXingyuan Dai
Xingyuan Dai
FWFei-Yue Wang
Fei-Yue Wang
This paper utilizes parallel control to investigate the problem of event-triggered deep reinforcement learning and develops an event-triggered deep Q-network (ETDQN) for decision-making of autonomous driving, without training an explicit triggering condition . Based on the framework of parallel control, the developed ETDQN incorporates information of actions into the feedback and constructs a dynamic control policy. First, in the realization of the dynamic control policy, we integrate the current state and the previous action to construct the augmented state as well as the augmented Markov decision process. Meanwhile, it is shown theoretically that the goal of the developed dynamic control policy is to learn the variation rate of the action. The augmented state contains information of the current state and the previous action, which enables the developed ETDQN to directly design the immediate reward considering communication loss. Then, based on dueling double deep Q-network (dueling DDQN), we establish the augmented action-value, value, and advantage functions to directly learn the optimal event-triggered decision-making policy of autonomous driving without an explicit triggering condition. It is worth noticing that the developed ETDQN applies to various deep Q-networks (DQNs). Empirical results demonstrate that, in event-triggered control, the developed ETDQN outperforms dueling DDQN and reduces communication loss effectively. Source code of this paper is available at: https://github.com/lujingweihh/Event-triggered-deep-Q-network https://github.com/lujingweihh/Event-triggered-deep-Q-network.

6 May 2022 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
JLJingwei Lu
Jingwei Lu
QWQinglai Wei
Qinglai Wei
TZTianmin Zhou
Tianmin Zhou
ZWZiyang Wang
Ziyang Wang
FWFei-Yue Wang
Fei-Yue Wang
This article uses parallel control to investigate the problem of event-triggered near-optimal control (ETNOC) for unknown discrete-time (DT) nonlinear systems. First, to achieve parallel control, an augmented nonlinear system (ANS) with an augmented performance index (API) is proposed to introduce the control input into the feedback system. The control stability relationship between the ANS and the original system is analyzed, and it is shown that, by choosing a proper API, optimal control of the ANS with the API can be seen as near-optimal control of the original system with the original performance index (OPI). Second, based on parallel control, a novel event-triggered scheme is proposed, and then a novel ETNOC method is developed using the time-triggered optimal value function of the ANS with the API. The control stability is proved, and an upper bound, which is related to the design parameter, is provided for the actual performance index in advance. Then, to implement the developed ETNOC method for unknown DT nonlinear systems, a novel online learning algorithm is developed without reconstructing unknown systems, and neural network (NN) and adaptive dynamic programming (ADP) techniques are employed in the developed algorithm. The convergence of the signals in the closed-loop system (CLS) is shown using the Lyapunov approach, and the assumption of boundedness of input dynamics is not required. Finally, two simulations justify the theoretical conjectures.

30 June 2023 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
QWQinglai Wei
Qinglai Wei
TZTianmin Zhou
Tianmin Zhou
JLJingwei Lu
Jingwei Lu
YLYu Liu
Yu Liu
Shuai SuShuai Su
Shuai Su
JXJun Xiao
Jun Xiao
In this article, we study the optimal control problem of continuous-time (CT) time-invariant nonlinear systems with stochastic nonlinear disturbances. A new stochastic adaptive dynamic programming (ADP) method is developed to solve the Hamilton–Jacobi–Bellman equation (HJBE). Under the conditional expectation, the value function and the control law are successively approximated simultaneously. The asymptotic stability of the closed-loop stochastic system in probability is analyzed by the stochastic Lyapunov direct method, and the convergence of the developed ADP method is given. Finally, four simulations illustrate the effectiveness of the developed method.

22 December 2022 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Open access
XWXingxia Wang
Xingxia Wang
XCXiang Cheng
Xiang Cheng
JLJingwei Lu
Jingwei Lu
OKOliver Kwan
Oliver Kwan
SLShixing Li
Shixing Li
ZPZhixing Ping
Zhixing Ping
Aiming to provide a novel paradigm of oil fields, metaverses-based parallel oil fields are proposed in this article. Compared with the existing smart/intelligent oil fields in cyber–physical systems (CPS), parallel oil fields can take human factors into full consideration and expand the operation space to cyber–physical–social systems (CPSS), which can be regarded as the abstract and scientific explanation of metaverses. In the proposed parallel oil fields, there are three kinds of workers (human workers, digital workers, and robotic workers) coordinating to construct a more reliable and intelligent oil field. Furthermore, the framework and methodology of parallel oil fields are illustrated by parallel systems and the artificial systems, computational experiments, and parallel executions (ACP) approach. Based on the proposed framework, parallel oil fields are capable of generating a more trustworthy artificial system and guaranteeing the realization of the 6S (safety, security, sustainability, sensitivity, service, and smartness) goal. Finally, based on dynamometer cards, fault diagnosis of sucker rod pumping systems (SRPS) is investigated in parallel oil fields.

30 December 2022 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Open access
JYJing Yang
Jing Yang
SLShimeng Li
Shimeng Li
XWXiaoxing Wang
Xiaoxing Wang
JLJingwei Lu
Jingwei Lu
HWHuaiyu Wu
Huaiyu Wu
XWXiao Wang
Xiao Wang
In cyber–physical–social systems, smart manufacturing has to overcome challenges, such as uncertainty, diversity, complexity in modeling, long-delayed responses to market changes, and human engineer dependency. DeFACT is a framework of parallel manufacturing in ManuVerse where the Decentralized Autonomous Organization-based interactions between parallel workers consisting of robotic, digital, and human workers are elaborated to transform from professional division to real-virtual division. In DeFACT, human workers are only responsible for 5% physical and mental work that is complex and creative, and the robotic and digital workers can take care of the rest. The perceptual and cognitive intelligence of digital workers are intensified by a manufacturing foundation model (MF-PC), where calibration and certification (C&C), and verification and validation (V&V) guarantee not only the accuracy of task models, but also the interpretability and controllability of feature learning. As a case study, the workflow of customized shoes of SANBODY Technology Company is illustrated to show how DeFACT breaks the time and space constraints, avoids production waste caused by aesthetic discrepancies with consumers, and truly realizes flexible manufacturing.

4 March 2024 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Closed access
JLJingwei Lu
Jingwei Lu
LLLefei Li
Lefei Li
FWFei-Yue Wang
Fei-Yue Wang
A novel event-triggered control (ETC) method, called deep event-triggered parallel control (deep-ETPC), is presented to achieve path tracking for comfortable autonomous driving (CAD) using parallel control and deep deterministic policy gradient (DDPG). Based on parallel control, the developed deep-ETPC method constructs a dynamic control policy by introducing variation rates of controls. By employing variation rates of controls, the developed deep-ETPC method is capable of indicating communication loss and comfortable driving indices in the reward, and then enables reinforcement learning (RL) agents to learn comfortable ETC driving policies directly. Moreover, the communication loss, which reflects ETC, is integrated into the reward, so there is no need to additionally design/train triggering conditions, which can be considered a type of multi-tasking learning. Furthermore, an EPTC-oriented DDPG algorithm is developed to achieve the developed deep-ETPC method, making DDPG applicable to ETC. Empirical results, including tracking a simple straight line trajectory and a complicated sinusoidal trajectory, demonstrate the effectiveness of the developed deepETPC method.