Huarong Zheng

Dr. Huarong Zheng

Institute of Marine Information Science and Technology, Zhejiang University, Hangzhou 310058, China
orcid

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 June 2023 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Closed access
Dongfang MaDongfang Ma
Dongfang Ma
XCXi Chen
Xi Chen
WMWeihao Ma
Weihao Ma
Huarong ZhengHuarong Zheng
Huarong Zheng
FQFengzhong Qu
Fengzhong Qu
Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this paper. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.

21 September 2016 in IEEE Transactions on Control Systems Technology
Verified
Journal Article
Closed access
Huarong ZhengHuarong Zheng
Huarong Zheng
RNRudy R. Negenborn
Rudy R. Negenborn
GLGabriel Lodewijks
Gabriel Lodewijks
This brief proposes a distributed predictive path following controller with arrival time awareness for multiple waterborne automated guided vessels (waterborne AGVs) applied to interterminal transport (ITT). The goal is to design an efficient cooperative distributed algorithm that solves local problems in parallel and minimizes an overall objective. We model the ITT problem using waterborne AGVs with independent dynamics and objectives but coupling collision avoidance constraints. The problem is then solved by distributed model predictive control (DMPC) of which the parallelism is realized using the alternating direction method of multipliers (ADMM). Successive linearizations are utilized to maintain a tradeoff among computational complexity, optimality, and ease of decomposition. Moreover, we propose a fast ADMM by iteratively incorporating in local problems adaptive global information to improve convergence rates. Simulation results for an ITT case study illustrate the effectiveness of the proposed algorithms for DMPC of time-varying networks in general and cooperative distributed waterborne AGVs in particular.

16 July 2025 in Control Engineering Practice
Verified
Journal Article
Closed access
Huarong ZhengHuarong Zheng
Huarong Zheng
Chenguang LiuChenguang Liu
Chenguang Liu

13 March 2024 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
YYYing Yu
Ying Yu
Huarong ZhengHuarong Zheng
Huarong Zheng
WXWen Xu
Wen Xu
Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

22 March 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
Huarong ZhengHuarong Zheng
Huarong Zheng
JLJiacheng Li
Jiacheng Li
ZTZhuoer Tian
Zhuoer Tian
Chenguang LiuChenguang Liu
Chenguang Liu
WWWenxiang Wu
Wenxiang Wu
The trajectory tracking control of unmanned surface vehicles (USVs) generally faces challenges from complex uncertain hydrodynamics and system constraints. In this paper, we leverage the capability of the Deep Neural Networks (DNN) in approximating arbitrary nonlinear dynamics, and propose a hybrid physics-learning model based predictive control (PL-MPC) method, Neural-sailing, for USVs. The first feature of PL-MPC is robust in that it handles the modeling errors caused by either the USV uncertain hydrodynamics or the environmental disturbances. Particularly, the hybrid physics-learning model combines a conventional mass-Coriolis-damping USV maneuvering model and a DNN model. The DNN model is trained with comprehensive USV motion data. The hybrid model enables efficient model-based control design with easily pre-obtained simple models. Moreover, the stability of the PL-MPC is guaranteed following the quasi-infinite nonlinear predictive control scheme. The second feature of PL-MPC is being computationally efficient. We propose a successive linearization approach to deal with the complexity of the prediction model caused by the introduction of DNN. The optimal control sequence computed from the previous step is utilized to obtain a linearization trajectory in the current step. This is the first time that a hybrid physics-learning model is successively linearized and used for predictive control. Simulation results reveal that PL-MPC has higher tracking precision than the conventional predictive control. The PL-MPC with successive linearizations has comparable tracking control performance with that of PL-MPC. However, with successive linearizations, the controller is much more computationally efficient, and achieves the trade-off between the control performance and computational burden.

29 August 2017 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
Huarong ZhengHuarong Zheng
Huarong Zheng
RNRudy R. Negenborn
Rudy R. Negenborn
GLGabriel Lodewijks
Gabriel Lodewijks
Waterborne autonomous guided vessels (waterborne AGVs) moving over open waters experience environmental uncertainties. This paper proposes a novel cost-effective robust distributed control approach for waterborne AGVs. The overall system is uncertain and has independent subsystem dynamics but coupling objectives and state constraints. Waterborne AGVs determine their actions in a parallel way, while still minimizing an overall cost function and respecting coupling constraints robustly by communicating within a neighborhood. Our first contribution is the proposal of the system robustness level for the cost-effective robust distributed model predictive control (RDMPC) for waterborne AGVs. Cost-effective RDMPC models the price of robustness by explicitly considering uncertainty and system characteristics in a tube-based robust control framework. The second contribution is an efficient integrated branch & bound (B&B) and the alternating direction method of multipliers (ADMMs) algorithm for solving the cost-effective RDMPC problem. The algorithm exploits special ordered variable sets and combining branching criteria with intermediate ADMM results conducting smart search in B&B. Simulation results demonstrate the effectiveness of the proposed approach for cooperative distributed waterborne AGVs with cost-effective robustness.