Chang Wang

Dr. Chang Wang

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 February 2023 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
CYChao Yan
Chao Yan
CWChang Wang
Chang Wang
XXXiaojia Xiang
Xiaojia Xiang
KLKin Huat Low
Kin Huat Low
Xiangke WangXiangke Wang
Xiangke Wang
LSLincheng Shen
Lincheng Shen
Multiple unmanned aerial vehicles (UAVs) are able to efficiently accomplish a variety of tasks in complex scenarios. However, developing a collision-avoiding flocking policy for multiple fixed-wing UAVs is still challenging, especially in obstacle-cluttered environments. In this article, we propose a novel curriculum-based multiagent deep reinforcement learning (MADRL) approach called task-specific curriculum-based MADRL (TSCAL) to learn the decentralized flocking with obstacle avoidance policy for multiple fixed-wing UAVs. The core idea is to decompose the collision-avoiding flocking task into multiple subtasks and progressively increase the number of subtasks to be solved in a staged manner. Meanwhile, TSCAL iteratively alternates between the procedures of online learning and offline transfer. For online learning, we propose a hierarchical recurrent attention multiagent actor–critic (HRAMA) algorithm to learn the policies for the corresponding subtask(s) in each learning stage. For offline transfer, we develop two transfer mechanisms, i.e., model reload and buffer reuse, to transfer knowledge between two neighboring stages. A series of numerical simulations demonstrate the significant advantages of TSCAL in terms of policy optimality, sample efficiency, and learning stability. Finally, the high-fidelity hardware-in-the-loop (HITL) simulation is conducted to verify the adaptability of TSCAL. A video about the numerical and HITL simulations is available at https://youtu.be/R9yLJNYRIqY.

16 January 2023 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Closed access
Dong YinDong Yin
Dong Yin
XYXuan Yang
Xuan Yang
HYHuangchao Yu
Huangchao Yu
SCSiyuan Chen
Siyuan Chen
CWChang Wang
Chang Wang
For civil applications of Unmanned Aerial Vehicles (UAVs) for search, and emergency, data transmission between UAVs and Ground Control Stations (GCS) is always suffered from long distance, undulating terrains or other interferences. Thus, relaying is a critical enhancing technology in wireless communications for better service quality. In this paper, a planning method for fixed-wing relay UAV (RU) serving to sequential tasks of UAV swarm is proposed. Firstly, considering characteristics of signal propagation, antenna, environment and UAV, the UAV-to-GCS and UAV-to-UAV communication models are designed. And the limits of communication are investigated, which are crucial issues to provide a guarantee for swarm mission. Meanwhile, based on the analysis of relay UAVs requirements during the spatial distribution of tasks, a mixed integer nonlinear programming problem (MINLP) is constructed to solve the approximate number of relay nodes and access locations. Then aiming for the minimum number of relay UAVs, a continuous time-sharing relay UAVs reward model is constructed, and the consensus-based bundle algorithm (CBBA) is adopted to obtain the maximum rewards, including the number of relay nodes, mission sequences and route planning. Finally, the numerical simulation for a typical scenario is conducted to show the performance of the proposed approach.

4 September 2022 in Drones
Verified
Journal Article
Open access
PDF file
LWLizhen Wu
Lizhen Wu
CWChang Wang
Chang Wang
PZPengpeng Zhang
Pengpeng Zhang
CWChangyun Wei
Changyun Wei
Autonomous Unmanned Aerial Vehicle (UAV) landing remains a challenge in uncertain environments, e.g., landing on a mobile ground platform such as an Unmanned Ground Vehicle (UGV) without knowing its motion dynamics. A traditional PID (Proportional, Integral, Derivative) controller is a choice for the UAV landing task, but it suffers the problem of manual parameter tuning, which becomes intractable if the initial landing condition changes or the mobile platform keeps moving. In this paper, we design a novel learning-based controller that integrates a standard PID module with a deep reinforcement learning module, which can automatically optimize the PID parameters for velocity control. In addition, corrective feedback based on heuristics of parameter tuning can speed up the learning process compared with traditional DRL algorithms that are typically time-consuming. In addition, the learned policy makes the UAV landing smooth and fast by allowing the UAV to adjust its speed adaptively according to the dynamics of the environment. We demonstrate the effectiveness of the proposed algorithm in a variety of quadrotor UAV landing tasks with both static and dynamic environmental settings.

5 December 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
YZYi Zhu
Yi Zhu
TWTaotao Wang
Taotao Wang
CWChang Wang
Chang Wang
WQWei Quan
Wei Quan
MTMingwei Tang
Mingwei Tang
This study explores the intricate dynamics of trust in human–robot interaction (HRI), particularly in the context of modern robotic systems enhanced by artificial intelligence (AI). By grounding our investigation in the principles of interpersonal trust, we identify and analyze both similarities and differences between trust in human–human interactions and human–robot scenarios. A key aspect of our research is the clear definition and characterization of trust in HRI, including the identification of factors influencing its development. Our empirical findings reveal that trust in HRI is not static but varies dynamically with the complexity of the tasks involved. Notably, we observe a stronger tendency to trust robots in tasks that are either very straightforward or highly complex. In contrast, for tasks of intermediate complexity, there is a noticeable decline in trust. This pattern of trust challenges conventional perceptions and emphasizes the need for nuanced understanding and design in HRI. Our study provides new insights into the nature of trust in HRI, highlighting its dynamic nature and the influence of task complexity, thereby offering a valuable reference for future research in the field.

5 December 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
CYChao Yan
Chao Yan
CWChang Wang
Chang Wang
HZHan Zhou
Han Zhou
XXXiaojia Xiang
Xiaojia Xiang
Xiangke WangXiangke Wang
Xiangke Wang
LSLincheng Shen
Lincheng Shen
Flocking with multiple unmanned aerial vehicles (UAVs) offers significant potential for diverse applications due to its enhanced maneuverability, improved efficiency, and increased robustness. Collision avoidance is a critical and challenging issue for distributed flocking control with a UAV fleet, especially in dynamic environments with varying numbers of non-cooperative intruders. However, existing reinforcement learning based methods mainly focus on flocking with collision avoidance tasks with static obstacles and a fixed number of UAVs. In this article, we propose a scalable multi-agent reinforcement learning based method to solve the distributed flocking with collision avoidance problem for a scalable fleet of fixed-wing UAVs in dynamic environments. Specifically, we cast this problem in a decentralized partially observable Markov decision process framework and propose a scalable multi-agent reinforcement learning algorithm called spatial-temporal attention multi-agent actor-critic (STAAC). In this algorithm, we design a spatial-temporal attention based population-invariant network architecture to facilitate the representation learning of dynamic dimensional observations. By integrating the local spatial attention and global temporal attention mechanisms, STAAC is able to adapt to the changes in the scale of UAV fleets and the number of intruders. Finally, we empirically demonstrate the effectiveness, scalability, and adaptability of the proposed approach in numerical simulations and hardware-in-the-loop experiments.

11 July 2024 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
CWChang Wang
Chang Wang
JWJiaqing Wang
Jiaqing Wang
ZMZhaowei Ma
Zhaowei Ma
MXMingjin Xu
Mingjin Xu
KQKailei Qi
Kailei Qi
CWChangyun Wei
Changyun Wei
Autonomous unmanned aerial vehicle (UAV) landing on a moving unmanned ground vehicle (UGV) remains a challenge as it is difficult for the UAV to track the real-time state of the UGV and adjust its landing policy accordingly. This paper proposes a learning framework for a quadrotor UAV to land on a moving UGV without knowing its motion dynamics. Specifically, the learning framework consists of two main systems: a Landing Vision System (LVS) using deep learning and a Landing Control System (LCS) using deep reinforcement learning. The LVS enables the UAV to recognize and localize the UGV in real time to estimate the relative position and velocity between them. Besides, the location of the UGV is tracked in the field of view of the UAV using consecutive images, alleviating the tracking failure problem. We propose a Memory Consolidated TD3 (MCTD3) algorithm to generate optimal policies to enable precise tracking and landing control of the UAV. In addition, we propose an adaptive COACH (ACOACH) algorithm that allows human intervention in the action space of the UAV to speed up the training process. We demonstrate the effectiveness of the proposed method in both simulation and real-world experiments.