Qichao Ma

Qichao Ma

Auto-generated profile, based on publicly available information

Qichao Ma

Department of Automation, University of Science and Technology of China, Hefei, China

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 May 2018 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
JQJiahu Qin
Jiahu Qin
MLMan Li
Man Li
YSYang Shi
Yang Shi
QMQichao Ma
Qichao Ma
WZWei Xing Zheng
Wei Xing Zheng
In this paper, we aim to investigate the optimal synchronization problem for a group of generic linear systems with input saturation. To seek the optimal controller, Hamilton-Jacobi-Bellman (HJB) equations involving nonquadratic input energy terms in coupled forms are established. The solutions to these coupled HJB equations are further proven to be optimal and the induced controllers constitute interactive Nash equilibrium. Due to the difficulty to analytically solve HJB equations, especially in coupled forms, and the possible lack of model information of the systems, we apply the data-based off-policy reinforcement learning algorithm to learn the optimal control policies. A byproduct of this off-policy algorithm is shown that it is insensitive to probing noise that is exerted to the system to maintain persistence of excitation condition. In order to implement this off-policy algorithm, we employ actor and critic neural networks to approximate the controllers and the cost functions. Furthermore, the estimated control policies obtained by this presented implementation are proven to converge to the optimal ones under certain conditions. Finally, an illustrative example is provided to verify the effectiveness of the proposed algorithm.

6 February 2020 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
JQJiahu Qin
Jiahu Qin
QMQichao Ma
Qichao Ma
XYXinghuo Yu
Xinghuo Yu
LWlong wang
long wang
In this paper, we aim to investigate the synchronization problem of dynamical systems, which can be of generic linear or Lipschitz nonlinear type, communicating over directed switching network topologies. A mild connectivity assumption on the switching topologies is imposed, which allows them to be directed and jointly connected. We propose a novel analysis framework from both algebraic and geometric perspectives to justify the attractiveness of the synchronization manifold. Specifically, it is proven that the complementary space of the synchronization manifold can be spanned by certain subspaces constructed from the network structure. This allows to project the states of the dynamical systems onto these subspaces and transform the synchronization problem under consideration equivalently into a convergence one of the projected states in each subspace. Then, assuming the joint connectivity condition on the communication topologies, we are able to work out a unified convergence analysis for both types of dynamical systems. More specifically, for partialstate coupled generic linear systems, it is proven that synchronization can be reached if an extra condition, which is easy to verify in several cases, on the system dynamics is satisfied. For Lipschitz nonlinear systems with positive-definite inner coupling matrix, synchronization is realized if the coupling strength is strong enough to stabilize the evolution of the projected states in each subspace under certain conditions. The above claims generalize the existing results concerning both types of dynamical systems to so far the most general framework. Some illustrative examples are provided to verify our theoretical findings.

20 November 2017 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
JQJiahu Qin
Jiahu Qin
QMQichao Ma
Qichao Ma
Huijun GaoHuijun Gao
Huijun Gao
WZWei Xing Zheng
Wei Xing Zheng
In this paper, we aim to deal with the cooperative tracking problem for a group of nonlinear systems with actuator faults and external disturbance/model uncertainty. The faults in the actuator are allowed to be in arbitrary forms such as actuator degradation, amplification, or even total failure. Moreover, the disturbance/model uncertainty under consideration is of Lipschitz type by assuming that the derivative of disturbance/model uncertainty is uniformly bounded. Then, provided that the actuator has sufficient healthy components when the faults happen, we employ the integral sliding mode technique to design the controller that can tolerate the actuator faults, meanwhile the external disturbance can also be rejected. The controller design is separated into two steps. First, a nominal controller is designed such that the estimated disturbance/model uncertainty from disturbance observer is completely rejected and the desired performance is guaranteed. Second, by the integral sliding mode control technique, a compensating controller is designed such that the matched estimation error of actuator faults and the external disturbance/model uncertainty can be compensated. The designed controller, formed by the sum of the nominal controller and compensating controller, finally proves to guarantee practical synchronization of nonlinear systems. Simulations demonstrate the effectiveness of our theoretical findings.

5 April 2017 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
YKYu Kang
Yu Kang
JQJiahu Qin
Jiahu Qin
QMQichao Ma
Qichao Ma
Huijun GaoHuijun Gao
Huijun Gao
WZWei Xing Zheng
Wei Xing Zheng
The cluster synchronization problem is investigated using intermittent pinning control for the interacting clusters of nonidentical nodes that may represent either general linear systems or nonlinear oscillators. These nodes communicate over general network topology, and the nodes from different clusters are governed by different self-dynamics. A unified convergence analysis is provided to analyze the synchronization via intermittent pinning controllers. It is observed that the nodes in different clusters synchronize to the given patterns if a directed spanning tree exists in the underlying topology of every extended cluster (which consists of the original cluster of nodes as well as their pinning node) and one algebraic condition holds. Structural conditions are then derived to guarantee such an algebraic condition. That is: 1) if the intracluster couplings are with sufficiently strong strength and the pinning controller is with sufficiently long execution time in every period, then the algebraic condition for general linear systems is warranted and 2) if every cluster is with the sufficiently strong intracluster coupling strength, then the pinning controller for nonlinear oscillators can have its execution time to be arbitrarily short. The lower bounds are explicitly derived both for these coupling strengths and the execution time of the pinning controller in every period. In addition, in regard to the above-mentioned structural conditions for nonlinear systems, an adaptive law is further introduced to adapt the intracluster coupling strength, such that the cluster synchronization for nonlinear systems is achieved.

15 February 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
GWGuojie Wang
Guojie Wang
JQJiahu Qin
Jiahu Qin
Qingchen LiuQingchen Liu
Qingchen Liu
QMQichao Ma
Qichao Ma
CZCong Zhang
Cong Zhang
Visual servoing of Unmanned Aerial Vehicles (UAVs) has achieved satisfactory performance in fixed and planar motion targets. Due to highly coupled system dynamics and the sensitivity of the target image to aircraft attitude, the problem for chasing free-flying targets remains challenging. In this paper, a vision-based algorithm is designed for controlling an UAV while tracking an intruder flying arbitrarily in 3D space. Image-based visual servoing is used to design controllers that depend directly on errors in image plane. Specifically, a virtual camera approach is adopted to decouple the UAV dynamics by compensating the pitch and yaw, and an improved image error term is proposed to reduce the impact of the UAV rotation on error signals in the process of tracking, thus a simplified control design is achieved, and the stability of the visual servo system is guaranteed. Comparison and ablation experiments in both simulated and real environments are provided to verify the effectiveness of the proposed method.

9 September 2022 in IEEE Transactions on Industrial Electronics
Verified
Journal Article
Closed access
CYChengzhen Yan
Chengzhen Yan
JQJiahu Qin
Jiahu Qin
Qingchen LiuQingchen Liu
Qingchen Liu
QMQichao Ma
Qichao Ma
YKYu Kang
Yu Kang
Mapless navigation is a popular approach for guiding a robot in an unknown environment. However, current learning-based methods for mapless navigation cannot guarantee safe exploration during training. In this article, we aim to safely train a mapless navigation policy with 2-D LiDAR inputs using imitation learning (IL). We propose a novel IL training scheme based on the dataset aggregation with extra safety enhancement. In order to avoid collisions during training, we design a controlled exploration strategy for demonstration data collection. In this strategy, the output of the novice and expert policy are fused adaptively to control the robot. In order to improve the obstacle avoidance capability of the trained policy, we design a safety-enhanced loss function for network training. This proposed loss function focuses on the obstacle avoidance by prioritizing the training samples collected in different states. In addition, inspired by the symmetrical pattern of the navigation task, we propose a new data augmentation technique, which increases the training speed significantly. In both simulation and real-world experiments, our method demonstrates the remarkable performance in terms of training safety and navigation success rate compared with other IL-based approaches.