In this article, a leader–follower system is developed for cooperative transportation. To the best of our knowledge, this is the first work in which interunmanned aerial vehicle communication is not required and the reference trajectory of the payload can be modified in real time, so that it can be applied to a dynamically changing environment. To track the modified reference trajectory in real time under the communication-free condition, the leader–follower system is considered as a nonholonomic system in which a controller is developed for the leader to achieve an asymptotic tracking of the payload. To eliminate the need to install force sensors, unscented Kalman filters (UKFs) are developed to estimate the forces applied by the leader and the follower. Stability analysis is conducted to prove that the tracking error of the closed-loop system is asymptotically stable; however, the dynamics of the UKF estimators is not considered in the closed-loop system, which is assumed to be a deterministic system for the controller. The experiments show that the controllers of the leader and the follower can work in the real world, but the tracking errors are affected by the disturbance of airflow in a restricted space.
6 August 2020 in IEEE Transactions on Control Systems Technology
A tracking controller for unmanned aerial vehicles (UAVs) is developed to track moving targets in the presence of occlusion. The controller can track moving targets based on a bounding box of the target detected by a deep neural network using the you-only-look-once (YOLO) method. The features generated from the YOLO approach relaxes the assumption of continuous availability of the feature points for applications, which facilitates estimation using an unscented Kalman filter (UKF) and the design of image-based tracking controller in this work. The challenge is that when occlusion is present, the bounding box of the moving target becomes unobtainable and makes the estimation diverge. To solve this, a motion model derived by quadratic programming is employed as a process model in the UKF, wherein the estimated velocity is implemented as a feedforward term in the developed tracking controller in order to enhance the tracking performance. Since no motion constraint is assumed for the target, the developed controller can be applied to track various moving targets. Simulations are used to demonstrate the performance of the developed estimator and controller in the presence of occlusion. Experiments are also conducted to verify the efficacy of the developed estimator and controller.
4 August 2023 in IEEE Transactions on Control Systems Technology
A heterogeneous sensing multiunmanned aerial vehicle (UAV) system is developed to track a moving target undergoing unknown motion. Using heterogeneous sensors for tracking can increase robustness and reduce costs. However, the formation configuration of the multi-UAV system needs to be designed to ensure the best estimation performance. A metric based on the Fisher information matrix is used to determine the best formation configuration since the state covariance matrix was proven to be lower bounded by the Cramer–Rao lower bound. In other words, the determinant value of the Fisher information matrix is designed to be the cost function, and limitation of the field of view (FOV), limitation of the tracking distance, and avoiding inter-UAV collisions are considered as constraints. Finally, the generated optimal formation configuration is converted to the relative position for the distributed controller of the UAVs to achieve tracking. Controllers for UAVs are designed to ensure that tracking of the target is achieved in the optimal configuration with the constraints satisfied. In addition to performing the theoretical analysis, experiments and simulations were conducted to verify the efficacy of the developed heterogeneous sensing system.
Most UAVs rely on GPS for localization in an outdoor environment. However, in GPS-denied environment, other sources of localization are required for UAVs to conduct feedback control and navigation. LiDAR has been used for indoor localization, but the sampling rate is usually too low for feedback control of UAVs. To compensate this drawback, IMU sensors are usually fused to generate high-frequency odometry, with only few extra computation resources. To achieve this goal, a real-time LiDAR inertial odometer system (RTLIO) is developed in this work to generate high-precision and high-frequency odometry for the feedback control of UAVs in an indoor environment, and this is achieved by solving cost functions that consist of the LiDAR and IMU residuals. Compared to the traditional LIO approach, the initialization process of the developed RTLIO can be achieved, even when the device is stationary. To further reduce the accumulated pose errors, loop closure and pose-graph optimization are also developed in RTLIO. To demonstrate the efficacy of the developed RTLIO, experiments with long-range trajectory are conducted, and the results indicate that the RTLIO can outperform LIO with a smaller drift. Experiments with odometry benchmark dataset (i.e., KITTI) are also conducted to compare the performance with other methods, and the results show that the RTLIO can outperform ALOAM and LOAM in terms of exhibiting a smaller time delay and greater position accuracy.
13 October 2016 in IEEE Transactions on Control of Network Systems
Decentralized synchronization approaches generally assume that communication of state information between neighboring agents is completely accurate. However, just one agent's communication of inaccurate information to neighbors can significantly degrade the performance of the entire network. To help abate this problem, we present a decentralized controller for a leader-follower framework which uses local information to vet neighbors and change consensus weights accordingly. Because updates of the consensus weights produce a switched system, switching control theory techniques are used to develop a dwell-time that must elapse between agents' successive weight updates. A Lyapunov-based stability analysis is presented which develops sufficient conditions for approximate convergence of follower agents' states to a leader agent's time-varying state. Simulation results are provided to demonstrate the performance of the developed techniques.
To track moving targets undergoing unknown translational and rotational motions, a tracking controller is developed for unmanned aerial vehicles (UAVs). The main challenges are to control both the relative position and orientation between the target and the UAV to within desired values, and to guarantee that the generated control input to the UAV is feasible (i.e., below its motion capability). Moreover, the UAV is controlled to ensure that the target always remains within the field of view of the onboard camera. These control objectives were achieved by developing a nonlinear-model predictive controller, in which the future motion of the target is predicted by quadratic programming (QP). Since constraints of the feature vector and the control input are considered when solving the optimal control problem, the control inputs can be bounded and the target can remain inside the image. Three simulations were performed to compare the efficacy and performance of the developed controller with a traditional image-based visual servoing controller.