6 February 2023 in IEEE Transactions on Robotics
Although the use of multiple unmanned aerial vehicles (UAVs) has great potential for fast autonomous exploration, it has received far too little attention. In this article, we present a RApid Collaborative ExploRation (RACER) approach using a fleet of decentralized UAVs. To effectively dispatch the UAVs, a pairwise interaction based on an online hgrid space decomposition is used. It ensures that all UAVs simultaneously explore distinct regions, using only asynchronous and limited communication. Furthermore, we optimize the coverage paths of unknown space and balance the workloads partitioned to each UAV with a capacitated vehicle routing problem formulation. Given the task allocation, each UAV constantly updates the coverage path and incrementally extracts crucial information to support the exploration planning. A hierarchical planner finds exploration paths, refines local viewpoints, and generates minimum-time trajectories in sequence to explore the unknown space agilely and safely. The proposed approach is evaluated extensively, showing high exploration efficiency, scalability, and robustness to limited communication. Furthermore, for the first time, we achieve fully decentralized collaborative exploration with multiple UAVs in the real world. We will release our implementation as an open-source package.
1 July 2022 in IEEE Transactions on Robotics
Decentralized state estimation is one of the most fundamental components of autonomous aerial swarm systems in GPS-denied areas; yet, it remains a highly challenging research topic. Omni-swarm, a decentralized omnidirectional visual–inertial–ultrawideband (UWB) state estimation system for aerial swarms, is proposed in this article to address this research niche. To solve the issues of observability, complicated initialization, insufficient accuracy, and lack of global consistency, we introduce an omnidirectional perception front end in Omni-swarm. It consists of stereo wide-field-of-view cameras and UWB sensors, visual–inertial odometry, multidrone map-based localization, and visual drone tracking algorithms. The measurements from the front end are fused with graph-based optimization in the back end. The proposed method achieves centimeter-level relative state estimation accuracy while guaranteeing global consistency in the aerial swarm, as evidenced by the experimental results. Moreover, supported by Omni-swarm, interdrone collision avoidance can be accomplished without any external devices, demonstrating the potential of Omni-swarm as the foundation of autonomous aerial swarms.
2 July 2024 in IEEE Transactions on Robotics
Collaborative simultaneous localization and mapping (CSLAM) is essential for autonomous aerial swarms, laying the foundation for downstream algorithms such as planning and control. To address existing CSLAM systems' limitations in relative localization accuracy, crucial for close-range UAV collaboration, this paper introduces $D^{2}$ SLAM'a novel decentralized and distributed CSLAM system. $D^{2}$ SLAM innovatively manages near-field estimation for precise relative state estimation in proximity and far-field estimation for consistent global trajectories. Its adaptable front-end supports both stereo and omnidirectional cameras, catering to various operational needs and overcoming field-of-view challenges in aerial swarms. Experiments demonstrate $D^{2}$ SLAM's effectiveness in accurate ego-motion estimation, relative localization, and global consistency. Enhanced by distributed optimization algorithms, $D^{2}$ SLAM exhibits remarkable scalability and resilience to network delays, making it well-suited for a wide range of real-world aerial swarm applications. The adaptability and proven performance of $D^{2}$ SLAM represent a significant advancement in autonomous aerial swarm technology.
24 February 2022 in IEEE Robotics and Automation Letters
Nowadays, multirotors are playing important roles in abundant types of missions. During these missions, entering confined and narrow tunnels that are barely accessible to humans is desirable yet extremely challenging for multirotors. The restricted space and significant ego airflow disturbances induce control issues at both fast and slow flight speeds, meanwhile bringing about problems in state estimation and perception. Thus, a smooth trajectory at the proper speed is necessary for safe tunnel flights. To address these challenges, in this letter, a complete autonomous aerial system that can achieve smooth flights through tunnels with dimensions as narrow as to 0.6 m is presented. The system contains a motion planner that generates smooth mini-jerk trajectories along the tunnel center lines, which are extracted according to the map and Euclidean distance field (EDF), and its practical speed range is obtained through computational fluid dynamics (CFD) and flight data analyses. Extensive flight experiments on the quadrotor are conducted inside multiple narrow tunnels to validate the planning framework as well as the robustness of the whole system.
6 March 2025 in IEEE Transactions on Robotics
Multirotors are usually desired to enter confined narrow tunnels that are barely accessible to humans in various applications including inspection, search and rescue, and so on. This task is extremely challenging since the lack of geometric features and illuminations, together with the limited field of view, cause problems in perception; the restricted space and significant ego airflow disturbances induce control issues. This paper introduces an autonomous aerial system designed for navigation through tunnels as narrow as 0.5 m in diameter. The real-time and online system includes a virtual omni-directional perception module tailored for the mission and a novel motion planner that incorporates perception and ego airflow disturbance factors modeled using camera projections and computational fluid dynamics analyses, respectively. Extensive flight experiments on a custom-designed quadrotor are conducted in multiple realistic narrow tunnels to validate the superior performance of the system, even over human pilots, proving its potential for real applications. Additionally, a deployment pipeline on other multirotor platforms is outlined and open-source packages are provided for future developments.
26 August 2025 in IEEE Sensors Journal
Multi-Object Tracking (MOT) aims to detect and uniquely identify objects within a video sequence. Traditional methods often focus on processing data between consecutive frames or primarily rely on motion cues to represent object states. However, these approaches often overlook the influence of historical data on the association process. To address this gap, this paper introduces a Topological Chronology Graph Model (TCGM) designed to bridge the historical and current states of objects. The TCGM consists of two main components: the Topological Chronology Graph Builder (TCGB) and the Spatio-Temporal Feature Integrator (STFI). TCGB encodes historical trajectory data and establishes associative links with newly detected objects to model spatio-temporal topological relationships. Meanwhile, the STFI integrates current and historical data through a spatio-temporal transformer to comprehensively represent the state of each object. Our algorithm has been rigorously evaluated on the MOT17, MOT20, DanceTrack and KITTI benchmarks, achieving competitive results.