In recent years, onboard self-localization (OSL) methods based on cameras or lidar have achieved many significant progresses. However, some issues such as estimation drift and robustness in low-texture environment still remain inherent challenges for OSL methods. On the other hand, infrastructure-based methods can generally overcome these issues, but at the expense of some installation cost. This poses an interesting problem of how to effectively combine these methods, so as to achieve localization with long-term consistency as well as flexibility compared to any single method. To this end, we propose a comprehensive optimization-based estimator for the 15-D state of an unmanned aerial vehicle (UAV), fusing data from an extensive set of sensors: inertial measurement unit (IMU), ultrawideband (UWB) ranging sensors, and multiple onboard visual-inertial and lidar odometry subsystems. In essence, a sliding window is used to formulate a sequence of robot poses, where relative rotational and translational constraints between these poses are observed in the IMU preintegration and OSL observations, while orientation and position are coupled in the body-offset UWB range observations. An optimization-based approach is developed to estimate the trajectory of the robot in this sliding window. We evaluate the performance of the proposed scheme in multiple scenarios, including experiments on public datasets, high-fidelity graphical-physical simulation, and field-collected data from UAV flight tests. The result demonstrates that our integrated localization method can effectively resolve the drift issue, while incurring minimal installation requirements.
14 May 2021 in IEEE Robotics and Automation Letters
In this letter we investigate a tightly coupled Lidar-Inertia Odometry and Mapping (LIOM) scheme, with the capability to incorporate multiple lidars with complementary field of view (FOV). In essence, we devise a time-synchronized scheme to combine extracted features from separate lidars into a single pointcloud, which is then used to construct a local map and compute the feature-map matching (FMM) coefficients. These coefficients, along with the IMU preinteration observations, are then used to construct a factor graph that will be optimized to produce an estimate of the sliding window trajectory. We also propose a key frame-based map management strategy to marginalize certain poses and pointclouds in the sliding window to grow a global map, which is used to assemble the local map in the later stage. The use of multiple lidars with complementary FOV and the global map ensures that our estimate has low drift and can sustain good localization in situations where single lidar use gives poor result, or even fails to work. Multi-thread computation implementations are also adopted to fractionally cut down the computation time and ensure real-time performance. We demonstrate the efficacy of our system via a series of experiments on public datasets collected from an aerial vehicle.
19 February 2024 in IEEE Robotics and Automation Letters
Simultaneous Localization and Mapping (SLAM) plays an important role in robot autonomy. Reliability and efficiency are the two most valued features for applying SLAM in robot applications. In this letter, we consider achieving a reliable LiDAR-based SLAM function in computation-limited platforms, such as quadrotor UAVs based on graph-based point cloud association. First, contrary to most works selecting salient features for point cloud registration, we propose a non-conspicuous feature selection strategy for reliability and robustness purposes. Then a two-stage correspondence selection method is used to register the point cloud, which includes a KD-tree-based coarse matching followed by a graph-based matching method that uses geometric consistency to vote out incorrect correspondences. Additionally, we propose an odometry approach where the weight optimizations are guided by vote results from the aforementioned geometric consistency graph. In this way, the optimization of LiDAR odometry rapidly converges and evaluates a fairly accurate transformation resulting in the back-end module efficiently finishing the mapping task. Finally, we evaluate our proposed framework on different datasets and real-world environments. Experiments show that our SLAM system achieves a comparative level or higher level of accuracy with more balanced computation efficiency compared with the mainstream LiDAR-based SLAM solutions.
15 August 2023 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
In this article, we focus on enabling the autonomous perception and control of a small unmanned aerial vehicle (UAV) for a façade inspection task. Specifically, we consider the perception as a planar object pose estimation problem by simplifying the building structure as a concatenation of planes, and the control as an optimal reference tracking control problem. First, a vision-based adaptive observer is proposed for plane pose estimation which converges fast and is insensitive to noise under very mild observation conditions. Second, a model predictive controller (MPC) is designed to achieve stable plane following and smooth transition in a multiple-plane scenario, while the persistent excitation (PE) condition of the observer and the maneuver constraints of the UAV are satisfied. The stability of the observer and the MPC controller is also investigated to ensure theoretical completeness. The proposed autonomous plane pose estimation and plane tracking methods are tested in both simulation and practical building façade inspection scenarios, which demonstrate their effectiveness and practicability.
8 June 2022 in IEEE Transactions on Circuits and Systems I: Regular Papers
The vulnerabilities of multi-agent-system (MAS) become a critical issue for cybersecurity. The article investigates the formation control problem for MASs under multi-channel denial-of-service (DoS) attacks. In this article, the attacks on each channel are independent, while most of the existing results show that DoS attacks are the same on all channels. Without loss of generality, we consider multi-channel DoS attacks are imposed on a leader-follower MAS. Firstly, we propose a distributed formation control protocol to achieve the desired formation in the presence of DoS attacks. A translation-adaptive method is considered to adjust the interaction weights among neighboring agents online. Furthermore, a performance guarantee is derived based on the state information, and hereafter state errors among all agents can be regulated. Moreover, we derive the sufficient conditions for system stability w.r.t the controller gain and the allowable attack duration in the form of linear matrix inequalities (LMIs). Finally, simulation results are given to illustrate the effectiveness of the proposed method.
13 January 2022 in IEEE Transactions on Aerospace and Electronic Systems
The article proposes a visual-inertial navigation method to support the autonomous operation of a quadrotor UAV during the building façade inspection tasks, where state-of-the-art vision-based localization methods may fail due to texture point feature insufficiency. Considering the appearance characteristics of the building façades, we additionally fuse line features and their corresponding structure prior information to the sliding-window-based estimator to improve localization reliability and accuracy. The contribution of the proposed method lies mainly in two aspects. First, we develop an informative feature selection mechanism according to the façade patterns and the inspection trajectory patterns to make a balance between localization accuracy and computation overheads. Second, we further utilize structure prior information, which is defined as line-to-line and point-to-line relationships, as another source of high-fidelity measurement to restrain the localization drifts. The proposed method is tested not only on public datasets, but also on an actual flight data package recorded in a building inspection task. Experimental results show that the proposed method can serve as a practical tool for navigating a robot in a building inspection task, with improved localization reliability and accuracy.