Improving the level of autonomy during the landing phase helps promote the full-envelope autonomous flight capability of unmanned aerial vehicles (UAVs). Aiming at the identification of potential landing sites, an end-to-end state estimation method for the autonomous landing of carrier-based UAVs based on monocular vision is proposed in this paper, which allows them to discover landing sites in flight by using equipped optical sensors and avoid a crash or damage during normal and emergency landings. This scheme aims to solve two problems: the requirement of accuracy for runway detection and the requirement of precision for UAV state estimation. First, we design a robust runway detection framework on the basis of YOLOv5 (you only look once, ver. 5) with four modules: a data augmentation layer, a feature extraction layer, a feature aggregation layer and a target prediction layer. Then, the corner prediction method based on geometric features is introduced into the prediction model of the detection framework, which enables the landing field prediction to more precisely fit the runway appearance. In simulation experiments, we developed datasets applied to carrier-based UAV landing simulations based on monocular vision. In addition, our method was implemented with help of the PyTorch deep learning tool, which supports the dynamic and efficient construction of a detection network. Results showed that the proposed method achieved a higher precision and better performance on state estimation during carrier-based UAV landings.
10 May 2023 in Transactions of the Institute of Measurement and Control
In this paper, a consensus-based distributed formation control method is proposed for improving the coordinated battle efficiency of coordinated battle system for manned/unmanned aerial vehicles (MAV/UAVs). The method proposed is designed based on consensus protocol, which contains three parts. First, the distributed structure with limited centralized strategy for MAV/UAVs cooperative system is designed. Second, a second-order dynamic model is built up to describe the distributed formation system, which is further simplified using feedback linearization method. Third, the information exchange topology of MAV/UAV-coordinated battle system is established on the basis of graph theory and leader–follower mechanism. Finally, the effectiveness of the proposed formation strategy for MAV/UAVs cooperative system is proved asymptotic convergence by constructing a reasonable Lyapunov function which guarantees the accurate formation maintenance. Simulation results are presented to demonstrate the effectiveness of the proposed method. And comparative simulation results reveal that the method proposed in this paper is superior to traditional algorithms in the aspects of accuracy and stability.
Machine vision has been extensively researched in the field of unmanned aerial vehicles (UAV) recently. However, the ability of Sense and Avoid (SAA) largely limited by environmental visibility, which brings hazards to flight safety in low illumination or nighttime conditions. In order to solve this critical problem, an approach of image enhancement is proposed in this paper to improve image qualities in low illumination conditions. Considering the complementarity of visible and infrared images, a visible and infrared image fusion method based on convolutional sparse representation (CSR) is a promising solution to improve the SAA ability of UAVs. Firstly, the source image is decomposed into a texture layer and structure layer since infrared images are good at characterising structural information, and visible images have richer texture information. Both the structure and the texture layers are transformed into the sparse convolutional domain through the CSR mechanism, and then CSR coefficient mapping are fused via activity level assessment. Finally, the image is synthesised through the reconstruction results of the fusion texture and structure layers. In the experimental simulation section, a series of visible and infrared registered images including aerial targets are adopted to evaluate the proposed algorithm. Experimental results demonstrates that the proposed method increases image qualities in low illumination conditions effectively and can enhance the object details, which has better performance than traditional methods.