4 October 2024 in IEEE Transactions on Instrumentation and Measurement
Real-time acquisition of airport scene information is crucial for airport safety and optimization of airport utilization efficiency. However, detecting airport objects is still a challenging task due to the small size of person and vehicle targets in the airport scene images, insufficient public airport data, and so on, which makes it difficult to achieve high accuracy and real-time detection method in the airport scene simultaneously. This article proposes a novel airport object detection approach to address the challenge by integrating the advantages of improved YOLO, Swin Transformer, and attention mechanism (AD-YOLO). Specifically, we introduce the Swin Transformer, which retains the Transformer ability of global attention to obtain features and reduces the drawbacks of computational complexity, into the head net work based on YOLOv7 to improve the high-dimensional information feature fusion. We also design an effective channel spatial attention module (ECSA) and introduce a small object detection layer (SODL) to improve the detection accuracy of small targets in the airport scene. We test the proposed method on the self-constructed multiple airport surveillance dataset (MASD) containing 5736 images captured by actual airport and online airport video. The experimental results show that AD-YOLO achieves 71.6% mAP , exceeding the mAP of the baseline method by 4.4%. The proposed method has 101.4 FPS on the NVIDIA RTX3080 GPU and 17.8 FPS on the Jetson Orin NX, meeting the real-time and accuracy requirements of the airport scene. Finally, the experimental results on the public airport surface surveillance dataset (ASS) show that AD-YOLO outperform other detection methods, demonstrating the effectiveness.