Vehicle object detection in aerial scenes has important applications in both military and civilian fields. Recently, deep learning has shown clear advantages in object detection, and the detection performance has been continuously improved. However, these deep object detection algorithms rely on anchor-based approaches accompanied by complex convolutional operations. In this paper, we establish a lightweight aerial vehicle object detection algorithm based on the method of anchor-free. The anchor-free based object detection method effectively gets rid of the limitation of detection model capability by the size of fixed anchor box, which reduces the set of parameters and provides a more flexible solution space. In addition, the proposed lightweight object feature extraction network effectively reduces the computational cost of the model, while improving the feature extraction capability of small objects. Besides, we use channel stacking to improve the object feature extraction capability of the lightweight network, and introduce the attention mechanism in the detection model to improve the efficiency of resource utilization. We evaluate the proposed detection algorithm on both the public aerial dataset and our collected aerial dataset, and the results show that our algorithm has significant advantages over other detection algorithms in detection accuracy and efficiency. The proposed detection algorithm achieves 89.1% and 92.6% mAP on the Munich dataset and the created dataset, and the detection time for each image is 1.21s and 0.036s, respectively.
3 December 2021 in IEEE Transactions on Instrumentation and Measurement
Even though the deep neural networks have strong feature representation capability and high recognition accuracy in finger vein recognition, the deep models are computationally intensive and poor in timeliness. To address these issues, this article proposes a lightweight algorithm for finger vein image recognition and matching. The proposed algorithm uses a lightweight convolutional model in the backbone network and employs a triplet loss function to train the model, which not only improves the matching accuracy, but also satisfies the real-time matching requirements. In addition, the Mini-region of interest (RoI) and finger vein pattern feature extraction also effectively solve the problems of large amounts of calculation and background noise. Moreover, the present model recognizes new categories based on the feature vector space constructed by the finger vein recognition system, so that new categories can be recognized without retraining the model. The results show that the finger vein recognition and matching algorithm proposed in this article achieves 99.3% and 99.6% in recognition accuracy and 14.2 and 16.5 ms in matching time for the dataset Shandong University Machine Learning and Applications Laboratory-Homologous Multimodal Biometric Traits (SDUMLA-HMT) and Peking University Finger Vein Dataset (PKU-FVD), respectively. These metrics show that our approach is time-saving and more effective than previous algorithms. Compared with the state-of-the-art finger vein recognition algorithm, the proposed algorithm improves 1.45% in recognition accuracy while saving 45.7% in recognition time.
The ancient mural paintings unearthed in China are precious world cultural heritages, which record the historical information of various eras and serve as valuable image materials for studying ancient Chinese society. The elements of the murals include figures, carriages, flowers, birds, and auspicious clouds. The digital research on these elements can better help us understand history and culture. In this paper, we have established a large-scale target detection dataset for mural elements excavated from ancient China, featuring a rich variety of labeled sample categories that span across different historical periods and regions, which provides significant value for the study of ancient Chinese history. Meanwhile, to address the defects present in the mural paintings, we have developed an adaptive random erasing augmentation algorithm, which forces the model to learn more comprehensive feature information, enabling it to adapt to the defective scenarios of the mural paintings. Moreover, we have created a target semantic feature extraction model for elements of ancient Chinese murals, which utilizes contextual information and residual attention mechanism to capture the semantic information, thereby enhancing the accuracy of element target detection. Finally, we have conducted a comparative analysis of the detection results of our proposed method with several other state-of-the-art target detection algorithms on the created mural dataset, and the visualization results validated the superiority of our proposed method.
19 December 2025 in IEEE Transactions on Intelligent Transportation Systems
The detection of traffic objects in aerial scenes holds significant application potential in both military and civilian sectors. However, current aerial traffic object detection techniques based on computer vision face challenges including limited awareness of object direction, a heavy computational burden on the feature extraction backbone network, and inadequate capacity to learn crucial semantic information. In this paper, our focus is on investigating the mechanisms for predicting the directional perception of traffic objects in aerial scenes, achieving backbone network lightness, and exploring methods for extracting key semantic information from objects. Firstly, to tackle the challenge of poor perception of traffic object direction and angle in aerial scenes, we utilize techniques like equivariant vector field convolution, multi-task anchor-free prediction, and adaptive loss to develop a precise mechanism for recognizing and predicting object directions. Secondly, given the presence of small-sized and numerous objects in aerial scenes, we propose the adoption of a lightweight backbone network employing channel stacking to decrease the model’s computational burden. Additionally, we establish a theoretical framework and methodology for optimizing and compressing this backbone network, aimed at enhancing feature extraction and propagation for aerial traffic objects. Furthermore, to address the issue of inadequate learning of key semantic information features, we incorporate saliency attention and multi-scale contextual information to capture the essential semantic characteristics of the objects. We also establish a method for extracting semantic features specifically for aerial traffic objects. The approach presented in this paper broadens the applicability of aerial object detection algorithms and offers novel methodologies and theoretical foundations for object detection in intricate scenarios.
1 January 2024 in IEEE Transactions on Instrumentation and Measurement
Instruments detect and respond to various parameters, playing a crucial role in civil and industrial applications. However, the current instrument recognition algorithm still suffers from low detection accuracy, a large amount of model calculation, and a low degree of automatic recognition. In this article, we propose an efficient real-time automatic instrument indication acquisition algorithm based on a lightweight deep convolutional neural network and hybrid attention fine-grained features. In this algorithm, we divide instrument identification into three subtasks, which are instrument object detection, instrument fine-grained recognition, and instrument indication acquisition. In the instrument object detection task, we propose a lightweight instrument detection algorithm, which uses a lightweight feature extraction backbone network and a single-scale object detection algorithm to reduce the computational load. In the instrument fine-grained recognition task, this article proposes a fine-grained classification network based on attention hybrid clipping, which can effectively recognize the instrument fine-grained category and range features. In the instrument indication acquisition task, the edge detection and polar coordinate change are used to realize an automated instrument identification and reading system, which can meet the needs of high-precision real-time monitoring of the instrument indication in various complex scenarios. In addition, we have created and made publicly available an instrument image dataset that contains 3457 images of various types of instruments in actual scenes. The recognition accuracy of the instrument reading recognition algorithm proposed in this article is 92.9% on the created dataset, and the average recognition time per image is 348 ms on the i7-8700 CPU.
21 February 2022 in IEEE Geoscience and Remote Sensing Letters
Vehicle detection in aerial photography scenarios has a wide range of promising applications in the military and civilian fields. Recently, object detection algorithms based on depth models have shown superior performance in aerial vehicle detection tasks. However, these detection algorithms are often accompanied by a large amount of computation and resource consumption, which leads to the inability to perform real-time detection. In addition, the insufficient feature extraction capability of the vehicle and the complex background information also lead to low detection accuracy. In this letter, we propose a lightweight backbone network with a context information module and an attention mechanism module for vehicle detection in the aerial image, which enables the feature extraction network to increase the utilization of contextual information and salient regions. In addition, we use adaptive anchor-free in the detection model to predict the bounding box. The proposed detection algorithm achieves 89.7% and 94.1% mean average precision (mAP) on the German Aerospace Center (DLR)-3K dataset and the created dataset, and the detection time for each image is 1.66 and 0.049 s, respectively.