The detection and classification of engine-based moving objects in restricted scenes from acoustic signals allow better Unmanned Aerial System (UAS)-specific intelligent systems and audio-based surveillance systems. Recurrent Neural Networks (RNNs) provide wide coverage in the field of acoustic analysis due to their effectiveness in widespread practical applications. In this work, we propose to study SimpleRNN, LSTM, BiLSTM, and GRU recurrent network models for real-time UAV sound recognition systems based on Mel-spectrogram using Kapre layers. The main goal of the work is to study the types of RNN networks in a practical sense for a reliable drone sound recognition system. According to the results of an experimental study, the GRU (Gated Recurrent Units) network model demonstrated a higher prediction ability than other RNN architectures for detecting differences and the state of objects from acoustic signals. That is, RNNs gave higher recognition than CNNs for loaded and unloaded audio states of various UAV models, while the GRU model showed about 98% accuracy for determining the UAV load states and 99% accuracy for background noise, which consisted of more other data.
As unmanned aerial vehicles (UAVs) are increasingly employed across various industries, the demand for robust and accurate detection has become crucial. Light detection and ranging (LiDAR) has developed as a vital sensor technology due to its ability to provide rich 3D spatial information, particularly in applications such as security and airspace monitoring. This review systematically explores recent innovations in LiDAR-based drone detection, deeply focusing on the principles and components of LiDAR sensors, their classifications based on different parameters and scanning mechanisms, and the approaches for processing LiDAR data. The review briefly compares recent research works in LiDAR-based only and its fusion with other sensor modalities, the real-world applications of LiDAR with deep learning, as well as the major challenges in sensor fusion-based UAV detection.
Nowadays Unmanned Aerial Vehicles (UAVs) pose an increasing threat to public areas such as parks, schools, hospitals and official buildings. Different methods of dealing with UAV detection are developing more and more actively. This paper primarily focuses on two key aims: the first aim is to perform a multi-label classification system and the second aim is to develop Stacked Bidirectional Long Short-Term Memory (LSTM) with two hidden layers to categorize multiple UAVs sounds. Frame-wise spectral-domain features are applied as inputs of the proposed system. Overall, the results of the study show that the sound of UAVs can be classified into multiple labels. This study has been one of the first attempts to thoroughly examine Stacked Bidirectional LSTM for UAV sound classification task.
Recently the detection of drones using acoustic data has attracted the interest of researchers, because it is less expensive than other traditional methods. By using acoustic signature we can perform binary classification of UAVs, moreover we can identify if the drone has a load or not. Detection of UAVs with an additional load in the restricted and crowded areas is considered as an effective protection system. This paper considers Multiple label UAV sound classification task using LSTM-CNN architecture. The proposed architecture is composed of Stacked Bidirectional LSTM and CNN, which were learned on representations of the short-term power spectrum of UAV sounds (MFCCs). The results of our experiment show higher accuracy by using a combination of Stacked BiLSTM and CNN rather than using these architectures separately.
As UAVs are increasingly employed across various industries, the demand for robust and accurate detection has become crucial. LiDAR has developed as a vital sensor technology because to its ability to offer rich 3D spatial information, particularly in applications such as security and airspace monitoring. This review systematically explores recent innovations in LiDAR-based drone detection, deeply focusing on the principle and components of LiDAR sensor, its classifications based on different parameters and scanning mechanisms, as well as the approaches for processing LiDAR data. The review briefly compares several deep learning approaches, including point-based, voxel-based, and hybrid models, that have improved drone detection, tracking, and classification. We also explore the integration of multi-modal sensor fusion, which combines LiDAR data with other complimentary modalities to improve UAV detection and tracking in complex environments such as GNSS-denied zones.
30 September 2024 in Scientific Journal of Astana IT University
In recent years, the potential risks posed by easily moving objects have highlighted the need for intelligent surveillance systems in protected areas, primarily to ensure the safety of human lives. Among the most common of these objects are unmanned aerial vehicles (UAVs). Recent advances in deep learning techniques for recognizing audio signals have made these techniques effective in identifying moving or aerial objects, especially those powered by engines. And the growing deployment of UAVs has made their rapid recognition in various suspicious or unauthorized circumstances critical. Detecting suspicious drone flights, especially in restricted areas, remains a significant research challenge. It is vital to perform the task of determining their distance in order to quickly detect drones approaching people in such protected areas. Therefore, this paper aims to study the research question of recognizing UAV audio data from different distances. That is, recognizing drone audio at different distances was experimentally studied using Simple RNN, LSTM and GRU based deep learning models. The main objective of this study is based on finding one of the capable types of recurrent network for the task of recognizing UAV audio data at different distances. During the experimental study, the recognition abilities of Single-layer Simple RNN, LSTM and GRU recurrent network types were studied from two basic directions: with recognition accuracy curves and classification reports. As a result, LSTM and GRU based models showed high recognition ability for these types of audio signals. It was noted that UAVs can reliably predict distances greater than 10 meters based on the proposed deep learning architecture.