Most existing multi-UAV collaborative search methods only consider scenarios of two-dimensional path planning or static target search. To be close to the practical scenario, this paper proposes a path planning method based on an action-mask-based multi-agent proximal policy optimization (AM-MAPPO) algorithm for multiple UAVs searching for moving targets in three-dimensional (3D) environments. In particular, a multi-UAV high–low altitude collaborative search architecture is introduced that not only takes into account the extensive detection range of high-altitude UAVs but also leverages the benefit of the superior detection quality of low-altitude UAVs. The optimization objective of the search task is to minimize the uncertainty of the search area while maximizing the number of captured moving targets. The path planning problem for moving target search in a 3D environment is formulated and addressed using the AM-MAPPO algorithm. The proposed method incorporates a state representation mechanism based on field-of-view encoding to handle dynamic changes in neural network input dimensions and develops a rule-based target capture mechanism and an action-mask-based collision avoidance mechanism to enhance the AM-MAPPO algorithm’s convergence speed. Experimental results demonstrate that the proposed algorithm significantly reduces regional uncertainty and increases the number of captured moving targets compared to other deep reinforcement learning methods. Ablation studies further indicate that the proposed action mask mechanism, target capture mechanism, and collision avoidance mechanism of the AM-MAPPO algorithm can improve the algorithm’s effectiveness, target capture capability, and UAVs’ safety, respectively.
Technology determines tactics, and tactics promote the development of technology. Artificial intelligence technology is a multiplier that accelerates the innovation and development of military theory. In this paper, we first list the different intelligence levels by introducing their corresponding applications. Then we review the technical classification based on the related concepts, Finally, we discuss technical and practical difficulties and give some solutions from the aspects of strengthening knowledge engineering, building simulation systems, and accumulating data engineering knowledge. The development of Artificial intelligence technology has a profound impact on military development trends, leading to major changes in the forms and modes of war.
Specific emitter identification (SEI) is extracting the features of the received radio signals and determining the emitter individuals that generate the signals. Although deep learning-based methods have been effectively applied for SEI, their performance declines dramatically with the smaller number of labeled training samples and in the presence of significant noise. To address this issue, we propose an improved Bootstrap Your Own Late (BYOL) self-supervised learning scheme to fully exploit the unlabeled samples, which comprises the pretext task adopting contrastive learning conception and the downstream task. We designed three optimized data augmentation methods for communication signals in the former task to serve the contrastive concept. We built two neural networks, online and target networks, which interact and learn from each other. The proposed scheme demonstrates the generality of handling the small and sufficient sample cases across a wide range from 10 to 400, being labeled in each group. The experiment also shows promising accuracy and robustness where the recognition results increase at 3-8% from 3 to 7 signal-to-noise ratio (SNR). Our scheme can accurately identify the individual emitter in a complicated electromagnetic environment.
Specific Emitter Identification (SEI) is a key research problem in the field of information countermeasures. It is one of the key technologies required to be solved urgently in the target reconnaissance system. It has the ability to distinguish between different individual radiation sources according to the varying individual characteristics of the emitter hardware within the transmitted signals. In response to the lack of scarcity among labeled samples in specific emitter identification, this paper proposes a method combining multi-domain feature fusion and integrated learning (MDFFIL). First, the received signal is preprocessed to obtain segmented time domain signal samples. Then, the signal is converted to time–frequency distribution using wavelet transform. Afterwards, an integrated learning two-stage recognition classification method is designed to extract data features of 1D time domain signals and 2D time–frequency distribution signals using the symmetry network structures of CVResNet and ResNet. Finally, fused features are fed into the complex-valued residual network classifier to obtain the final classification results. We demonstrate through the analysis results of the measured data that the proposed method has a higher accuracy as compared with the classical feature extraction method, and that this can improve the identification of communication radiation sources with fewer labeled samples.