With the continuous proliferation of radio frequency devices, electromagnetic environments in various regions are becoming increasingly complex. Effective monitoring of the electromagnetic environment and identification of interference sources have thus become critical tasks for maintaining order in the electromagnetic spectrum. In recent years, rapid advances in UAV technology have spurred exploration of UAV-based electromagnetic spectrum monitoring as a novel approach. However, the limited payload capacity and endurance of UAVs constrain their monitoring capabilities. To address these challenges, we propose HMUDRL, a distributed heterogeneous multi-agent deep reinforcement learning algorithm. By leveraging cooperative operation between cluster-head UAVs (CH) and cluster-monitoring UAVs (CM) within a heterogeneous UAV swarm, HMUDRL enables high-precision detection and wide-area localization of UHF radiation source. Furthermore, we integrate a minimum-gap localization algorithm that exploits the spatial distribution of multiple CM to accurately pinpoint anomalous radiation sources. Simulation results validate the effectiveness of HMUDRL: in the later stages of training, the success rate of localizing target radiation sources converges to 96.1%, representing an average improvement of 1.8% over baseline algorithms; localization accuracy, measured by root mean square error (RMSE), is enhanced by approximately 87.3% compared to baselines; and communication overhead is reduced by more than 80% relative to homogeneous architectures. These results demonstrate that HMUDRL effectively addresses the challenges of data transmission control and sensing-localization performance faced by UAVs in UHF spectrum monitoring.
The proliferation of UAVs operating in complex interference environments has intensified the demand for collaborative spectrum management to mitigate interference and maximize network capacity. This paper proposes a heterogeneous graph neural network (HGNN) framework for collaborative spectrum management in hierarchical UAV communication networks. The proposed architecture consists of three layers: a Terminal Transmission and Control Layer for local spectrum monitoring, a Sub-Domain Transmission and Control Layer for regional interference localization, and a Global Control Layer for network-wide spectrum optimization. Each layer incorporates multiple sensing UAVs that communicate exclusively with their own layer’s Transmission and Control UAV (T&C UAV), which aggregates and processes data from its subordinate sensing nodes and forwards the result upward through the T&C UAV chains. A hierarchical heterogeneous graph neural network with intra-layer and inter-layer message passing mechanisms was designed to capture the complex spatial–temporal dependencies in the spectrum environment under non-uniform interference conditions. The simulation results demonstrate that the proposed HGNN framework achieves steady-state utility gains of approximately 7.1% and 1.4% over the SL-GNN in 48-node and 81-node scenarios, respectively, along with corresponding Interference Suppression Ratio (ISR) improvements of 1.5 dB and 2.9 dB against the SL-GNN.