In disaster scenarios, unmanned aerial vehicles (UAVs) can serve as mobile base stations because of their maneuverability and synergy. However, due to constrained UAV communication capabilities and limited battery life, UAV base stations resource allocation for mobile sensors in a data-heterogeneous environment is a significant challenge when optimizing communication quality. To address this, we propose AGUZero, an attention-based graph reinforcement learning (RL) framework. Inspired by MuZero [27], AGUZero is designed to handle dynamic and uncontrollable environments based on Monte Carlo Tree Search (MCTS). Additionally, to tackle data heterogeneity, AGUZero represents the states using heterogeneous sub-graphs and employs an attention-based model to capture relationships among UAVs and sensors. The experimental results show that AGUZero outperforms other baseline models consistently when either the number of UAVs or the number of sensors is varying. AGUZero improves the data transmission ratio by 11.03% and 10.35% in the two cases respectively.
Utilizing unmanned aerial vehicles (UAVs) as mobile access points can assist urban communication systems in establishing emergency networks in disaster scenarios. However, in large-scale dynamic environments, the extensive exploration space makes effective collaboration among a large number of UAVs challenging. In this paper, to schedule the deployment of UAVs for networking purposes, we propose a novel approach, MAEN, using multi-agent reinforcement learning. The grouping and information sharing mechanisms in MAEN enable the algorithm to easily scale up the number of UAVs to dozens and address the issue of strategy equilibrium. Additionally, a reward decomposition module is designed to handle coordination and task allocation among UAVs. Experimental results demonstrate that the algorithm outperforms existing algorithms in terms of ground device coverage and communication quality.
The rapid advancement of unmanned aerial vehicle (UAV) swarm systems has enabled their deployment in large-scale applications such as disaster response, environmental monitoring, logistics, and communication networks. In these scenarios, effective scheduling and coordination of UAV swarms are critical for mission success, particularly under complex spatiotemporal constraints. This article provides a comprehensive survey of scheduling and planning algorithms for large-scale UAV swarm coordination under spatiotemporal constraints. The unique challenges posed by these constraints are analyzed, and state-of-the-art algorithms, including sampling-based, graph-based, mathematical optimization-based, and learning-based methods, are systematically evaluated. In addition, two representative application domains, sensing and communication, are investigated to demonstrate how spatiotemporal constraints shape algorithm design and performance. Furthermore, this article also explores the key challenges faced by UAV swarms and proposes corresponding future research directions, which are crucial for advancing the development of this field. This survey aims to serve as a foundational reference for researchers and practitioners developing scalable coordination and planning solutions for UAV swarms.