With the rapid growth of IoT data and increasing demands for low-latency computation, UAV-assisted mobile edge computing (MEC) offers a flexible solution to overcome the limitations of fixed MEC servers. To better reflect concurrent service scenarios, this paper innovatively develops a multi-channel task modeling method, enabling UAVs to simultaneously select multiple users and offload tasks via separate channels, thereby breaking the constraints of traditional sequential assumptions. To address task conflicts and resource waste caused by sequential service assumptions, this paper proposes a hierarchical reinforcement learning-based trajectory and offloading decision-making framework (H-TAOD) for UAVs with multi-channel parallel processing. The framework decouples UAV trajectory planning and task offloading into two sub-tasks optimized via appropriate reinforcement learning methods. An invalid action masking (IAM) mechanism is introduced to avoid channel conflicts. Simulation results verify the superiority of H-TAOD in reward, delay, and convergence.
In the domain of multi-agent reinforcement learning, conventional algorithms such as VDN, QMIX, and QTRAN have exhibited favorable performance in static task scenarios. However, these algorithms encounter challenges due to their limited capacity to model elastic collaboration scenarios, wherein the number of agents and the state-action space undergo dynamic changes over time. To address this limitation, this paper proposes a novel multi-agent collaboration mechanism: the Dual-Stream Dynamic Weight Compensation Network (DDWCN). This method employs a dual-stream action modeling network for the classification and processing of actions. It integrates an information compensation network and a dynamic weight fusion network. These additions have been demonstrated to enhance the network’s robustness and generalization capabilities for complex collaborative tasks. Extensive experimentation on a variety of benchmark tasks in StarCraft II has validated the effectiveness of DDWCN. The findings indicate that this approach exhibits commendable scalability and reliability in authentic multi-agent collaboration scenarios, underscoring its extensive applicability.