13 February 2024 in IEEE Journal on Selected Areas in Communications
The integrated satellite-terrestrial network (ISTN) system has experienced significant growth, offering seamless communication services in remote areas with limited terrestrial infrastructure. However, designing a routing scheme for ISTN is exceedingly difficult, primarily due to the heightened complexity resulting from the inclusion of additional ground stations, along with the requirement to satisfy various constraints related to satellite service quality. To address these challenges, we study packet routing with ground stations and satellites working jointly to transmit packets, while prioritizing fast communication and meeting energy efficiency and packet loss requirements. Specifically, we formulate the problem of packet routing with constraints as a max-min problem using the Lagrange method. Then we propose a novel constrained Multi-Agent reinforcement learning (MARL) dynamic routing algorithm named CMADR, which efficiently balances objective improvement and constraint satisfaction during the updating of policy and Lagrange multipliers. Finally, we conduct extensive experiments and an ablation study using the OneWeb and Telesat mega-constellations. Results demonstrate that CMADR reduces the packet delay by a minimum of 21% and 15%, while meeting stringent energy consumption and packet loss rate constraints, outperforming several baseline algorithms.
28 June 2022 in IEEE Transactions on Green Communications and Networking
Recently, Low Earth Orbit (LEO) satellite-based Internet of Things (LEO-IoT) becomes attractive for computation offloading in mobile-edge computing (MEC) since it can overcome terrain obstacles, such as in depopulated villages and disaster sites. However, it is extremely hard to allocate bandwidth and power resources jointly with multiple users and satellites. In this paper, we study offloading in collaborative LEO-IoT where satellites forward data from users to the MEC server, with the goal of making offloading fast and energy efficient. To achieve this goal, we first define the data offloading in collaborative LEO-IoT as an optimization problem with resource constraints. Then we formulate the optimization problem as a Partially Observable Markov Decision Processes (POMDP), which differs from the existing Markov Decision Processes (MDP) work for the offloading scenario. We further propose a novel Multi-Agent Information Broadcasting and Judging (MAIBJ) algorithm to allocate resources in a collaborative manner. Finally, extensive experiments are conducted with various configurations and the results show that MAIBJ can shorten at least 33% of transmission latency and save at least 42% of energy consumption compared with several baseline algorithms.
1 February 2024 in IEEE Transactions on Cognitive Communications and Networking
This paper investigates the satellite communication network (SCN) to optimize the channel allocation of the fixed ground base station and the transmission power allocation of the Low Earth orbit (LEO) satellites jointly while considering the freshness of the information. We present a mathematical model for the problem and formulate it as a mixed-integer programming (MIP) problem, which is NP-hard. To tackle this challenge, we propose a two-step approach that decomposes the problem into a channel allocation problem and a power allocation problem. For the power allocation problem, we propose a convex optimization algorithm termed as Opt. For the channel allocation problem, we introduce two learning-based schemes, Ptr and DNN-Ptr. Combining these two steps together, we develop two novel algorithms, i.e., Opt-Ptr and Opt-DNN-Ptr. In particular, the Opt-Ptr algorithm devises a novel Pointer Network to obtain the channel allocation decision and then solves the remaining power allocation problem using convex optimization algorithms. To further improve the performance, the Opt-DNN-Ptr algorithm utilizes a DNN to predict a transmission power allocation, which is then combined with the channel allocation decision obtained from the pointer network to solve the remaining power allocation problem. The simulation results verify the superiority of the proposed algorithm.
11 March 2025 in IEEE Transactions on Wireless Communications
The Multi-Layer Satellite Remote Sensing (SRS) integrates data collection by Low Earth Orbit (LEO) satellites and data processing assistance from Medium Earth Orbit (MEO) satellites, thereby playing a crucial role in scientific exploration. However, effectively controlling access to LEO satellites for processing data, especially considering the frequent handovers caused by speed differences, presents a significant challenge to achieving high energy efficiency services. To address this challenge, we explore cooperative dynamic access control based on efficient communication mechanisms, with the aim of prioritizing processed data volume and meeting energy consumption requirements for satellites. Specifically, we formulate the access control issue as an optimization problem and integrate it into the framework of partially observable Markov decision process (POMDP), considering MEO satellites’ limited observation ability. By employing Multi-agent Deep Reinforcement Learning (MADRL), we propose a novel dynamic access control algorithm named DAC to solve our featured problem. Specifically, for improving performance, communication-efficient cooperation among MEOs is enhanced through modeling decision-relevant information of fellow MEO satellites and maximizing mutual information with their actual data to extract precise awareness and enable the generation of concise message. Finally, we conduct comprehensive experiments and an ablation study spanning the Starlink, OneWeb, and Telesat mega-constellations. The results demonstrate that DAC increases the average system data processing volume by at least 13.5%, while meeting energy consumption constraints and outperforming baseline algorithms.