Shiyang Zhou

Shiyang Zhou

Auto-generated profile, based on publicly available information

Shiyang Zhou

National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China (UESTC), Chengdu, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 July 2022 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
SZShiyang Zhou
Shiyang Zhou
YCYufan Cheng
Yufan Cheng
XLXia Lei
Xia Lei
QPQihang Peng
Qihang Peng
JWJun Wang
Jun Wang
SLShaoqian Li
Shaoqian Li
As an aerial base station, unmanned aerial vehicle (UAV) has been considered as a promising technology to assist future wireless communications due to its flexible, swift and low cost features, where resource allocation is the basis for ensuring energy-efficient UAV-assisted networks. This paper formulates a joint optimization problem of user association, UAV trajectory design and power control to maximize the channel capacity among all ground users at a limited power level in a downlink transmission. To tackle the mixed-integer non-linear programming problem, this paper proposes a clustering-aided reinforcement learning approach consisting of three consecutive stages. Firstly, modified expectation-maximization unsupervised learning algorithm is investigated to cluster the ground users, which reduces the dimensions and hence, the association complexity is reduced as well. Then, Kuhn-Munkres algorithm is incorporated for user association, which associates a UAV with the ground users via matching to the cluster, and assigns the UAVs to the centroid of the matching cluster for pre-placement, with the aim of speeding up the convergence of the following deep reinforcement learning algorithm. Finally, a multi-agent twin delayed deep deterministic (MATD3) policy gradient is proposed to solve the non-convex sub-problem, which determines the transmit power and designs the fine-tuned trajectory of UAVs. By incorporating low-bias value estimation technique, the reward of the proposed MATD3 algorithm is improved compared with existing multi-agent reinforcement learning algorithms. Simulation results have demonstrated that our proposed approach achieves higher reward as well as converging faster than existing reinforcement algorithms. Besides, the clustering-aided reinforcement learning has lower computational complexity than the benchmark schemes.

23 October 2020 in IEEE Access
Verified
Journal Article
Open access
SZShiyang Zhou
Shiyang Zhou
YCYufan Cheng
Yufan Cheng
XLXia Lei
Xia Lei
HDHuanhuan Duan
Huanhuan Duan
Reinforcement learning is a technique for power control in wireless communications. However, most research has focused on the deep Q-network (DQN) scheme, which outputs the Q-value for each discrete action, and does not match the continuous power control problem. Hence, this paper provides a deep deterministic policy gradient (DDPG) scheme for power control. A power selection policy designated an actor is approximated by a convolutional neural network (CNN), and an evaluation of a policy designated a critic is approximated by a fully connected network. These deep neural networks enable fast decision-making for large-scale power control problems. Moreover, to speed up the training process, this paper proposes a prioritized sampling technique, which samples the experiences that need to be learned with a higher probability. This paper simulates the proposed algorithm in a multiple sweep interference (MSI) scenario. The simulation results show that the DDPG scheme is more likely to achieve optimal policy than the DQN scheme. In addition, the DDPG scheme with prioritized sampling (DDPG-PS) converges faster than the DDPG scheme with uniform sampling.

18 October 2025 in Signal Processing
Verified
Journal Article
Closed access
SZShiyang Zhou
Shiyang Zhou
XNXianhua Niu
Xianhua Niu
SLShujun Lu
Shujun Lu
YXYidong Xiang
Yidong Xiang
CPChao Pu
Chao Pu

31 October 2026 in Computer Networks
Verified
Journal Article
Closed access
SPSiming Pang
Siming Pang
XNXianhua Niu
Xianhua Niu
SZShiyang Zhou
Shiyang Zhou
BYBoran Yang
Boran Yang
HLHouwen Liu
Houwen Liu
JZJianhong Zhao
Jianhong Zhao