Ruikang Zhong

Ruikang Zhong

Auto-generated profile, based on publicly available information

Ruikang Zhong

School of Information and Communication Engineering, Xian Jiaotong University, Xian, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 August 2021 in IEEE Transactions on Wireless Communications
Verified
Journal Article
Closed access
RZRuikang Zhong
Ruikang Zhong
XLXiao Liu
Xiao Liu
YLYuanwei Liu
Yuanwei Liu
YCYue Chen
Yue Chen
A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs), while non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spectrum efficiency of the wireless network. The optimization problem of joint three-dimensional (3D) trajectory design and power allocation is formulated for maximizing the throughput. Since ground mobile users are considered as roaming continuously, the UAVs need to be re-deployed timely based on the movement of users. In an effort to solve this pertinent dynamic problem, a K-means based clustering algorithm is first adopted for periodically partitioning users. Afterward, a mutual deep Q-network (MDQN) algorithm is proposed to jointly determine the optimal 3D trajectory and power allocation of UAVs. In contrast to the conventional deep Q-network (DQN) algorithm, the MDQN algorithm enables the experience of multi-agent to be input into a shared neural network to shorten the training time with the assistance of state abstraction. Numerical results demonstrate that: 1) the proposed MDQN algorithm is capable of converging under minor constraints and has a faster convergence rate than the conventional DQN algorithm in the multi-agent case; 2) The achievable sum rate of the NOMA enhanced UAV network is 23% superior to the case of orthogonal multiple access (OMA); 3) By designing the optimal 3D trajectory of UAVs with the MDON algorithm, the sum rate of the network enjoys 142% and 56% gains than invoking the circular trajectory and the 2D trajectory, respectively.

25 November 2021 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
RZRuikang Zhong
Ruikang Zhong
YLYuanwei Liu
Yuanwei Liu
XMXidong Mu
Xidong Mu
YCYue Chen
Yue Chen
LSLingyang Song
Lingyang Song
A reconfigurable intelligent surface (RIS)-assisted multi-user downlink communication system over fading channels is investigated, where both non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA) schemes are employed. In particular, the time overhead for configuring the RIS reflective elements at the beginning of each fading channel is considered. The optimization goal is maximizing the effective throughput of the entire transmission period by jointly optimizing the phase shift of the RIS and the power allocation of the AP for each channel block. In an effort to solve the formulated problem and fill the research vacancy of the performance comparison between different machine learning tools in wireless networks, a deep learning (DL) approach and a reinforcement learning (RL) approach are proposed and their representative superiority and inferiority are investigated. The DL approach can locate the optimal phase shifts with the deep neural network fitting as well as the corresponding power allocation for each user. From the perspective of long-term reward, the phase shift control with configuration overhead can be regarded as a Markov decision process and the RL algorithm is proficient in solving such problems with the assistance of the Bellman equation. The numerical results indicate that: 1) From the perspective of the wireless network, NOMA can achieve a throughput gain of about 42% compared with OMA; 2) The well-trained RL and DL agents are able to achieve the same performance in Rician channel, while RL is superior in the Rayleigh channel; 3) The DL approach has lower complexity and faster convergence, while the RL approach has preferable strategy flexibility.

25 July 2022 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
RZRuikang Zhong
Ruikang Zhong
YLYuanwei Liu
Yuanwei Liu
XMXidong Mu
Xidong Mu
YCYue Chen
Yue Chen
Xianbin WangXianbin Wang
Xianbin Wang
LHLajos Hanzo
Lajos Hanzo
A simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assisted multi-user downlink multiple-input single-output (MISO) communication system is investigated. In contrast to the existing ideal STAR-RIS model assuming an independent transmission and reflection phase-shift control, a practical coupled phase-shift model is considered. Then, a joint active and passive beamforming optimization problem is formulated for minimizing the long-term transmission power consumption, subject to the coupled phase-shift constraint and the minimum data rate constraint. Despite the coupled nature of the phase-shift model, the formulated problem is solved by invoking a hybrid continuous and discrete phase-shift control policy. Inspired by this observation, a pair of hybrid reinforcement learning (RL) algorithms, namely the hybrid deep deterministic policy gradient (hybrid DDPG) algorithm and the joint DDPG & deep-Q network (DDPG-DQN) based algorithm are proposed. The hybrid DDPG algorithm controls the associated high-dimensional continuous and discrete actions by relying on the hybrid action mapping. By contrast, the joint DDPG-DQN algorithm constructs two Markov decision processes (MDPs) relying on an inner and an outer environment, thereby amalgamating the two agents to accomplish a joint hybrid control. Simulation results demonstrate that the STAR-RIS has superiority over other conventional RISs in terms of its energy consumption. Furthermore, both the proposed algorithms outperform the baseline DDPG algorithm, and the joint DDPG-DQN algorithm achieves a superior performance, albeit at an increased computational complexity.

16 June 2022 in IEEE Transactions on Wireless Communications
Verified
Journal Article
Closed access
RZRuikang Zhong
Ruikang Zhong
XLXiao Liu
Xiao Liu
YLYuanwei Liu
Yuanwei Liu
YCYue Chen
Yue Chen
ZHZhu Han
Zhu Han
A novel framework of reconfigurable intelligent surfaces (RISs)-enhanced indoor wireless networks is proposed, where an RIS mounted on the robot is invoked to enable mobility of the RIS and enhance the service quality for mobile users. Meanwhile, non-orthogonal multiple access (NOMA) techniques are adopted to further increase the spectrum efficiency since RISs are capable of providing NOMA with artificial controlled channel conditions, which can be seen as a beneficial operation condition to obtain NOMA gains. To optimize the sum rate of all users, a deep deterministic policy gradient (DDPG) algorithm is invoked to optimize the deployment and phase shifts of the mobile RIS as well as the power allocation policy. In order to improve the efficiency and effectiveness of agent training for the DDPG agents, a federated learning (FL) concept is adopted to enable multiple agents to simultaneously explore similar environments and exchange experiences. We also proved that with the same random exploring policy, the FL armed deep reinforcement learning (DRL) agents can theoretically obtain a reward gain comparing to the independent agents. Our simulation results indicate that the mobile RIS scheme can significantly outperform the fixed RIS paradigm, which provides about three times data rate gain compared to the fixed RIS paradigm. Moreover, the NOMA scheme is capable of achieving a gain of 42% in contrast with the OMA scheme in terms of the sum rate. Finally, the multi-cell simulation proved that the FL enhanced DDPG algorithm has a superior convergence rate and optimization performance than the independent training framework.

3 September 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
QGQian Gao
Qian Gao
RZRuikang Zhong
Ruikang Zhong
HSHyundong Shin
Hyundong Shin
YLYuanwei Liu
Yuanwei Liu
A multiple unmanned aerial vehicle (UAV) enabled integrated sensing and communication (ISAC) system is investigated. In contrast to existing UAV-enabled ISAC systems assuming static users or 2-D UAV trajectory, we consider a practical roaming user scenario and a 3-D deployment for UAVs. Then, a joint trajectory and beamforming optimization problem is formulated for maximizing the long-term sum data rate, subject to the transmitting power constraint and ensuring beam pattern gain constraint for sensing target. To address the challenge caused by the dynamic and high dimensionality features, multiagent reinforcement learning (MARL) is employed for this partial observation Markov decision process (POMDP) problem. We proposed a two-step approach for against the dynamic scenario: 1) a K-means-based hierarchical user association algorithm is proposed to renew the user association periodically and 2) a hybrid reward multiagent proximal policy optimization (HR-MAPPO) algorithm is proposed, which decomposes the complex combined reward into a team reward and an individual reward. HR-MAPPO introduces a hyperparameter to control the proportion of team/individual action. Numerical results demonstrate that the proposed HR-MAPPO algorithm can outperform the conventional single-agent and multiagent RL algorithms by maintaining high scores on both the sum data rate and beam pattern gain.

1 July 2024 in IEEE Network
Verified
Journal Article
Closed access
RZRuikang Zhong
Ruikang Zhong
XMXidong Mu
Xidong Mu
YZYimeng Zhang
Yimeng Zhang
Mona JaberMona Jaber
Mona Jaber
YLYuanwei Liu
Yuanwei Liu
A conception of mobile edge generation (MEG) is proposed, where generative artificial intelligence (GAI) models are distributed at edge servers (ESs) and user equipment (UE), enabling joint execution of generation tasks. The overall object of MEG is to alleviate the immense network load caused by GAI service and to reduce user queuing times for accessing GAI service. Two MEG protocols are proposed, namely the seed-based MEG protocol and the sketch-based MEG protocol , which enable efficient information exchange and joint generation among ESs and UE. Based on the MEG protocols, various model deployment strategies are proposed to arrange the distribution of the GAI model among UE and ESs. Furthermore, model deployment problems in multi-ES cases are discussed, where several deployment strategies are proposed for parallel and cooperative multi-ES MEG. Finally, a case study, the text-guided-image-to-image generation is provided, where a latent diffusion model is distributed at an ES and a UE. The simulation results demonstrate that both the proposed protocols are able to generate high-quality images at extremely low signal-to-noise ratios, and they also significantly reduce the communication overhead compared to the centralized model. Finally, open research problems for MEG are highlighted.