Zhuwei Wang

Dr. Zhuwei Wang

Beijing University of Technology, Beijing 100124, China
orcid

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 July 2023 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
Chao FangChao Fang
Chao Fang
ZHZhaoming Hu
Zhaoming Hu
XMXiangheng Meng
Xiangheng Meng
STShanshan Tu
Shanshan Tu
Zhuwei WangZhuwei Wang
Zhuwei Wang
ZHZhu Han
Zhu Han
With the proliferation of mobile devices (e.g., vehicles and smartphones), rich media content services from massive users lead to high network resource consumption and energy usage. How to effectively allocate heterogeneous network resources and achieve green content delivery is a major challenge to be addressed in urgency, especially when vehicular users are involved and the spatiotemporal distribution of the content requests can change drastically. In this paper, we propose a new deep reinforcement learning (DRL)-aided task offloading and resource allocation scheme, named TORA-DRL, to minimize power consumption in cloud-edge cooperation environments, where in-network caching and request aggregation are incorporated to reduce replicated transmissions of network contents. Based on the history of content requests and available network resources in the system, TORA-DRL jointly optimizes the decisions about task offloading, as well as computing, caching and communication resource allocation, adapting to the changes in network states and user requirements. Simulation results demonstrate that the proposed TORA-DRL solution converges fast and has much higher energy efficiency than the existing popular cloud-edge cooperation schemes under different network environments.

29 September 2022 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
XYXinyu Ye
Xinyu Ye
MLMeng Li
Meng Li
PSPengbo Si
Pengbo Si
RYRuizhe Yang
Ruizhe Yang
Zhuwei WangZhuwei Wang
Zhuwei Wang
YZYanhua Zhang
Yanhua Zhang
Recently, the rise of the Internet of Vehicles (IoV) has driven the broad development of intelligent transportation and smart cities. In order to promote the computing power of mobile vehicles and decrease the content delivery latency of suppliers, mobile edge computing (MEC) is recognized as a promising computational paradigm and used in vehicular networks. However, there are some essential issues to be considered: 1) privacy and authenticity of data transmission in IoV, and 2) reasonable resource allocation for collaborative computing and caching. In this paper, to solve above issues, blockchain technology is introduced and adopted to ensure the accuracy and reliability of data transmission and interaction. Meanwhile, we develop an intelligent framework of resource allocation about computing and caching for blockchain-enabled MEC systems in IoV. Through jointly considering and optimizing offloading decision of computation task carried by vehicle, caching decision, the number of offloaded consensus nodes, block interval and block size, the weighted consumption costs of energy consumption and computation overheads can be decreased, and the transactional throughput of the blockchain can be increased. Moreover, due to the continuity and dynamic of the available resources of mobile vehicles and computing servers, the optimization problem is modeled as a Markov decision process (MDP). Facing the large-scale and dynamic characteristics of the system, the asynchronous advantage actor-critic (A3C) approach is introduced to deal with the optimization problem. Simulation results show that our proposed scheme achieves significant advantages over other comparison schemes, such as the total reward of the proposed scheme is about 14 $\%$ higher than that of the deep $Q$ -network based scheme.

29 June 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
ZHZhaoming Hu
Zhaoming Hu
Chao FangChao Fang
Chao Fang
Zhuwei WangZhuwei Wang
Zhuwei Wang
STShu-Ming Tseng
Shu-Ming Tseng
MDMianxiong Dong
Mianxiong Dong
With the advancement of mobile communication technology, there has been a marked increase in the demand for personalized and ubiquitous Internet of Things (IoT) services, raising the expectations for network Quality of Service (QoS) and Quality of Experience (QoE). Existing popularity-prediction-based content caching policies improve QoS and QoE by precaching contents at the network edge, but jointly optimizing multiple network metrics remains a challenge. To address this challenge, we propose a many-objective optimization-based popularity prediction for cooperative caching (MaOPPC-Caching) framework for cloud–edge–end collaborative IoT networks. This framework simultaneously optimizes prediction accuracy, delay, offloaded traffic, and load balance. We integrate three prediction algorithms to forecast content popularity and present a horizontal and vertical collaborative caching decision strategy to generate caching forms based on the predicted results. Then, the many-objective evolutionary algorithm (MaOEA) is employed to optimize the combined proportions to take full advantage of hidden preferences and popularity characteristics of both users and items. To promote the convergence of the framework, we present a knowledge mining-based MaOEA (KMaOEA) to incorporate knowledge mining into the optimization process. Simulation results show that the proposed MaOPPC-Caching framework outperforms existing prediction algorithms in terms of four evaluation indicators. Furthermore, KMaOEA shows a significant advantage over NSGA-III in load balance, as indicated by a Mann–Whitney rank sum test with a $p$ -value of 0.040.

23 May 2022 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
Zhuwei WangZhuwei Wang
Zhuwei Wang
SJSenfan Jin
Senfan Jin
LLLihan Liu
Lihan Liu
Chao FangChao Fang
Chao Fang
MLMeng Li
Meng Li
SGSong Guo
Song Guo
Connected cruise control (CCC) refers to a type of advanced driver assistance system combined with wireless vehicle-to-vehicle (V2V) communication technology to improve control stability and driving safety. However, it is urgent to investigate intelligent control algorithms to improve the adaptability of CCC in complex traffic environment. In addition, the effect of communication delays attributed to shared wireless communications on the performance degradation of the intelligent CCC design cannot be ignored. In this study, the design of deep reinforcement learning (DRL) controller for CCC system in high-dynamic traffic scenarios is investigated, which considers both time-varying leading velocity and communication delays. To be more specific, an intelligent CCC algorithm based on deep deterministic policy gradient (DDPG) is developed. According to the training samples obtained from interacting with the traffic environment, the actor network and the critic network are trained to maximize the quadratic reward function determined by state errors and control inputs for generating intelligent control strategies. In particular, the effect of previous control strategies is considered in vehicle dynamics analysis, optimization problem formulation and Markov decision process (MDP) definition to compensate the performance degradation attributed to communication delays. Lastly, the effectiveness and convergence of the proposed DRL-based CCC controller are verified through numerical simulations with various conditions. The superior performance of the proposed algorithm is shown by comparing with existing traditional algorithms and state-of-the-art DRL algorithms.

23 August 2019 in IEEE Systems Journal
Verified
Journal Article
Closed access
Zhuwei WangZhuwei Wang
Zhuwei Wang
YGYu Gao
Yu Gao
Chao FangChao Fang
Chao Fang
LLLihan Liu
Lihan Liu
SGSong Guo
Song Guo
PLPeng Li
Peng Li
Connected cruise control (CCC), as an approach to regulate vehicle's longitudinal motion in car-following platoon scenarios, can improve the safety and efficiency of the traffic flow. In order to make it available for extensive information sharing among vehicles, wireless vehicle-to-vehicle (V2V) communication is exploited in the vehicular platoon. However, time delays caused by wireless communication may result in significant degradation of system stability. In this article, considering arbitrary V2V communication delays, an optimal longitudinal control algorithm is proposed for the CCC vehicle with the goal of minimizing the deviations of vehicle's headway and velocity. In the proposed scheme, the vehicular platoon is modeled as a discrete-time system based on vehicle's error dynamics, and the optimal-state feedback control problem is designed as a cost function represented by a sum of platoon states in a quadratic form. A backward recursion method is used to iteratively derive the optimal control strategy, namely the acceleration for CCC vehicle, based on the current platoon states and previous control signals. In addition, the stability analysis shows that the system is asymptotically mean square stable under the control of the proposed algorithm. Finally, numerical simulations indicate that the proposed algorithm provides better system performance and stability.

18 September 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
Zhuwei WangZhuwei Wang
Zhuwei Wang
YXYi Xue
Yi Xue
LLLihan Liu
Lihan Liu
HZHaijun Zhang
Haijun Zhang
CQChunhui Qu
Chunhui Qu
Chao FangChao Fang
Chao Fang
The development of intelligent transportation systems (ITS) has attracted significant attention to connected and autonomous vehicles (CAVs). It is urgent to investigate multi-CAV intelligent cruise control solutions in mixed traffic environments. In addition, the impact of platoon dynamics and time delays, induced by shared wireless communications, data processing, and actuation cannot be ignored. This article investigates the development of a multi-agent deep reinforcement learning (MADRL) controller tailored for CAVs operating within mixed and dynamic traffic scenarios that involve time delays. Firstly, the error dynamics in the discrete-time domain for each subplatoon is derived by considering the time-varying delays and leading vehicle states, and then the optimal CAV cruise control problem is formulated. Subsequently, the partially observable Markov game (POMG) is used to construct the multi-agent environment, and then a centralized training decentralized execution (CTDE) algorithm framework is proposed based on the multi-agent deep deterministic policy gradient (MADDPG) method. Finally, the computational complexity and the influence of delay are analyzed. The simulation results illustrate the effectiveness of the proposed intelligent algorithm.