Siying Wang

Mr. Siying Wang

University of Electronic Science and Technology of China, Chengdu, Sichuan, China
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 April 2025 in IEEE Computational Intelligence Magazine
Verified
Journal Article
Closed access
Malu ZhangMalu Zhang
Malu Zhang
SWShuai Wang
Shuai Wang
JWJibin Wu
Jibin Wu
WWWenjie Wei
Wenjie Wei
DZDehao Zhang
Dehao Zhang
YYYang Yang
Yang Yang
Deep reinforcement learning (DRL) facilitates efficient interaction with complex environments by enabling continuous optimization strategies and providing agents with autonomous learning abilities. However, traditional DRL methods often require large-scale neural networks and extensive computational resources, which limits their applicability in power-sensitive and resource-constrained edge environments, such as mobile robots and drones. To overcome these limitations, we leverage the energy-efficient properties of brain-inspired spiking neural networks (SNNs) to develop a novel spike-based DRL framework, referred to as Spike-DRL. Unlike traditional SNN-based reinforcement learning methods, Spike-DRL incorporates the energy-efficient time-to-first-spike (TTFS) encoding scheme, where information is encoded through the precise timing of a single spike. This TTFS-based method allows Spike-DRL to work in a sparse, event-driven manner, significantly reducing energy consumption. In addition, to improve the deployment capability of Spike-DRL in resource-constrained environments, a lightweight strategy for quantizing synaptic weights into low-bit representations is introduced, significantly reducing memory usage and computational complexity. Extensive experiments have been conducted to evaluate the performance of the proposed Spike-DRL, and the results show that our method achieves competitive performance with higher energy efficiency and lower memory requirements. This work presents a biologically inspired model that is well suited for real-time decision-making and autonomous learning in power-sensitive and resource-limited edge environments.

30 March 2024 in Knowledge-Based Systems
Verified
Journal Article
Closed access
ZZZhitong Zhao
Zhitong Zhao
YZYa Zhang
Ya Zhang
SWSiying Wang
Siying Wang
FZFan Zhang
Fan Zhang
MZMalu Zhang
Malu Zhang
WCWenyu Chen
Wenyu Chen

15 June 2023 in Knowledge-Based Systems
Verified
Journal Article
Closed access
SWSiying Wang
Siying Wang
WCWenyu Chen
Wenyu Chen
LHLiwei Huang
Liwei Huang
FZFan Zhang
Fan Zhang
ZZZhitong Zhao
Zhitong Zhao
HQHong Qu
Hong Qu

30 October 2024 in Knowledge-Based Systems
Verified
Journal Article
Closed access
SWSiying Wang
Siying Wang
HDHongfei Du
Hongfei Du
YZYang Zhou
Yang Zhou
ZZZhitong Zhao
Zhitong Zhao
RZRuoning Zhang
Ruoning Zhang
WCWenyu Chen
Wenyu Chen

22 July 2025 in Information Sciences
Verified
Journal Article
Closed access
ZZZhitong Zhao
Zhitong Zhao
YZYa Zhang
Ya Zhang
WCWenyu Chen
Wenyu Chen
FZFan Zhang
Fan Zhang
SWSiying Wang
Siying Wang
YZYang Zhou
Yang Zhou

2 August 2022 in Mathematics
Verified
Journal Article
Open access
PDF file
SWSiying Wang
Siying Wang
WCWenyu Chen
Wenyu Chen
JHJian Hu
Jian Hu
SHSiyue Hu
Siyue Hu
HLHuang Liwei
Huang Liwei
Leveraging global state information to enhance policy optimization is a common approach in multi-agent reinforcement learning (MARL). Even with the supplement of state information, the agents still suffer from insufficient exploration in the training stage. Moreover, training with batch-sampled examples from the replay buffer will induce the policy overfitting problem, i.e., multi-agent proximal policy optimization (MAPPO) may not perform as good as independent PPO (IPPO) even with additional information in the centralized critic. In this paper, we propose a novel noise-injection method to regularize the policies of agents and mitigate the overfitting issue. We analyze the cause of policy overfitting in actor–critic MARL, and design two specific patterns of noise injection applied to the advantage function with random Gaussian noise to stabilize the training and enhance the performance. The experimental results on the Matrix Game and StarCraft II show the higher training efficiency and superior performance of our method, and the ablation studies indicate our method will keep higher entropy of agents’ policies during training, which leads to more exploration.