Rui Yan

Rui Yan

Auto-generated profile, based on publicly available information

Rui Yan

Zhejiang University of Technology

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2020 in Neural Computation
Verified
Journal Article
Closed access
XJXiping Ju
Xiping Ju
BFBiao Fang
Biao Fang
RYRui Yan
Rui Yan
XXXiaoliang Xu
Xiaoliang Xu
HTHuajin Tang
Huajin Tang
A spiking neural network (SNN) is a type of biological plausibility model that performs information processing based on spikes. Training a deep SNN effectively is challenging due to the nondifferention of spike signals. Recent advances have shown that high-performance SNNs can be obtained by converting convolutional neural networks (CNNs). However, the large-scale SNNs are poorly served by conventional architectures due to the dynamic nature of spiking neurons. In this letter, we propose a hardware architecture to enable efficient implementation of SNNs. All layers in the network are mapped on one chip so that the computation of different time steps can be done in parallel to reduce latency. We propose new spiking max-pooling method to reduce computation complexity. In addition, we apply approaches based on shift register and coarsely grained parallels to accelerate convolution operation. We also investigate the effect of different encoding methods on SNN accuracy. Finally, we validate the hardware architecture on the Xilinx Zynq ZCU102. The experimental results on the MNIST data set show that it can achieve an accuracy of 98.94% with eight-bit quantized weights. Furthermore, it achieves 164 frames per second (FPS) under 150 MHz clock frequency and obtains 41[ ] speed-up compared to CPU implementation and 22 times lower power than GPU implementation.

23 November 2017 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
HTHuajin Tang
Huajin Tang
RYRui Yan
Rui Yan
KTKay Chen Tan
Kay Chen Tan
One of the important topics in the study of robotic cognition is to enable robot to perceive, plan and react to situations in a real-world environment. We present a novel angle on this subject, by integrating active navigation with sequence learning. We propose a neuro-inspired cognitive navigation model which integrates the cognitive mapping ability of entorhinal cortex (EC) and episodic memory ability of hippocampus to enable the robot to perform more versatile cognitive tasks. The EC layer is modeled by a 3D continuous attractor network (CAN) structure to build the map of the environment. The hippocampus is modeled by a recurrent spiking neural network to store and retrieve task-related information. The information between cognitive map and memory network are exchanged through respective encoding and decoding schemes. The cognitive system is applied on a mobile robot platform and the robot exploration, localization and navigation are investigated. The robotic experiments demonstrate the effectiveness of the proposed system.

5 November 2019 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
RXRong Xiao
Rong Xiao
HTHuajin Tang
Huajin Tang
YMYuhao Ma
Yuhao Ma
RYRui Yan
Rui Yan
GOGarrick Orchard
Garrick Orchard
In this article, we present a systematic computational model to explore brain-based computation for object recognition. The model extracts temporal features embedded in address-event representation (AER) data and discriminates different objects by using spiking neural networks (SNNs). We use multispike encoding to extract temporal features contained in the AER data. These temporal patterns are then learned through the tempotron learning rule. The presented model is consistently implemented in a temporal learning framework, where the precise timing of spikes is considered in the feature-encoding and learning process. A noise-reduction method is also proposed by calculating the correlation of an event with the surrounding spatial neighborhood based on the recently proposed time-surface technique. The model evaluated on wide spectrum data sets (MNIST, N-MNIST, MNIST-DVS, AER Posture, and Poker Card) demonstrates its superior recognition performance, especially for the events with noise.

4 February 2020 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
YWYixuan Wang
Yixuan Wang
YXYang Xu
Yang Xu
RYRui Yan
Rui Yan
HTHuajin Tang
Huajin Tang
Spiking neural networks (SNNs) have shown great potential as a solution for realizing ultra-low power consumption on neuromorphic hardware, but obtaining deep SNNs is still a challenging problem. Existing network conversion methods can effectively obtain SNNs from the trained convolutional neural networks (CNNs) with little performance loss, however, high-precision weights in the converted SNNs would take up high storage space non-amicable to limited memory resources. To tackle this problem, we analyze the relationship between weights and thresholds of spiking neurons, and propose an efficient weights-threshold balance conversion method to obtain SNNs with binary weights, resulting in a significant memory storage reduction. Experimental results evaluated with various network structures on benchmark datasets show that the binary SNN not only needs much less memory resources compared to its high-precision counterpart, but also achieves the high recognition accuracy comparable to other state-of-the-art SNNs.

1 December 2019 in Neural Computation
Verified
Journal Article
Closed access
MYMengwen Yuan
Mengwen Yuan
XWXi Wu
Xi Wu
RYRui Yan
Rui Yan
HTHuajin Tang
Huajin Tang
Though succeeding in solving various learning tasks, most existing reinforcement learning (RL) models have failed to take into account the complexity of synaptic plasticity in the neural system. Models implementing reinforcement learning with spiking neurons involve only a single plasticity mechanism. Here, we propose a neural realistic reinforcement learning model that coordinates the plasticities of two types of synapses: stochastic and deterministic. The plasticity of the stochastic synapse is achieved by the hedonistic rule through modulating the release probability of synaptic neurotransmitter, while the plasticity of the deterministic synapse is achieved by a variant of a reward-modulated spike-timing-dependent plasticity rule through modulating the synaptic strengths. We evaluate the proposed learning model on two benchmark tasks: learning a logic gate function and the 19-state random walk problem. Experimental results show that the coordination of diverse synaptic plasticities can make the RL model learn in a rapid and stable form.

15 December 2023 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
ZWZiming Wang
Ziming Wang
YZYuhao Zhang
Yuhao Zhang
SLShuang Lian
Shuang Lian
XCXiaoxin Cui
Xiaoxin Cui
RYRui Yan
Rui Yan
HTHuajin Tang
Huajin Tang
Spiking neural networks (SNNs) operating with asynchronous discrete events show higher energy efficiency with sparse computation. A popular approach for implementing deep SNNs is artificial neural network (ANN)–SNN conversion combining both efficient training of ANNs and efficient inference of SNNs. However, the accuracy loss is usually nonnegligible, especially under few time steps, which restricts the applications of SNN on latency-sensitive edge devices greatly. In this article, we first identify that such performance degradation stems from the misrepresentation of the negative or overflow residual membrane potential in SNNs. Inspired by this, we decompose the conversion error into three parts: quantization error, clipping error, and residual membrane potential representation error. With such insights, we propose a two-stage conversion algorithm to minimize those errors, respectively. In addition, we show that each stage achieves significant performance gains in a complementary manner. By evaluating on challenging datasets including CIFAR-10, CIFAR-100, and ImageNet, the proposed method demonstrates the state-of-the-art performance in terms of accuracy, latency, and energy preservation. Furthermore, our method is evaluated using a more challenging object detection task, revealing notable gains in regression performance under ultralow latency, when compared with existing spike-based detection algorithms. Codes will be available at: https://github.com/Windere/snn-cvt-dual-phase.