Jeong-Jun Lee

Jeong-Jun Lee

Auto-generated profile, based on publicly available information

Jeong-Jun Lee

University of California, Santa Barbara, San Jose, United States

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 July 2018 in IEEE Electron Device Letters
Verified
Journal Article
Closed access
SHSungmin Hwang
Sungmin Hwang
Hyungjin KimHyungjin Kim
Hyungjin Kim
JPJungjin Park
Jungjin Park
MKMin-Woo Kwon
Min-Woo Kwon
MBMyung-Hyun Baek
Myung-Hyun Baek
BPByung-Gook Park
Byung-Gook Park
We perform a system-level simulation of hardware spiking neural network (SNN) consisting of silicon-based synaptic transistors and integrate-and-fire (I&F) neuron circuits. Using electrical models of the synaptic device and I&F neuron circuit, a three-layer fully connected SNN in hardware is presented for MNIST pattern recognition by means of ex situ training. Right-justified rate coding is employed as an information encoding method, and negative weight values are implemented by a pair of the synaptic transistors (specifically, excitatory and inhibitory synapses). Furthermore, the variability effect occurring in the devices and circuits is demonstrated. This result indicates that the system has tolerance to the variations and how precisely the variations need to be controlled for hardware SNN applications.

26 October 2022 in ACM Journal on Emerging Technologies in Computing Systems
Verified
Journal Article
Open access
JLJeong-Jun Lee
Jeong-Jun Lee
WZWenrui Zhang
Wenrui Zhang
YXYuan Xie
Yuan Xie
PLPeng Li
Peng Li
Spiking neural networks (SNNs) are brain-inspired event-driven models of computation with promising ultra-low energy dissipation. Rich network dynamics emergent in recurrent spiking neural networks (R-SNNs) can form temporally based memory, offering great potential in processing complex spatiotemporal data. However, recurrence in network connectivity produces tightly coupled data dependency in both space and time, rendering hardware acceleration of R-SNNs challenging. We present the first work to exploit spatiotemporal parallelisms to accelerate the R-SNN-based inference on systolic arrays using an architecture called SaARSP. We decouple the processing of feedforward synaptic connections from that of recurrent connections to allow for the exploitation of parallelisms across multiple time points. We propose a novel time window size optimization (TWSO) technique, to further explore the temporal granularity of the proposed decoupling in terms of optimal time window size and reconfiguration of the systolic array considering layer-dependent connectivity to boost performance. Stationary dataflow and time window size are jointly optimized to trade off between weight data reuse and movements of partial sums, the two bottlenecks in latency and energy dissipation of the accelerator. The proposed systolic-array architecture offers a unifying solution to an acceleration of both feedforward and recurrent SNNs, and delivers 4,000X EDP improvement on average for different R-SNN benchmarks over a conventional baseline.

5 August 2024
Verified
Conference Paper
Open access
JLJeongjun Lee
Jeongjun Lee
PLPeng Li
Peng Li
Spiking Neural Networks (SNNs) are brain-inspired computing models with event-driven based low-power operations and unique temporal dynamics. However, temporal dynamics in SNNs pose a significant overhead in accelerating neural computations and limit the computing capabilities of neuromorphic accelerators. Especially, unstructured sparsity emergent in both space and time, i.e., across neurons and time points, and iterative computations across time points cause a primary bottleneck in data movement. In this work, we propose a novel technique and architecture that allow the exploitation of temporal information compression with structured sparsity and parallelism across time, and significantly improves data movement on a systolic array. We split a full range of temporal domain into several time windows (TWs) where a TW packs multiple time points, and encode the temporal information in each TW with Split-Time Temporal coding (STT) by limiting the number of spikes within a TW up to one. STT enables sparsification and structurization of irregular firing activities and dramatically reduces computational overhead while delivering competitive classification accuracy without a huge drop. To further improve the data reuse, we propose an Integration Through Time (ITT) technique that processes integration steps across different TWs in parallel with a systolic array. The proposed architecture with STT and ITT offers an application-independent solution for spike-based models across various types of layers and networks. The proposed architecture delivers 97X latency and 78X energy efficiency improvements on average over a conventional SNN baseline on different benchmarks.