Chankyu Lee

Chankyu Lee

Auto-generated profile, based on publicly available information

Chankyu Lee

Department of Electrical and Computer Engineering, Purdue University, West Lafayette, USA

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 July 2018 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
AAAmogh Agrawal
Amogh Agrawal
Akhilesh JaiswalAkhilesh Jaiswal
Akhilesh Jaiswal
CLChankyu Lee
Chankyu Lee
KRKaushik Roy
Kaushik Roy
Silicon-based static random access memories (SRAM) and digital Boolean logic have been the workhorse of the state-of-the-art computing platforms. Despite tremendous strides in scaling the ubiquitous metal-oxide-semiconductor transistor, the underlying von-Neumann computing architecture has remained unchanged. The limited throughput and energy-efficiency of the state-of-the-art computing systems, to a large extent, result from the well-known von-Neumann bottleneck. The energy and throughput inefficiency of the von-Neumann machines have been accentuated in recent times due to the present emphasis on data-intensive applications such as artificial intelligence, machine learning, and cryptography. A possible approach towards mitigating the overhead associated with the von-Neumann bottleneck is to enable in-memory Boolean computations. In this paper, we present an augmented version of the conventional SRAM bit-cells, called the X-SRAM, with the ability to perform in-memory, vector Boolean computations, in addition to the usual memory storage operations. We propose at least six different schemes for enabling in-memory vector computations, including NAND, NOR, IMP (implication), XOR logic gates, with respect to different bit-cell topologies - the 8T cell and the 8⁺T Differential cell. In addition, we also present a novel `read-compute-store' scheme, wherein the computed Boolean function can be directly stored in the memory without the need of latching the data and carrying out a subsequent write operation. The feasibility of the proposed schemes has been verified using the predictive transistor models and detailed Monte-Carlo variation analysis. As an illustration, we also present the efficacy of the proposed in-memory computations by implementing advanced encryption standard algorithm on a non-standard von-Neumann machine wherein the conventional SRAM is replaced by X-SRAM. Our simulations indicated that up to 75% of memory accesses can be saved using the proposed techniques.

3 August 2018 in Frontiers in Neuroscience
Verified
Journal Article
Open access
PDF file
CLChankyu Lee
Chankyu Lee
PPPriyadarshini Panda
Priyadarshini Panda
GSGopalakrishnan Srinivasan
Gopalakrishnan Srinivasan
KRKaushik Roy
Kaushik Roy
Spiking Neural Networks (SNNs) are fast becoming a promising candidate for brain-inspired neuromorphic computing because of their inherent power efficiency and impressive inference accuracy across several cognitive tasks such as image classification and speech recognition. The recent efforts in SNNs have been focused on implementing deeper networks with multiple hidden layers to incorporate exponentially more difficult functional representations. In this paper, we propose a pre-training scheme using biologically plausible unsupervised learning, namely Spike-Timing-Dependent-Plasticity (STDP), in order to better initialize the parameters in multi-layer systems prior to supervised optimization. The multi-layer SNN is comprised of alternating convolutional and pooling layers followed by fully-connected layers, which are populated with leaky integrate-and-fire spiking neurons. We train the deep SNNs in two phases wherein, first, convolutional kernels are pre-trained in a layer-wise manner with unsupervised learning followed by fine-tuning the synaptic weights with spike-based supervised gradient descent backpropagation. Our experiments on digit recognition demonstrate that the STDP-based pre-training with gradient-based optimization provides improved robustness, faster (~2.5 ×) training time and better generalization compared with purely gradient-based training without pre-training.

7 October 2020
Verified
Book Chapter
Closed access
PDF file
CLChankyu Lee
Chankyu Lee
AKAdarsh Kumar Kosta
Adarsh Kumar Kosta
AZAlex Zihao Zhu
Alex Zihao Zhu
KCKenneth Chaney
Kenneth Chaney
KDKostas Daniilidis
Kostas Daniilidis
Kaushik RoyKaushik Roy
Kaushik Roy

4 May 2018 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
CLChankyu Lee
Chankyu Lee
GSGopalakrishnan Srinivasan
Gopalakrishnan Srinivasan
PPPriyadarshini Panda
Priyadarshini Panda
KRKaushik Roy
Kaushik Roy
Spiking Neural Networks (SNNs) have emerged as a promising brain inspired neuromorphic-computing paradigm for cognitive system design due to their inherent event-driven processing capability. The fully-connected shallow SNNs typically used for pattern recognition require large number of trainable parameters to achieve competitive classification accuracy. In this work, we propose a deep Spiking Convolutional Neural Network (SpiCNN) composed of a hierarchy of stacked convolutional layers followed by a spatial-pooling layer and a final fully-connected layer. The network is populated with biologically plausible Leaky-Integrate-and-Fire (LIF) neurons interconnected by shared synaptic weight kernels. We train convolutional kernels layer-by-layer in an unsupervised manner using Spike Timing Dependent Plasticity (STDP) that enables them to self-learn characteristic features making up the input patterns. In order to further improve the feature learning efficiency, we propose using smaller 3×3 kernels trained using STDP-based synaptic weight updates performed over a mini-batch of input patterns. Our deep SpiCNN, consisting of two convolutional layers trained using the unsupervised convolutional STDP learning methodology, achieved classification accuracies of 91.1% and 97.6% respectively for inferring handwritten digits from the MNIST dataset and a subset of natural images from the Caltech dataset.

19 May 2022 in Scientific Reports
Verified
Journal Article
Open access
PDF file
CWCheng Wang
Cheng Wang
CLChankyu Lee
Chankyu Lee
KRKaushik Roy
Kaushik Roy
The capability of emulating neural functionalities efficiently in hardware is crucial for building neuromorphic computing systems. While various types of neuro-mimetic devices have been investigated, it remains challenging to provide a compact device that can emulate spiking neurons. In this work, we propose a non-volatile spin-based device for efficiently emulating a leaky integrate-and-fire neuron. By incorporating an exchange-coupled composite free layer in spin-orbit torque magnetic tunnel junctions, multi-domain magnetization switching dynamics is exploited to realize gradual accumulation of membrane potential for a leaky integrate-and-fire neuron with compact footprints. The proposed device offers significantly improved scalability compared with previously proposed spin-based neuro-mimetic implementations while exhibiting high energy efficiency and good controllability. Moreover, the proposed neuron device exhibits a varying leak constant and a varying membrane resistance that are both dependent on the magnitude of the membrane potential. Interestingly, we demonstrate that such device-inspired dynamic behaviors can be incorporated to construct more robust spiking neural network models, and find improved resiliency against various types of noise injection scenarios. The proposed spintronic neuro-mimetic devices may potentially open up exciting opportunities for the development of efficient and robust neuro-inspired computational hardware.

24 March 2020 in arXiv
Verified
Preprint
Open access
PDF file
CLChankyu Lee
Chankyu Lee
SSSyed Shakib Sarwar
Syed Shakib Sarwar
PPPriyadarshini Panda
Priyadarshini Panda
GSGopalakrishnan Srinivasan
Gopalakrishnan Srinivasan
Kaushik RoyKaushik Roy
Kaushik Roy
Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input spikes has not been successful so far. Diverse methods have been proposed to get around this issue such as converting off-the-shelf trained deep Artificial Neural Networks (ANNs) to SNNs. However, the ANN-SNN conversion scheme fails to capture the temporal dynamics of a spiking system. On the other hand, it is still a difficult problem to directly train deep SNNs using input spike events due to the discontinuous, non-differentiable nature of the spike generation function. To overcome this problem, we propose an approximate derivative method that accounts for the leaky behavior of LIF neurons. This method enables training deep convolutional SNNs directly (with input spike events) using spike-based backpropagation. Our experiments show the effectiveness of the proposed spike-based learning on deep networks (VGG and Residual architectures) by achieving the best classification accuracies in MNIST, SVHN and CIFAR-10 datasets compared to other SNNs trained with a spike-based learning. Moreover, we analyze sparse event-based computations to demonstrate the efficacy of the proposed SNN training method for inference operation in the spiking domain.