Aayush Ankit

Aayush Ankit

Auto-generated profile, based on publicly available information

Aayush Ankit

School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 March 2023 in ACM Computing Surveys
Verified
Journal Article
Open access
NRNitin Rathi
Nitin Rathi
ICIndranil Chakraborty
Indranil Chakraborty
AKAdarsh Kosta
Adarsh Kosta
Abhronil SenguptaAbhronil Sengupta
Abhronil Sengupta
AAAayush Ankit
Aayush Ankit
Kaushik RoyKaushik Roy
Kaushik Roy
Neuromorphic Computing, a concept pioneered in the late 1980s, is receiving a lot of attention lately due to its promise of reducing the computational energy, latency, as well as learning complexity in artificial neural networks. Taking inspiration from neuroscience, this interdisciplinary field performs a multi-stack optimization across devices, circuits, and algorithms by providing an end-to-end approach to achieving brain-like efficiency in machine intelligence. On one side, neuromorphic computing introduces a new algorithmic paradigm, known as Spiking Neural Networks (SNNs), which is a significant shift from standard deep learning and transmits information as spikes (“1” or “0”) rather than analog values. This has opened up novel algorithmic research directions to formulate methods to represent data in spike-trains, develop neuron models that can process information over time, design learning algorithms for event-driven dynamical systems, and engineer network architectures amenable to sparse, asynchronous, event-driven computing to achieve lower power consumption. On the other side, a parallel research thrust focuses on development of efficient computing platforms for new algorithms. Standard accelerators that are amenable to deep learning workloads are not particularly suitable to handle processing across multiple timesteps efficiently. To that effect, researchers have designed neuromorphic hardware that rely on event-driven sparse computations as well as efficient matrix operations. While most large-scale neuromorphic systems have been explored based on CMOS technology, recently, Non-Volatile Memory (NVM) technologies show promise toward implementing bio-mimetic functionalities on single devices. In this article, we outline several strides that neuromorphic computing based on spiking neural networks (SNNs) has taken over the recent past, and we present our outlook on the challenges that this field needs to overcome to make the bio-plausibility route a successful one.

15 July 2020 in Proceedings of the IEEE
Verified
Journal Article
Closed access
ICIndranil Chakraborty
Indranil Chakraborty
MAMustafa Ali
Mustafa Ali
AAAayush Ankit
Aayush Ankit
SJShubham Jain
Shubham Jain
SRSourjya Roy
Sourjya Roy
Kaushik RoyKaushik Roy
Kaushik Roy
Traditional computing systems based on the von Neumann architecture are fundamentally bottlenecked by data transfers between processors and memory. The emergence of data-intensive workloads, such as machine learning (ML), creates an urgent need to address this bottleneck by designing computing platforms that utilize the principle of colocated memory and processing units. Such an approach, known as “in-memory computing,” can potentially eliminate data movement costs by computing inside the memory array itself. Crossbars based on resistive nonvolatile memory (NVM) devices have shown immense promise in serving as the building blocks of in-memory computing systems for ML workloads. This is because their high density can lead to higher on-chip storage capacity, while they can also perform massively parallel, in situ matrix–vector multiplication (MVM) operations, thereby accelerating the main computational kernel of ML workloads. However, resistive crossbar-based analog computing is inherently approximate due to the device- and circuit-level nonidealities. Furthermore, the area and energy costs of peripheral circuits for conversions between the analog and digital domains can greatly diminish the intrinsic efficiency of crossbar-based MVM computation. We present a comprehensive overview of the emerging paradigm of computing using NVM crossbars for accelerating ML workloads. We describe the design principles of resistive crossbars, including the devices and associated circuits that constitute them. We discuss intrinsic approximations arising from the device and circuit characteristics and study their functional impact on the MVM operation. Next, we present an overview of spatial architectures that exploit the high storage density of NVM crossbars. Furthermore, we elaborate on software frameworks that effectively capture device–circuit–architecture characteristics to evaluate the performance of large-scale deep neural networks (DNNs) using resistive crossbar-based hardware. Finally, we discuss open challenges and future research directions that need to be explored in order to realize the vision of resistive crossbars as the building blocks of future computing platforms.

30 December 2019 in IEEE Access
Verified
Journal Article
Open access
SSSyed Shakib Sarwar
Syed Shakib Sarwar
AAAayush Ankit
Aayush Ankit
Kaushik RoyKaushik Roy
Kaushik Roy
Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high computational time and energy requirements. Also, previously seen training samples may not be available at the time of retraining. We propose an efficient training methodology and incrementally growing DCNN to learn new tasks while sharing part of the base network. Our proposed methodology is inspired by transfer learning techniques, although it does not forget previously learned tasks. An updated network, for learning new set of classes, is formed using previously learned convolutional layers (shared from initial part of base network) with addition of few newly added convolutional kernels included in the later layers of the network. We employed a `clone-and-branch' technique with calibration, which allows the network to learn new tasks (containing classes with similar features as old tasks) one after another without any performance loss in old tasks. We evaluated the proposed scheme on several recognition applications. The classification accuracy achieved by our approach is comparable to the regular incremental learning approach (where networks are updated with new training samples only, without any network sharing), while achieving energy efficiency, reduction in storage requirements, memory access and training time.

26 September 2018 in IEEE Transactions on Emerging Topics in Computational Intelligence
Verified
Journal Article
Closed access
PWParami Wijesinghe
Parami Wijesinghe
AAAayush Ankit
Aayush Ankit
Abhronil SenguptaAbhronil Sengupta
Abhronil Sengupta
KRKaushik Roy
Kaushik Roy
Deep analog artificial neural networks (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The biological brain, on the other hand, is significantly more powerful than such networks and consumes orders of magnitude less power, indicating us about some conceptual mismatch. Given that the biological neurons communicate using energy efficient trains of spikes, and the behavior is nondeterministic, incorporating these effects in deep artificial neural networks may drive us few steps toward a more realistic neuron. In this paper, we propose how the inherent stochasticity of nanoscale resistive devices can be harnessed to emulate the functionality of a spiking neuron that can be incorporated in deep stochastic spiking neural networks (SNN). At the algorithmic level, we propose how the training can be modified to convert an ANN to an SNN while supporting the stochastic activation function offered by these devices. We devise circuit architectures to incorporate stochastic memristive neurons along with memristive crossbars, which perform the functionality of the synaptic weights. We tested the proposed all-memristor deep stochastic SNN for image classification and observed only about 1% degradation in accuracy with the ANN baseline after incorporating the circuit and device related nonidealities. We witnessed that the network is robust to certain variations and consumes ~6.4 × less energy than its complementary metal oxide semiconductor (CMOS) counterpart.

29 May 2020 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
AAAayush Ankit
Aayush Ankit
IHIzzat El Hajj
Izzat El Hajj
SCSai Rahul Chalamalasetti
Sai Rahul Chalamalasetti
SASapan Agarwal
Sapan Agarwal
MMMatthew Marinella
Matthew Marinella
Kaushik RoyKaushik Roy
Kaushik Roy
The wde adoption of deep neural networks has been accompanied by ever-increasing energy and performance demands due to the expensive nature of training them. Numerous special-purpose architectures have been proposed to accelerate training: both digital and hybrid digital-analog using ReRAM crossbars. ReRAM-based accelerators have demonstrated the effectiveness of ReRAM crossbars at performing matrix operations that are prevalent in training. However, they suffer from inefficiency due to the use of serial reads and writes for performing the weight gradient and update step. A few works have demonstrated the possibility of performing outer products in crossbars, which can be used to realize the weight gradient and update step without the use of serial reads and writes. However, these works have been limited to low precision operations which are not sufficient for typical training workloads. Moreover, they have been confined to a limited set of training algorithms for fully-connect layers only. To address these limitations, we propose a bit-slicing technique for enhancing the precision of ReRAM-based outer products. We incorporate this technique into a crossbar architecture with three variants catered to different training algorithms. We build an ISA-programmable training accelerator with compiler support to evaluate our design on both convolutional and fully-connected layers.

24 April 2019 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
AAAmogh Agrawal
Amogh Agrawal
Akhilesh JaiswalAkhilesh Jaiswal
Akhilesh Jaiswal
DRDeboleena Roy
Deboleena Roy
BHBing Han
Bing Han
GSGopalakrishnan Srinivasan
Gopalakrishnan Srinivasan
KRKaushik Roy
Kaushik Roy
Deep neural networks are biologically inspired class of algorithms that have recently demonstrated the state-of-the-art accuracy in large-scale classification and recognition tasks. Hardware acceleration of deep networks is of paramount importance to ensure their ubiquitous presence in future computing platforms. Indeed, a major landmark that enables efficient hardware accelerators for deep networks is the recent advances from the machine learning community that have demonstrated the viability of aggressively scaled deep binary networks. In this paper, we demonstrate how deep binary networks can be accelerated in modified von Neumann machines by enabling binary convolutions within the static random access memory (SRAM) arrays. In general, binary convolutions consist of bit-wise exclusive-nor (xnor) operations followed by a population count (popcount). We present two proposals: one based on charge sharing approach to perform vector xnor and approximate popcount and another based on bit-wise xnor followed by a digital bit-tree adder for accurate popcount. We highlight the various tradeoffs in terms of circuit complexity, speed-up, and classification accuracy for both the approaches. Few key techniques presented as a part of the manuscript are the use of low-precision, low-overhead analog-to-digital converter (ADC), to achieve a fairly accurate popcount for the charge-sharing scheme and proposal for sectioning of the SRAM array by adding switches onto the read-bitlines, thereby achieving improved parallelism. Our results on benchmark image classification datasets for CIFAR-10 and SVHN on a binarized neural network architecture show energy improvements of up to 6.1x and 2.3x for the two proposals, compared to conventional SRAM banks. In terms of latency, improvements of up to 15.8x and 8.1x were achieved for the two respective proposals.