Gourav Southern Datta

Mr. Gourav Southern Datta


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 August 2022 in Scientific Reports
Verified
Journal Article
Open access
PDF file
GDGourav Southern Datta
Gourav Southern Datta
SKSouvik Kundu
Souvik Kundu
ZYZihan Yin
Zihan Yin
RLRavi Teja Lakkireddy
Ravi Teja Lakkireddy
JMJoe Mathai
Joe Mathai
AJAkhilesh R. Jaiswal
Akhilesh R. Jaiswal
The demand to process vast amounts of data generated from state-of-the-art high resolution cameras has motivated novel energy-efficient on-device AI solutions. Visual data in such cameras are usually captured in analog voltages by a sensor pixel array, and then converted to the digital domain for subsequent AI processing using analog-to-digital converters (ADC). Recent research has tried to take advantage of massively parallel low-power analog/digital computing in the form of near- and in-sensor processing, in which the AI computation is performed partly in the periphery of the pixel array and partly in a separate on-board CPU/accelerator. Unfortunately, high-resolution input images still need to be streamed between the camera and the AI processing unit, frame by frame, causing energy, bandwidth, and security bottlenecks. To mitigate this problem, we propose a novel Processing-in-Pixel-in-memory (P2M) paradigm, that customizes the pixel array by adding support for analog multi-channel, multi-bit convolution, batch normalization, and Rectified Linear Units (ReLU). Our solution includes a holistic algorithm-circuit co-design approach and the resulting P2M paradigm can be used as a drop-in replacement for embedding memory-intensive first few layers of convolutional neural network (CNN) models within foundry-manufacturable CMOS image sensor platforms. Our experimental results indicate that P2M reduces data transfer bandwidth from sensors and analog to digital conversions by $${\sim }\,21\times$$∼21× , and the energy-delay product (EDP) incurred in processing a MobileNetV2 model on a TinyML use case for visual wake words dataset (VWW) by up to $$\mathord {\sim }\,11\times$$∼11× compared to standard near-processing or in-sensor implementations, without any significant drop in test accuracy.

7 April 2022 in Frontiers in Neuroscience
Verified
Journal Article
Open access
GDGourav Southern Datta
Gourav Southern Datta
SKSouvik Kundu
Souvik Kundu
AJAkhilesh R. Jaiswal
Akhilesh R. Jaiswal
PBPeter A. Beerel
Peter A. Beerel
High-quality 3D image recognition is an important component of many vision and robotics systems. However, the accurate processing of these images requires the use of compute-expensive 3D Convolutional Neural Networks (CNNs). To address this challenge, we propose the use of Spiking Neural Networks (SNNs) that are generated from iso-architecture CNNs and trained with quantization-aware gradient descent to optimize their weights, membrane leak, and firing thresholds. During both training and inference, the analog pixel values of a 3D image are directly applied to the input layer of the SNN without the need to convert to a spike-train. This significantly reduces the training and inference latency and results in high degree of activation sparsity, which yields significant improvements in computational efficiency. However, this introduces energy-hungry digital multiplications in the first layer of our models, which we propose to mitigate using a processing-in-memory (PIM) architecture. To evaluate our proposal, we propose a 3D and a 3D/2D hybrid SNN-compatible convolutional architecture and choose hyperspectral imaging (HSI) as an application for 3D image recognition. We achieve overall test accuracy of 98.68, 99.50, and 97.95% with 5 time steps (inference latency) and 6-bit weight quantization on the Indian Pines, Pavia University, and Salinas Scene datasets, respectively. In particular, our models implemented using standard digital hardware achieved accuracies similar to state-of-the-art (SOTA) with ~560.6× and ~44.8× less average energy than an iso-architecture full-precision and 6-bit quantized CNN, respectively. Adopting the PIM architecture in the first layer, further improves the average energy, delay, and energy-delay-product (EDP) by 30, 7, and 38%, respectively.

19 February 2023
Verified
Book Chapter
Closed access
PDF file
GDGourav Southern Datta
Gourav Southern Datta
ZYZihan Yin
Zihan Yin
AJAjey P. Jacob
Ajey P. Jacob
AJAkhilesh R. Jaiswal
Akhilesh R. Jaiswal
PBPeter Anthony Beerel
Peter Anthony Beerel

1 July 2019
Verified
Conference Paper
Open access
SKSouvik Kundu
Souvik Kundu
GDGourav Southern Datta
Gourav Southern Datta
PBPeter Anthony Beerel
Peter Anthony Beerel
MPMassoud Pedram
Massoud Pedram

15 February 2021 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
GDGourav Southern Datta
Gourav Southern Datta
YLYunkun Lin
Yunkun Lin
BZBo Zhang
Bo Zhang
PBPeter Anthony Beerel
Peter Anthony Beerel
Superconducting digital electronics, especially Single Flux Quantum (SFQ), has emerged as a promising beyond-CMOS technology with Josephson junctions (JJ) as the active device. It has the potential to meet the booming demands of lower power consumption and higher operation speeds in the electronics industry and future exascale supercomputing systems. Despite these promises, scaling SFQ circuits remains a serious challenge that motivates the support of multiple SFQ clock domains. Towards this end, this paper analyzes the impact of setup time violations and metastability in SFQ circuits comparing the derived analytical models to their CMOS counterparts. It also proposes new techniques to reduce the average latency in metastability-tolerant SFQ synchronizers, and evaluates their effects on the layout and critical margin of the design. It further extends the proposed model to estimate the Mean Time Between Failure (MTBF) of flip-flop-based synchronizers and shows that their MTBF with the current feature sizes is unaffected by noise, similar to CMOS. Finally, it curve fits this model to simulations using the state-of-the-art SFQ5ee process and shows that a two-flop SFQ synchronizer with a clock frequency of 25 GHz has an estimated MTBF of ~10 6 years.

5 June 2023
Verified
Conference Paper
Open access
AKAbdullah-Al Kaiser
Abdullah-Al Kaiser
GDGourav Southern Datta
Gourav Southern Datta
SSSreetama Sarkar
Sreetama Sarkar
SKSouvik Kundu
Souvik Kundu
ZYZihan Yin
Zihan Yin
Akhilesh JaiswalAkhilesh Jaiswal
Akhilesh Jaiswal
The massive amounts of data generated by camera sensors motivate data processing inside pixel arrays, i.e., at the extreme-edge. Several critical developments have fueled recent interest in the processing-in-pixel-in-memory paradigm for a wide range of visual machine intelligence tasks, including (1) advances in 3D integration technology to enable complex processing inside each pixel in a 3D integrated manner while maintaining pixel density, (2) analog processing circuit techniques for massively parallel low-energy in-pixel computations, and (3) algorithmic techniques to mitigate non-idealities associated with analog processing through hardware-aware training schemes. This article presents a comprehensive technology-circuit-algorithm landscape that connects technology capabilities, circuit design strategies, and algorithmic optimizations to power, performance, area, bandwidth reduction, and application-level accuracy metrics. We present our results using a comprehensive co-design framework incorporating hardware and algorithmic optimizations for various complex real-life visual intelligence tasks mapped onto our P2M paradigm.