Prabal Basu

Dr. Prabal Basu

Lead Software Engineer

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 April 2020 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
PPpramesh pandey
pramesh pandey
PBPrabal Basu
Prabal Basu
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
The emergence of hardware accelerators has brought about several orders of magnitude improvement in the speed of the deep neural-network (DNN) inference. Among such DNN accelerators, the Google tensor processing unit (TPU) has transpired to be the best-in-class, offering more than 15x speedup over the contemporary GPUs. However, the rapid growth in several DNN workloads conspires to escalate the energy consumptions of the TPU-based data-centers. In order to restrict the energy consumption of TPUs, we propose GreenTPU--a low-power near-threshold (NTC) TPU design paradigm. To ensure a high inference accuracy at a low-voltage operation, GreenTPU identifies the patterns in the error-causing activation sequences in the systolic array, and prevents further timing errors from similar patterns by intermittently boosting the operating voltage of the specific multiplier-and-accumulator units in the TPU. Compared to a cutting-edge timing error mitigation technique for TPUs, GreenTPU enables 2x to 3x higher performance (TOPS) in an NTC TPU, with a minimal loss in the prediction accuracy.

19 August 2021
Verified
Book Chapter
Closed access
PDF file
RRRiley Roberts
Riley Roberts
BLBenjamin Lewis
Benjamin Lewis
AHArnd Hartmanns
Arnd Hartmanns
PBPrabal Basu
Prabal Basu
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
ZZZhen Zhang
Zhen Zhang

3 September 2021 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
NGNoel Daniel Gundi
Noel Daniel Gundi
TSTahmoures Shabanian
Tahmoures Shabanian
PBPrabal Basu
Prabal Basu
PPpramesh pandey
pramesh pandey
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
Modern deep neural network (DNN) applications demand a remarkable processing throughput usually unmet by traditional Von Neumann architectures. Consequently, hardware accelerators, comprising a sea of multiplier-and-accumulate (MAC) units, have recently gained prominence in accelerating DNN inference engine. For example, tensor processing units (TPUs) account for a lion’s share of Google’s datacenter inference operations. The proliferation of real-time DNN predictions is accompanied by a tremendous energy budget. In quest of trimming the energy footprint of DNN accelerators, we propose Energy eFFicient and errOr Resilient TPU (EFFORT)—an energy optimized, yet high-performance TPU architecture, operating at the near-threshold computing (NTC) region. EFFORT promotes a better-than-worst case design by operating the NTC TPU at a substantially high frequency while keeping the voltage at the NTC nominal value. In order to tackle the timing errors due to such aggressive operation, we employ an opportunistic error mitigation strategy. In addition, we implement an in situ clock gating architecture, drastically reducing the MACs’ dynamic power consumption. Compared to a cutting-edge error mitigation technique for TPUs, EFFORT enables up to $2.5\times $ better performance at NTC with only 4% average accuracy drop across six out of eight DNN benchmarks.

Verified
Journal Article
Open access
PDF file
PPpramesh pandey
pramesh pandey
NGNoel Daniel Gundi
Noel Daniel Gundi
PBPrabal Basu
Prabal Basu
TSTahmoures Shabanian
Tahmoures Shabanian
MPMitchell Craig Patrick
Mitchell Craig Patrick
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
AI evolution is accelerating and Deep Neural Network (DNN) inference accelerators are at the forefront of ad hoc architectures that are evolving to support the immense throughput required for AI computation. However, much more energy efficient design paradigms are inevitable to realize the complete potential of AI evolution and curtail energy consumption. The Near-Threshold Computing (NTC) design paradigm can serve as the best candidate for providing the required energy efficiency. However, NTC operation is plagued with ample performance and reliability concerns arising from the timing errors. In this paper, we dive deep into DNN architecture to uncover some unique challenges and opportunities for operation in the NTC paradigm. By performing rigorous simulations in TPU systolic array, we reveal the severity of timing errors and its impact on inference accuracy at NTC. We analyze various attributes—such as data–delay relationship, delay disparity within arithmetic units, utilization pattern, hardware homogeneity, workload characteristics—and uncover unique localized and global techniques to deal with the timing errors in NTC.

25 July 2019
Verified
Book Chapter
Closed access
PDF file
BLBenjamin Lewis
Benjamin Lewis
AHArnd Hartmanns
Arnd Hartmanns
PBPrabal Basu
Prabal Basu
RSRajesh Jayashankara Shridevi
Rajesh Jayashankara Shridevi
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
ZZZhen Zhang
Zhen Zhang

8 October 2019 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
SSSourav Sanyal
Sourav Sanyal
PBPrabal Basu
Prabal Basu
ABAatreyi Bal
Aatreyi Bal
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
General-purpose graphics processing units (GPGPUs), due to their enormous parallelism, have found ubiquitous applications in parallel computing. However, their peak power rating has also increased over the years. As a consequence, near-threshold computing (NTC) has come to the rescue. However, a severe device-level delay variability arising from process variation (PV) can significantly diminish the NTC system performance. In this article, we examine choke points--a unique device-level characteristic of PV at NTC--that can exacerbate the delays of the GPGPU parallel warps. In order to improve the NTC GPU performance, we propose a family of holistic circuit-architectural solutions, referred to as choke-point-aware warp speculator (CPAWS). CPAWS identifies the choke point-induced critical warps in GPGPU applications and improves their execution latencies. Compared to a state-of-the-art warp scheduling policy, our best scheme improves the performance and energy efficiency of an NTC GPU by ~39% and ~31%, respectively.