Sanghamitra Roy

Dr. Sanghamitra Roy

Utah State University

Research Focus & Metrics

Academic Career Length

17Years (2010-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 April 2020 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
PPpramesh pandey
pramesh pandey
PBPrabal Basu
Prabal Basu
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
The emergence of hardware accelerators has brought about several orders of magnitude improvement in the speed of the deep neural-network (DNN) inference. Among such DNN accelerators, the Google tensor processing unit (TPU) has transpired to be the best-in-class, offering more than 15x speedup over the contemporary GPUs. However, the rapid growth in several DNN workloads conspires to escalate the energy consumptions of the TPU-based data-centers. In order to restrict the energy consumption of TPUs, we propose GreenTPU--a low-power near-threshold (NTC) TPU design paradigm. To ensure a high inference accuracy at a low-voltage operation, GreenTPU identifies the patterns in the error-causing activation sequences in the systolic array, and prevents further timing errors from similar patterns by intermittently boosting the operating voltage of the specific multiplier-and-accumulator units in the TPU. Compared to a cutting-edge timing error mitigation technique for TPUs, GreenTPU enables 2x to 3x higher performance (TOPS) in an NTC TPU, with a minimal loss in the prediction accuracy.

19 August 2021
Verified
Book Chapter
Closed access
PDF file
RRRiley Roberts
Riley Roberts
BLBenjamin Lewis
Benjamin Lewis
AHArnd Hartmanns
Arnd Hartmanns
PBPrabal Basu
Prabal Basu
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
ZZZhen Zhang
Zhen Zhang

3 September 2021 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
NGNoel Daniel Gundi
Noel Daniel Gundi
TSTahmoures Shabanian
Tahmoures Shabanian
PBPrabal Basu
Prabal Basu
PPpramesh pandey
pramesh pandey
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
Modern deep neural network (DNN) applications demand a remarkable processing throughput usually unmet by traditional Von Neumann architectures. Consequently, hardware accelerators, comprising a sea of multiplier-and-accumulate (MAC) units, have recently gained prominence in accelerating DNN inference engine. For example, tensor processing units (TPUs) account for a lion’s share of Google’s datacenter inference operations. The proliferation of real-time DNN predictions is accompanied by a tremendous energy budget. In quest of trimming the energy footprint of DNN accelerators, we propose Energy eFFicient and errOr Resilient TPU (EFFORT)—an energy optimized, yet high-performance TPU architecture, operating at the near-threshold computing (NTC) region. EFFORT promotes a better-than-worst case design by operating the NTC TPU at a substantially high frequency while keeping the voltage at the NTC nominal value. In order to tackle the timing errors due to such aggressive operation, we employ an opportunistic error mitigation strategy. In addition, we implement an in situ clock gating architecture, drastically reducing the MACs’ dynamic power consumption. Compared to a cutting-edge error mitigation technique for TPUs, EFFORT enables up to $2.5\times $ better performance at NTC with only 4% average accuracy drop across six out of eight DNN benchmarks.

Verified
Journal Article
Open access
PDF file
PPpramesh pandey
pramesh pandey
NGNoel Daniel Gundi
Noel Daniel Gundi
PBPrabal Basu
Prabal Basu
TSTahmoures Shabanian
Tahmoures Shabanian
MPMitchell Craig Patrick
Mitchell Craig Patrick
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
AI evolution is accelerating and Deep Neural Network (DNN) inference accelerators are at the forefront of ad hoc architectures that are evolving to support the immense throughput required for AI computation. However, much more energy efficient design paradigms are inevitable to realize the complete potential of AI evolution and curtail energy consumption. The Near-Threshold Computing (NTC) design paradigm can serve as the best candidate for providing the required energy efficiency. However, NTC operation is plagued with ample performance and reliability concerns arising from the timing errors. In this paper, we dive deep into DNN architecture to uncover some unique challenges and opportunities for operation in the NTC paradigm. By performing rigorous simulations in TPU systolic array, we reveal the severity of timing errors and its impact on inference accuracy at NTC. We analyze various attributes—such as data–delay relationship, delay disparity within arithmetic units, utilization pattern, hardware homogeneity, workload characteristics—and uncover unique localized and global techniques to deal with the timing errors in NTC.

25 June 2013 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
JAJason M. Allred
Jason M. Allred
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
The emergence of dark silicon-a fundamental design constraint absent in past generations-brings intriguing challenges and opportunities to microprocessor design. In this brief, we demonstrate the challenges of comparing competing design styles across different technology generations in a dark silicon era. We provide a new metric to guide a dark silicon aware (DSA) system design and propose a stochastic optimization algorithm for DSA multicore system design. Our technique shows 11%-58% and 5.7-5.8 times improvement in energy efficiency for forthcoming technology generations with two multicore design styles: cores with various voltage-frequency domains and cores with heterogeneous microarchitectures.

1 January 2010
Verified
Conference Paper
Closed access
Koushik ChakrabortyKoushik Chakraborty
Koushik Chakraborty
Sanghamitra RoySanghamitra Roy
Sanghamitra Roy
Due to the inherent nature of heat flow in 3D integrated circuits, stacked dies exhibit a wide range of thermal characteristics. The strong dependence of leakage with temperature and process variation plays havoc in achieving system level energy efficiency in such systems, complicating the task of power provisioning in 3D multicores. In this paper, we address this power provisioning challenge in 3D ICs by advocating a novel microprocessor design paradigm, where the circuit designers are aware of the intended placement of a die in a 3D stack. We present a concrete application of this paradigm through a threshold voltage (Vt) assignment algorithm for a 3D multicore system, where we specifically account for: (a) the change in the role of leakage power, (b) expected operating frequency, and (c) dependency of PV induced leakage variation and Vt levels. Detailed simulation based experiments with our proposed algorithm show 2-15% improvement in energy efficiency for a typical multicore system organized as 3D stacked dies.