Vikram Jain

Vikram Jain

Auto-generated profile, based on publicly available information

Vikram Jain

Department of EECS, University of California, Berkeley, Berkeley, CA, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 February 2021 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
LMLinyan Mei
Linyan Mei
PHPouya Houshmand
Pouya Houshmand
VJVikram Jain
Vikram Jain
SGSebastian Giraldo
Sebastian Giraldo
MVMarian Verhelst
Marian Verhelst
Building efficient embedded deep learning systems requires a tight co-design between DNN algorithms, hardware, and algorithm-to-hardware mapping, a.k.a. dataflow. However, owing to the large joint design space, finding an optimal solution through physical implementation becomes infeasible. To tackle this problem, several design space exploration (DSE) frameworks have emerged recently, yet they either suffer from long runtimes or a limited exploration space. This article introduces ZigZag, a rapid DSE framework for DNN accelerator architecture and mapping. ZigZag extends the common DSE with uneven mapping opportunities and smart mapping search strategies. Uneven mapping decouples operands (W/I/O), memory hierarchy, and mappings (temporal/spatial), opening up a whole new space for DSE, and thus better design points are found by ZigZag compared to other SotAs. For this, ZigZag uses an enhanced nested-for-loop format as a uniform representation to integrate algorithm, accelerator, and algorithm-to-accelerator mapping. ZigZag consists of three key components: 1) an analytical energy-performance-area Hardware Cost Estimator, 2) two Mapping Search Engines that support spatial and temporal even/uneven mapping search, and 3) an Architecture Generator that auto-explores the wide memory hierarchy design space. Benchmarking experiments against published works, in-house accelerator, and existing DSE frameworks, together with three case studies, show the reliability and capability of ZigZag. Up to 64 percent more energy-efficient solutions are found compared to other SotAs, due to ZigZag's uneven mapping capabilities.

31 October 2022 in IEEE Journal of Solid-State Circuits
Verified
Journal Article
Closed access
PHPouya Houshmand
Pouya Houshmand
GSGiuseppe M. Sarda
Giuseppe M. Sarda
VJVikram Jain
Vikram Jain
KUKodai Ueyoshi
Kodai Ueyoshi
IPIoannis A. Papistas
Ioannis A. Papistas
MVMarian Verhelst
Marian Verhelst
DIgital-ANAlog (DIANA), a heterogeneous multi-core accelerator, combines a reduced instruction set computer -five (RISC-V) host processor with an analog in-memory computing (AIMC) artificial intelligence (AI) accelerator and a digital reconfigurable deep neural network (DNN) accelerator in a single system-on-chip (SoC) to support a wide variety of neural network (NN) workloads. AIMC cores can bring extreme computational parallelism and efficiency at the expense of accuracy and dataflow flexibility. Digital AI co-processors, on the other hand, guarantee accuracy through deterministic compute, but cannot achieve the same computational density and efficiency. DIANA exploits this fundamental tradeoff by integrating both types of cores in a shared and optimized memory system, to enable seamless execution of the workloads on the parallel cores. The system’s performance benefits further from pipelined parallel execution across both accelerator cores and enhanced AIMC spatial unrolling techniques, leading to drastically reduced execution latency and reduced memory footprints. The design has been implemented in a 22-nm technology and achieves peak efficiencies of 600 TOP/s/W for the AIMC core (I/W/O: 7/1.5/6 bit) and 14 TOP/s/W (I/W/O: 8/8/8 bit) for the digital accelerator, respectively. End-to-end performance evaluation of CIFAR-10 and ImageNet classification workloads is carried out on the chip, reporting 7.02 and 5.56 TOP/s/W, respectively, at the system level.

20 January 2023 in IEEE Journal of Solid-State Circuits
Verified
Journal Article
Closed access
VJVikram Jain
Vikram Jain
SGSebastian Giraldo
Sebastian Giraldo
JRJaro De Roose
Jaro De Roose
LMLinyan Mei
Linyan Mei
BBBert Boons
Bert Boons
MVMarian Verhelst
Marian Verhelst
Extreme edge devices or Internet-of-Things (IoT) nodes require both ultra-low power (ULP) always-on (AON) processing as well as the ability to do on-demand sampling and processing. Moreover, support for IoT applications, such as voice recognition, machine monitoring, and so on, requires the ability to execute a wide range of machine learning (ML) workloads. This brings challenges in hardware (HW) design to build flexible processors operating in ULP regime. This article presents TinyVers, a tiny versatile ULP ML system-on-chip (SoC) to enable enhanced intelligence at the extreme edge. TinyVers exploits dataflow reconfiguration to enable multi-modal support and aggressive on-chip power management for duty cycling to enable smart sensing applications. The SoC combines an reduced instruction set computer-V (RISC-V) host processor, a 17-tera operations per second per watt (TOPS/W) dataflow reconfigurable ML accelerator, a 1.7- $\mu$ W deep sleep wake-up controller (WuC), and an embedded magnetoresistive random access memory (eMRAM) for boot code and ML parameter retention. The SoC can perform up to 17.6 giga operations per second (GOPS) while achieving a power consumption range from 1.7 $\mu$ W to 20 mW. Multiple ML workloads aimed for diverse applications are mapped on the SoC to showcase its flexibility and efficiency. All the models achieve 1–2 TOPS/W of energy efficiency with a power consumption below 230 $\mu$ W in continuous operation. In a duty-cycling use case for machine monitoring, this power is reduced to below 10 $\mu$ W.

30 October 2021 in Journal of Real-Time Image Processing
Verified
Journal Article
Closed access
PDF file
VJVikram Jain
Vikram Jain
NJNinad Jadhav
Ninad Jadhav
MVMarian Verhelst
Marian Verhelst

5 August 2024
Verified
Conference Paper
Open access
VJVikram Jain
Vikram Jain
WTWei Tang
Wei Tang
ZWZuoguo Wu
Zuoguo Wu
VSViansa Schmulbach
Viansa Schmulbach
SSSophia Shao
Sophia Shao
BNBorivoje Nikolic
Borivoje Nikolic
Heterogeneous chiplet integration and advanced packaging have given a new lease to scaling of compute in a post-Moore era. A critical aspect of designing chiplet systems is die-to-die interfaces for aggregation of smaller disaggregated chiplets. In recent years, interconnects and packaging have made a huge leap forward, thereby, enabling high bandwidth and energy-efficient parallel die-to-die (D2D) interfaces. Instead of bespoke solutions, building a standardized D2D interface provides a mechanism for interoperability between heterogeneous chiplets and facilitates low power and energy-efficient design by prescribing implementation strategy. In this paper, we discuss some of the recent efforts in the standardization of die-to-die interfaces. Starting with an overview of Advanced Interface Bus (AIB) PHY, we emphasize its simplicity and high energy efficiency. Followed by a case study that demonstrates an effective chiplet integration employing AIB. A more recent open standard for chiplet integration is the Universal Chiplet Interconnect Express (UCIe). We discuss the key aspects of UCIe, including its electrical and packaging characteristics, as well as low-power features that lead to a 10x power reduction compared to typical off-package I/O. Finally, we discuss the UCIe-lite controller, an effort to democratize the chiplet infrastructure by providing a simplified open-source RTL generator of the D2D interface. The generator is highly parameterizable and lightweight, enabling chiplet systems for energy-efficient applications.

6 June 2021
Verified
Conference Paper
Closed access
VJVikram Jain
Vikram Jain
LMLinyan Mei
Linyan Mei
MVMarian Verhelst
Marian Verhelst
Deep learning provides a wide range of neural networks (NNs) with varying accuracy and complexity, which can be mapped to a wide variety of specialized hardware accelerators. This results in a huge optimization space across energy, latency, area and task accuracy, complicating the assessment of which NNs, resp. which hardware architectures are most efficient as it strongly depends on the hardware platform, resp. suite of algorithms to support. The ultimate goal is to find hardware supporting a broad suite of NNs and to construct NNs which can be efficiently deployed on broad set of hardware platforms. This paper, therefore, brings 3 contributions: 1) an assessment methodology across a suite of networks and architectures; 2) deployment of this analysis for a set of architecture on popular networks for the ImageNet task; 3) derivation of insights from this study on characteristic of optimal architectures for modern NN models, and characteristic of optimal network topologies for modern processor architectures.