Dongjoo Shin

Dongjoo Shin

Auto-generated profile, based on publicly available information

Dongjoo Shin

School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 October 2018 in IEEE Journal of Solid-State Circuits
Verified
Journal Article
Closed access
JLJinmook Lee
Jinmook Lee
CKChanghyeon Kim
Changhyeon Kim
SKSanghoon Kang
Sanghoon Kang
DSDongjoo Shin
Dongjoo Shin
SKSangyeob Kim
Sangyeob Kim
HYHoi-Jun Yoo
Hoi-Jun Yoo
An energy-efficient deep neural network (DNN) accelerator, unified neural processing unit (UNPU), is proposed for mobile deep learning applications. The UNPU can support both convolutional layers (CLs) and recurrent or fully connected layers (FCLs) to support versatile workload combinations to accelerate various mobile deep learning applications. In addition, the UNPU is the first DNN accelerator ASIC that can support fully variable weight bit precision from 1 to 16 bit. It enables the UNPU to operate on the accuracy-energy optimal point. Moreover, the lookup table (LUT)-based bit-serial processing element (LBPE) in the UNPU achieves the energy consumption reduction compared to the conventional fixed-point multiply-and-accumulate (MAC) array by 23.1%, 27.2%, 41%, and 53.6% for the 16-, 8-, 4-, and 1-bit weight precision, respectively. Besides the energy efficiency improvement, the unified DNN core architecture of the UNPU improves the peak performance for CL by 1.15x compared to the previous work. It makes the UNPU operate on the lower voltage and frequency for the given DNN to increase energy efficiency. The UNPU is implemented in 65-nm CMOS technology and occupies the 4 x 4 mm² die area. The UNPU can operates from 0.63- to 1.1-V supply voltage with maximum frequency of 200 MHz. The UNPU has peak performance of 345.6 GOPS for 16-bit weight precision and 7372 GOPS for 1-bit weight precision. The wide operating range of UNPU makes the UNPU achieve the power efficiency of 3.08 TOPS/W for 16-bit weight precision and 50.6 TOPS/W for 1-bit weight precision. The functionality of the UNPU is successfully demonstrated on the verification system using ImageNet deep CNN (VGG-16).

9 September 2020 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
JLJinsu Lee
Jinsu Lee
SKSanghoon Kang
Sanghoon Kang
JLJinmook Lee
Jinmook Lee
DSDongjoo Shin
Dongjoo Shin
DHDonghyeon Han
Donghyeon Han
HYHoi-Jun Yoo
Hoi-Jun Yoo
Deep neural network (DNN) has been widely studied due to its high performance and usability for various applications such as image classification, detection, segmentation, translation, and action recognition. Thanks to the universal applications and high performance of DNN algorithm, DNN is adopted for various AI platforms, including edge/mobile devices as well as cloud servers. However, high-performance DNN requires a large amount of computation and memory access, making it challenging to implement DNN operation on edge/mobile. There have been several ways to solve these problems, including algorithms as well as hardware for DNN. Algorithms that help accelerate DNN in hardware enable much more efficient operation of high-performance AI. This article aims to provide an overview of the recent hardware and algorithm co-design schemes enabling efficient processing of DNNs. Specifically, it will provide algorithm optimization methods for DNN structure, neurons, synapses, and data types. This paper also introduces optimization methods for hardware architectures, PE array, data-path control, and microarchitecture of PE. And we will also show examples of DNN algorithm and hardware co-designed ASICs.

27 February 2019 in Proceedings of the IEEE
Verified
Journal Article
Closed access
DSDongjoo Shin
Dongjoo Shin
HYHoi-Jun Yoo
Hoi-Jun Yoo
Today's CPUs are general-purpose processors, which have the von Neumann architecture (including the Harvard architectures) to maximize the generality and programmability. On the other hand, application-specific integrated circuits (ASICs) have domain-specific architectures to optimize the cost-effective performance but show very low generality. The combination of generality and ASIC, which usually seemed to have no contact, is expected to be enabled by deep learning (DL). DL, realized with deep neural networks (DNNs), has changed the paradigm of machine learning (ML) and brought significant progress in vision, speech, language processing, and many other applications. DNNs have special features that can be efficiently implemented with dedicated architectures, ASICs. Sharing their special features, DNNs have a wide variety of network architectures, and even the same network architecture can be used for different applications depending on the weight parameters. This paper aims to provide the necessity, validity, and characteristics of the ML-specific integrated circuits (MSICs) that have a different architecture from the von Neumann architecture. MSICs can avoid the overhead from the complex instruction set, instruction decoder, multilevel caches, and branch prediction of the recent von Neumann architecture processors designed for high generality and programmability. We will also discuss the necessity and validity of a heterogeneous architecture in MSIC, starting from the differences between the visual-type information processing and the vector-type information processing, and show the chip implementation results.

1 November 2017
Verified
Conference Paper
Closed access
JLJinmook Lee
Jinmook Lee
DSDongjoo Shin
Dongjoo Shin
HYHoi-Jun Yoo
Hoi-Jun Yoo
A 21mW low-power embedded Recurrent Neural Network (RNN) accelerator is proposed to realize the image captioning applications. The low-power RNN operation is achieved by 3 key features: 1) Quantization-table-based matrix multiplication with RNN weight quantization, 2) Dynamic quantization-table allocation scheme for balanced pipelined RNN operation, and 3) Zero-skipped RNN operation using quantization-table. The Quantization table enables the 98% reduction of the multiplier operations by replacing the multiplication to the table reference. The dynamic quantization-table allocation is used to achieve high chip-utilization efficiency over 90% by balanced pipeline operation for three variations of the RNN operation. The zero-skipped RNN operation reduces the overall 27% of required external memory bandwidth and quantization-table operations without any additional hardware cost. The proposed RNN accelerator of 1.84mm2 achieves 21mW power consumption and demonstrates its functionality on the image captioning RNN in 65nm CMOS process.

1 April 2017
Verified
Conference Paper
Closed access
DSDongjoo Shin
Dongjoo Shin
JLJinmook Lee
Jinmook Lee
JLJinsu Lee
Jinsu Lee
JLJuhyoung Lee
Juhyoung Lee
HYHoi-Jun Yoo
Hoi-Jun Yoo
An energy-efficient deep learning processor is proposed for convolutional neural networks (CNNs) and recurrent neural networks (RNNs) in mobile platforms. The 16mm 2 chip is fabricated using 65nm technology with 3 key features, 1) Reconfigurable heterogeneous architecture to support both CNNs and RNNs, 2) LUT-based reconfigurable multiplier optimized for dynamic fixed-point with the on-line adaptation, 3) Quantization table-based matrix multiplication to reduce off-chip memory access and remove duplicated multiplications. As a result, compared to the [2] and [3], this work shows 20× and 4.5× higher energy efficiency, respectively. Also, DNPU shows 6.5× higher energy efficiency compared to the [5].

11 October 2017 in IEEE Micro
Verified
Journal Article
Closed access
YKYouchang Kim
Youchang Kim
DSDongjoo Shin
Dongjoo Shin
JLJinsu Lee
Jinsu Lee
HYHoi-Jun Yoo
Hoi-Jun Yoo
Autonomous robots are actively studied for many unmanned applications, however, the heavy computational costs and limited battery capacity make it difficult to implement intelligent decision making in robots. In this article, the authors propose a low-power deep search engine (code-named “BRAIN”) for real-time path planning of intelligent autonomous robots. To achieve low power consumption while maintaining high performance, BRAIN adopts a multithreaded core architecture with a transposition table cache to detect and avoid duplicated searches between the processors at the deeper level of the search tree. In addition, dynamic voltage and frequency scaling is adopted to minimize power consumption without any loss of performance because the workload is gradually decreasing while approaching the target position. BRAIN achieves fast search speed (470,000 searches per second) and low energy consumption (79 nJ per search), and it is successfully applied to the robots for autonomous navigation without any collision in dynamic environments.