18 August 2017 in IEEE Design & Test
Accelerating convolutional neural networks (CNNs) is becoming more and more important due to their ever-in-creasing range of applications, e.g., image and video classification in data centers. Based on the observations that the significant amount of weights and activations in CNNs can be zero without losing quality, we propose a novel zero-aware hardware accelerator for CNNs named ZeNA, which exploits both zero weights and activations. Moreover, we report zero-induced load imbalance problems at two levels of scale in a zero-aware parallel CNN accelerator and present zero-aware kernel allocation and dynamic work group allocation as solutions. According to our experiments with a cycle-accurate simulation model, RTL, and layout design, ZeNA achieves 4.4×/2× (AlexNet) and 5.6×/2.4× (VGG-16) speedup compared to an existing state-of-the-art zero-agnostic/zero-activation-aware accelerator.
22 March 2018 in ACM Transactions on Architecture and Code Optimization
This article proposes Benzene, an energy-efficient distributed SRAM/STT-RAM hybrid cache for manycore systems running multiple applications. It is based on the observation that a naïve application of hybrid cache techniques to distributed caches in a manycore architecture suffers from limited energy reduction due to uneven utilization of scarce SRAM. We propose two-level optimization techniques: intra-bank and inter-bank. Intra-bank optimization leverages highly associative cache design, achieving more uniform distribution of writes within a bank. Inter-bank optimization evenly balances the amount of write-intensive data across the banks. Our evaluation results show that Benzene significantly reduces energy consumption of distributed hybrid caches.