30 October 2023 in IEEE Transactions on Circuits and Systems II: Express Briefs
Radar-based human activity recognition (HAR) has great potential in many applications. The deployment of HAR in many practical applications requires the system to be energy-resource efficient. In this work, we propose a lightweight dedicated hardware accelerator for radar-based HAR. In particular, the specific property of radar signals are taken advantages of to optimize the 1-D convolutional neural network (CNN) model for HAR. Based on that, a dedicated hardware architecture is further proposed to exploit the advantages of the optimized CNN model. We build a prototype system on field programmable gate array (FPGA) to validate and demonstrate the proposed design. We also map the proposed accelerator to 55nm CMOS technology. Experimental results show that the performance as well as the energy-resource efficiency of the proposed design are significantly higher than other existing vision-based HAR systems.
30 December 2022 in IEEE Transactions on Circuits and Systems I: Regular Papers
This work presents an energy-efficient accelerator for medical image reconstruction from implicit neural representation (INR). The accelerator implements an INR-based algorithm to deliver high-quality medical image reconstruction with arbitrary resolution from a compact implicit format. In particular, we propose a dedicated hardware architecture based on an optimized computation flow for the INR-based reconstruction algorithm, which co-designs data reuse and computation load. The proposed architecture takes in the coordinate of the intersection of three scans and outputs all the voxel intensities, minimizing the data movement between on-chip and off-chip. To validate the proposed accelerator, we build a proof-of-concept prototype demonstration system using field programmable gate array (FPGA). We also map our design to 40nm CMOS technology to measure the performance of the proposed accelerator. The implementation results show that, running at 400MHz, the proposed accelerator is capable of processing medical images with $256\times 256$ resolution in real-time at 26.3 frames per second (FPS), with a power consumption of only 795 mW. Comparison results show that the performance, as well as the energy efficiency of the proposed accelerator, outperforms the central processing unit (CPU)-based and graphic processing unit (GPU)-based implementations.
20 July 2023 in IEEE Transactions on Circuits and Systems I: Regular Papers
Neural Radiance Field (NeRF), a disruptive method for 3D representation and rendering, is extremely popular in the field of computer graphics and computer vision in the past three years. The most distinctive feature of NeRF models is their scene representation property, making it possible to quantize the models according to the complexity of the representing scenes. This paper proposes a novel approach to improve the efficiency of NeRF rendering by adopting precision-scalable computation. We first analyze and validate the idea of scene-dependent quantization for NeRF models. Based on that, we further propose look-up table (LUT) processing element (PE)-based precision-scalable computation unit designs. To evaluate the performance of different precision-scalable computing units, we implement these designs and compare the corresponding area, power, speed and energy efficiency. We also compare the proposed designs with existing approaches as well as the fixed precision approach for NeRF rendering tasks. The comparison results show that energy efficiency can be significantly improved by using precision-scalable computation for NeRF.
14 March 2023 in IEEE Transactions on Circuits and Systems II: Express Briefs
This paper presents a low-power, fully reconfigurable finite impulse response (FIR) filter structure based on common operation sharing. Different from existing multiplexer(MUX)-based designs, the decoding of coefficients and compensation of negative-coefficient errors, which are the common operations for all the taps, are implemented by shared modules to reduce the overall hardware complexity. To validate the proposed structure, a proof-of-concept reconfigurable FIR filter is implemented and fabricated using 40 nm CMOS technology. Chip measurement results show that the proposed design is superior to existing methods in area-delay product and power performance, making it suitable for low-power filtering applications. The idea of sharing common operations for all taps can benefit the existing MUX-based filter techniques for further improvement of power and circuit complexity.
3 June 2025 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Neural rendering, a transformative approach for 3-D scene reconstruction and rendering, has advanced rapidly in recent years. This article introduces an energy-efficient neural rendering coprocessor that implements the popular and widely used instant neural graphics primitive (Instant-NGP) algorithm. In particular, we address the challenges of limited resources for deploying Instant-NGP on edge by proposing a dedicated architecture, which incorporates three main innovations: 1) we optimize occupancy grid queries in the ray marching module by partitioning the grid and decoupling the query process from sampling point generation, which improves both efficiency and memory usage; 2) we introduce a bilinked list-based ray switching strategy, which ensures continuous pipeline utilization to overcome the inefficiencies caused by sequential processing; and 3) we optimize the hash encoding process by incorporating quantization-aware training (QAT), enabling the hash table to fit into on-chip memory, thereby improving performance on resource-constrained devices. To demonstrate the effectiveness of our architecture, we design and fabricate a proof-of-concept chip using 40-nm CMOS technology and develop a testing system to evaluate its performance. Measurement results validate the advantages of the proposed design, showing that our chip achieves superior energy efficiency compared to both server and edge graphics processing units (GPUs), as well as other state-of-the-art neural rendering chip designs.