The existing von Neumann architecture for artificial intelligence (AI) computations suffers from excessive power consumption and memory bottlenecks. As an alternative, compute-in-memory (CIM) technology has been emerging. Among various CIM device candidates, split-gate NOR flash offers advantages such as a high density and low on-state current, enabling low-power operation, and benefiting from a high level of technological maturity. To achieve high energy efficiency and high accuracy in CIM inference chips, it is necessary to optimize device design by targeting low power consumption at the device level and surpassing baseline accuracy at the system level. In split-gate NOR flash, significant factors that can cause CIM inference accuracy drop are the device conductance variation, caused by floating gate charge variation, and a low on-off current ratio. Conductance variation generally has a trade-off relationship with the on-current, which greatly affects CIM dynamic power consumption. In this paper, we propose strategies for designing optimal devices by adjusting oxide thickness and other structural parameters. As a result of setting Tox,FG to 13.4 nm, TIPO to 4.6 nm and setting other parameters to optimal points, the design achieves erase on-current below 2 μA, program on-current below 10 pA, and off-current below 1 pA, while maintaining an inference accuracy of over 92%.
8 October 2024 in IEEE Transactions on Electron Devices
Two-transistor-zero-capacitor (2T0C) DRAM cell has been proposed and extensively investigated as a memory device for processing-in-memory (PIM) applications. In this two-part article, we propose a novel vertical-transistor on the gate (VTG) 2T0C DRAM cell structure and the refresh technique for PIM applications and demonstrate their effectiveness. We described the improved retention characteristics of VTG DRAM in Part I. In Part II, we introduce the adaptive layer-wise refresh technique to minimize refresh energy consumption while maintaining the inference accuracy. Additionally, we developed a customized simulation framework to evaluate the inference accuracy and hardware performance of the 2T0C DRAM-based PIM macro. Through the simulations reflecting the device characteristics extracted in Part I, the layer-wise refresh technique can achieve the same inference accuracy of 92% and 91%, with refresh energy consumption reduced by 22.9% and 16% respectively, compared to the conventional refresh method.