Tianhao Cai

Tianhao Cai

Auto-generated profile, based on publicly available information

Tianhao Cai

Beihang University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 May 2024 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
MHMeng Han
Meng Han
LWLiang Wang
Liang Wang
LXLimin Xiao
Limin Xiao
TCTianhao Cai
Tianhao Cai
ZWZeyu Wang
Zeyu Wang
CZChenhao Zhang
Chenhao Zhang
The systolic accelerator is one of the premier architectural choices for DNN acceleration. However, the conventional systolic architecture suffers from low PE utilization due to the mismatch between the fixed array and diverse DNN workloads. Recent studies have proposed flexible systolic array architectures to adapt to DNN models. However, these designs support only coarse-grained reshaping or significantly increase hardware overhead. In this study, we propose ReDas, a flexible and lightweight systolic array that supports dynamic fine-grained reshaping and multiple dataflows. First, ReDas integrates lightweight and reconfigurable roundabout data paths, which achieve fine-grained reshaping using only short connections between adjacent PEs. Second, we redesign the PE microarchitecture and integrate a set of multi-mode data buffers around the array. The PE structure enables additional data bypassing and flexible data switching. Simultaneously, the multi-mode buffers facilitate fine-grained reallocation of on-chip memory resources, adapting to various dataflow requirements. ReDas can dynamically reconfigure to up to 129 different logical shapes and 3 dataflows for a 128 × 128 array. Finally, we propose an efficient mapper to generate appropriate configurations for each layer of DNN workloads. Compared to the conventional systolic array, ReDas can achieve about 4.6× speedup and 8.3× energy-delay product (EDP) reduction.

10 May 2025 in arXiv
Verified
Preprint
Open access
PDF file
TCTianhao Cai
Tianhao Cai
LWLiang Wang
Liang Wang
LXLimin Xiao
Limin Xiao
MHMeng Han
Meng Han
ZWZeyu Wang
Zeyu Wang
XLXiaojian Liao
Xiaojian Liao
With the rapid development of DNN applications, multi-tenant execution, where multiple DNNs are co-located on a single SoC, is becoming a prevailing trend. Although many methods are proposed in prior works to improve multi-tenant performance, the impact of shared cache is not well studied. This paper proposes CaMDN, an architecture-scheduling co-design to enhance cache efficiency for multi-tenant DNNs on integrated NPUs. Specifically, a lightweight architecture is proposed to support model-exclusive, NPU-controlled regions inside shared cache to eliminate unexpected cache contention. Moreover, a cache scheduling method is proposed to improve shared cache utilization. In particular, it includes a cache-aware mapping method for adaptability to the varying available cache capacity and a dynamic allocation algorithm to adjust the usage among co-located DNNs at runtime. Compared to prior works, CaMDN reduces the memory access by 33.4% on average and achieves a model speedup of up to 2.56$\times$ (1.88$\times$ on average).

1 January 2026 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Verified
Journal Article
Closed access
HZHao Zhang
Hao Zhang
TCTianhao Cai
Tianhao Cai
LXLimin Xiao
Limin Xiao
MHMeng Han
Meng Han
XXXilong Xie
Xilong Xie
LWLiang Wang
Liang Wang