Taiquan Wei

Taiquan Wei

Auto-generated profile, based on publicly available information

Taiquan Wei

School of Integrated Circuits, Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 June 2025
Verified
Conference Paper
Open access
QYQize Yang
Qize Yang
TWTaiquan Wei
Taiquan Wei
SGSihan Guan
Sihan Guan
CLChengran Li
Chengran Li
HSHaoran Shang
Haoran Shang
YHYang Hu
Yang Hu


4 November 2025
Verified
Book Chapter
Closed access
PDF file
QYQize Yang
Qize Yang
JLJiaxin Liu
Jiaxin Liu
TWTaiquan Wei
Taiquan Wei
YJYuxin Jin
Yuxin Jin
SYShouyi Yin
Shouyi Yin
YHYang Hu
Yang Hu

4 November 2025
Verified
Book Chapter
Closed access
PDF file
TWTaiquan Wei
Taiquan Wei
HWHuizheng Wang
Huizheng Wang
ZWZichuan Wang
Zichuan Wang
SYShouyi Yin
Shouyi Yin
YHYang Hu
Yang Hu

24 December 2025 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
HWHuizheng Wang
Huizheng Wang
TWTaiquan Wei
Taiquan Wei
HWHongbin Wang
Hongbin Wang
ZWZichuan Wang
Zichuan Wang
XTXinru Tang
Xinru Tang
SYShouyi Yin
Shouyi Yin
Large language models (LLMs) rely on self-attention for contextual understanding, demanding high-throughput inference and large-scale token parallelism (LTPP). Existing dynamic sparsity accelerators falter under LTPP scenarios due to stage-isolated optimizations. Revisiting the end-to-end sparsity acceleration flow, we identify an overlooked opportunity: cross-stage coordination can substantially reduce redundant computation and memory access. We propose STAR, a cross-stage compute- and memory-efficient algorithm–hardware co-design tailored for Transformer inference under LTPP. STAR introduces a leading-zero-based sparsity prediction using log-domain add-only operations to minimize prediction overhead. It further employs distributed sorting and a sorted updating FlashAttention mechanism, guided by a coordinated tiling strategy that enables fine-grained stage interaction for improved memory efficiency and latency. These optimizations are supported by a dedicated STAR accelerator architecture, achieving up to $9.2\times$ speedup and $71.2\times$ energy efficiency over A100, and surpassing SOTA accelerators by up to $16.1\times$ energy and $27.1\times$ area efficiency gains. Further, we deploy STAR onto a multi-core spatial architecture, optimizing dataflow and execution orchestration for ultra-long sequence processing. Architectural evaluation shows that, compared to the baseline design, Spatial-STAR achieves a $20.1\times$ throughput improvement.

12 September 2025 in arXiv
Verified
Preprint
Open access
PDF file
HWHuizheng Wang
Huizheng Wang
ZWZichuan Wang
Zichuan Wang
ZYZhiheng Yue
Zhiheng Yue
YLYousheng Long
Yousheng Long
TWTaiquan Wei
Taiquan Wei
SYShouyi Yin
Shouyi Yin
Large language models (LLMs) face significant inference latency due to inefficiencies in GEMM operations, weight access, and KV cache access, especially in real-time scenarios. This highlights the need for a versatile compute-memory efficient accelerator. Unfortunately, existing Transformer accelerators struggle to address both aspects simultaneously, as they focus on value-level processing, missing fine-grained opportunities to optimize computation and memory collaboratively. This paper introduces MCBP, a bit-grained compute-memory efficient algorithm-hardware co-design that leverages bit-slice (BS) enabled repetitiveness and sparsity to accelerate LLM inference. MCBP features three key innovations: 1) BS-repetitiveness-enabled computation reduction (BRCR), which eliminates redundant GEMM computations via leveraging redundancy hidden among BS vectors; 2) BS-sparsity-enabled two-state coding (BSTC), which reduces weight access via exploiting significant sparsity in high-order bit-slice weight; 3) Bit-grained progressive prediction (BGPP), which reduces KV cache access by leveraging early-termination-based bit-grained prediction. These techniques, supported by custom accelerator designs, effectively alleviate the burden in GEMM, weight access, and KV cache access. Extensive experiments on 26 benchmarks show that MCBP achieves 9.43x speed up and 31.1x higher energy efficiency than Nvidia A100 GPU. Compared to SOTA Transformer accelerators, MCBP achieves 35x, 5.2x and 3.2x energy saving than Spatten, FACT and SOFA, respectively.