Tianyun Ma

Tianyun Ma

Auto-generated profile, based on publicly available information

Tianyun Ma

Institute of AI for Industries, Chinese Academy of Sciences

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 August 2025 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Verified
Journal Article
Closed access
YZYang Zhao
Yang Zhao
DHDi Huang
Di Huang
CLChongxiao Li
Chongxiao Li
PJPengwei Jin
Pengwei Jin
MSMuxin Song
Muxin Song
XHXing Hu
Xing Hu
The design flow of processors, particularly in hardware description languages (HDLs) like Verilog and Chisel, is complex and costly. While recent advances in large language models (LLMs) have significantly improved coding tasks in software languages such as Python, their application in HDL generation remains limited due to the scarcity of high-quality HDL data. Traditional methods of adapting LLMs for hardware design rely on synthetic HDL datasets, which often suffer from low quality because even advanced LLMs like GPT perform poorly in the HDL domain. Moreover, these methods focus solely on chat tasks and the Verilog language, limiting their application scenarios. In this article, we observe that: 1) HDL code collected from the real world is of higher quality than that generated by LLMs; 2) LLMs like GPT-3.5 excel in summarizing HDL code rather than generating it; and 3) an explicit language tag can help LLMs better adapt to the target language when there is insufficient data. Based on these observations, we propose an efficient LLM fine-tuning pipeline for HDL generation that integrates a multilevel summarization (MLS) data synthesis process with a novel Chat–FIM–Tag supervised fine-tuning method. The pipeline enhances the generation of HDL code from natural language descriptions and enables the handling of various tasks, such as chat and infilling incomplete code. Utilizing this pipeline, we introduce CodeV, a series of HDL generation LLMs. Among them, CodeV-All not only possesses a more diverse range of language abilities (Verilog and Chisel) and a broader scope of tasks (Chat and FIM), but also achieves performance on VerilogEval that is comparable to that of CodeV-Verilog fine-tuned on Verilog only, making them the first series of open-source LLMs designed for multiscenario HDL generation. The code, models, and dataset are available at https://github.com/IPRC-DIP/CodeV


3 October 2025 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Verified
Journal Article
Closed access
CLChongxiao Li
Chongxiao Li
DHDi Huang
Di Huang
PJPengwei Jin
Pengwei Jin
TMTianyun Ma
Tianyun Ma
HHHusheng Han
Husheng Han
QGQi Guo
Qi Guo
Customized processors are essential for domain-specific applications such as the Internet of Things (IoT) and multimedia embedded systems, yet their design often requires extensive expert intervention. Traditional approaches, including hardware design using encapsulated abstractions (e.g., Chisel) and high-level synthesis (HLS) from languages like C or SystemC, reduce some manual efforts but remain either costly or suboptimal. Recent explorations into leveraging large language models (LLMs) to generate register-transfer level (RTL) from natural language specifications have shown promise, but these methods still struggle with generating complex and high-performance processors, mainly due to the complicated low-level details in the RTL code. In this work, we introduce AGON, a novel framework designed to facilitate the development of customized processor RTL from instruction set architecture (ISA) documents using LLMs. The framework comprises two layers: a functional description layer and a hardware implementation layer. At the functional layer, AGON employs a nano-operator (nOP)-based intermediate representation (IR) that abstracts basic instruction operations, thereby reducing the semantic gap between natural language and the RTL code. This abstraction significantly shortens the descriptive code required for LLM generation, improving the generation accuracy in a single pass. At the hardware layer, AGON offers three abstraction levels (i.e., instruction, ISA, and processor) along with rule-based primitives to systematically lower the nOP-based IR into a fully optimized processor implementation. This decoupled design not only ensures correctness-by-construction but also enables automated, power, performance, and area (PPA)-aware performance optimization. We evaluate AGON by designing high-performance out-of-order (OoO) processors that correctly execute practical programs. Experimental results demonstrate that processors generated with AGON achieve an average speed of $4.51\times $ on specific tasks compared to expert-designed general-purpose central processing units (CPUs) while requiring minimal design effort.

13 October 2026 in ACM Transactions on Architecture and Code Optimization
Verified
Journal Article
Open access
TMTianyun Ma
Tianyun Ma
QWQian Wang
Qian Wang
SLShengwen Liang
Shengwen Liang
YCYunke Cai
Yunke Cai
ZNZiyuan Nan
Ziyuan Nan
TCTianshi Chen
Tianshi Chen
Deploying advanced large language models on edge devices, such as smartphones and robotics, is a growing trend that enhances user data privacy and network connectivity resilience while preserving intelligent capabilities. However, such a task exhibits single-batch computing with incredibly low arithmetic intensity, which poses significant challenges of huge memory footprint and bandwidth demands on limited edge resources. To address these issues, we introduce Cambricon-FlexLLM, a chiplet-based hybrid architecture with an NPU and a dedicated NAND flash chip to enable efficient on-device inference of 70B LLMs. Such a hybrid architecture utilizes both the high computing capability of NPU and the data capacity of the NAND flash chip, with the proposed hardware-tiling strategy that minimizes the data movement overhead between NPU and NAND flash chip. Specifically, the NAND flash chip, enhanced by our innovative in-flash computing and on-die ECC techniques, excels at performing precise lightweight on-die processing. Simultaneously, the NPU collaborates with the flash chip for matrix operations and handles special function computations beyond the flash’s on-die processing capabilities. Furthermore, to exploit the activation sparsity prevalent in modern LLMs, we propose a co-activation neuron-inspired weight-reordering algorithm and a sparsity-aware dynamic partitioning scheme. These optimizations significantly reduce the transfer of ineffective weight data. Experimental results demonstrate that Cambricon-FlexLLM achieves an inference speed of 3.44 tokens/s for 70B LLMs and 36.34 tokens/s for 7B LLMs, outperforming state-of-the-art flash-offloading frameworks by 22×–45×. Leveraging activation sparsity, Cambricon-FlexLLM achieves an additional 1.7× average speedup, ranging from 1.3× to 2.0× compared with dense inference. These results show a path toward local 70B-class decode for privacy-sensitive, offline, and fallback use cases on resource-constrained edge devices, while also highlighting the need to manage prefill latency, energy, thermal behavior, and shared-storage constraints.

24 August 2026
Verified
Book Chapter
Closed access
PDF file
HHHusheng Han
Husheng Han
DHDi Huang
Di Huang
TMTianyun Ma
Tianyun Ma
XZXinyao Zheng
Xinyao Zheng
JMJianan Mu
Jianan Mu
QGQi Guo
Qi Guo

13 August 2024 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Verified
Journal Article
Closed access
TMTianyun Ma
Tianyun Ma
YWYuanbo Wen
Yuanbo Wen
XSXinkai Song
Xinkai Song
PJPengwei Jin
Pengwei Jin
DHDi Huang
Di Huang
QGQi Guo
Qi Guo
Symbolic regression (SR), the process of formulating a mathematical expression based on observed data points, is a fundamental task in artificial intelligence but is often hindered by its intense computational demands. Deep-learning-based SR methods (DSR) aim to alleviate these demands by breaking down the SR process into two stages: 1) neural network (NN) inference and 2) Broyden-Fletcher–Goldfarb-Shanno (BFGS) optimization. Although NN accelerators can expedite the NN stage, the performance of the BFGS optimization is compromised due to its poor performance for the variety of transcendental functions. Moreover, the distinct computational characteristics of NN inference and BFGS cause not only low hardware utilization but also significant area waste. To address these issues, we propose Harmonia, a unified architecture with the neural transcendental function unit (NTFU) and the Unified Array for efficient DSR. The NTFU utilizes the radial basis function network (RBFN) as a universal approximator for various transcendental functions, which significantly reduces the heavy transcendental function computation cost. We further propose an efficient training algorithm called random nonlinear optimization (RNO) to obtain a lightweight RBFN without accuracy loss. Moreover, Harmonia supports configurable dataflow which integrates the two computing stages into the Unified Array. Experimental results show that Harmonia achieves hardware utilization of 83.83%, on average. Compared to the GPU baseline, Harmonia achieves $4.8\times $ speedup and $47.6\times $ energy saving, alongside considerable low area cost.