Jiacheng Zhao

Jiacheng Zhao

Auto-generated profile, based on publicly available information

Jiacheng Zhao

State Key Lab of Processors, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 June 2015 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JZJiacheng Zhao
Jiacheng Zhao
HCHuimin Cui
Huimin Cui
JXJingling Xue
Jingling Xue
XFXiaobing Feng
Xiaobing Feng
Despite their widespread adoption in cloud computing, multicore processors are heavily under-utilized in terms of computing resources. To avoid the potential for negative and unpredictable interference, co-location of a latency-sensitive application with others on the same multicore processor is disallowed, leaving many cores idle and causing low machine utilization. To enable co-location while providing QoS guarantees, it is challenging but important to predict performance interference between co-located applications. We observed that the performance degradation of an application can be represented as a piecewise predictor function of the aggregate pressures on shared resources from all cores. Based on this observation, we propose to adopt regression analysis to build a predictor function for an application. Furthermore, the prediction model thus obtained for an application is able to characterize its contentiousness and sensitivity. Validation using a large number of single-threaded and multi-threaded benchmarks and nine real-world datacenter applications on two different platforms shows that our approach is also precise, with an average error not exceeding 0.4 percent.

27 April 2024
Verified
Conference Paper
Open access
FYFeng Yu
Feng Yu
GLGuangli Li
Guangli Li
JZJiacheng Zhao
Jiacheng Zhao
HCHuimin Cui
Huimin Cui
XFXiaobing Feng
Xiaobing Feng
JXJingling Xue
Jingling Xue
In recent times, dynamic-shape neural networks have gained widespread usage in intelligent applications to address complex tasks, introducing challenges in optimizing tensor programs due to their dynamic nature. As the operators' shapes are determined at runtime in dynamic scenarios, the compilation process becomes expensive, limiting the practicality of existing static-shape tensor compilers. To address the need for effective and efficient optimization of dynamic-shape neural networks, this paper introduces MikPoly, a novel dynamic-shape tensor compiler based on micro-kernel polymerization. MikPoly employs a two-stage optimization approach, dynamically combining multiple statically generated micro-kernels using a lightweight cost model based on the shape of a tensor operator known at runtime. We evaluate the effectiveness of MikPoly by employing popular dynamic-shape operators and neural networks on two representative accelerators, namely GPU Tensor Cores and Ascend NPUs. Our experimental results demonstrate that MikPoly effectively optimizes dynamic-shape workloads, yielding an average performance improvement of 1.49× over state-of-the-art vendor libraries.

17 April 2024
Verified
Conference Paper
Open access
CXChunwei Xia
Chunwei Xia
JZJiacheng Zhao
Jiacheng Zhao
QSQianqi Sun
Qianqi Sun
Zheng WangZheng Wang
Zheng Wang
YWYuan Wen
Yuan Wen
HCHuimin Cui
Huimin Cui
Optimizing deep neural network (DNN) execution is important but becomes increasingly difficult as DNN complexity grows. Existing DNN compilers cannot effectively exploit optimization opportunities across operator boundaries, leaving room for improvement. To address this challenge, we present Souffle, an open-source compiler that optimizes DNN inference across operator boundaries. Souffle creates a global tensor dependency graph using tensor expressions, traces data flow and tensor information, and partitions the computation graph into subprograms based on dataflow analysis and resource constraints. Within a subprogram, Souffle performs local optimization via semantic-preserving transformations, finds an optimized program schedule, and improves instruction-level parallelism and data reuse. We evaluated Souffle using six representative DNN models on an NVIDIA A100 GPU. Experimental results show that Souffle consistently outperforms six state-of-the-art DNN optimizers by delivering a geometric mean speedup of up to 3.7× over TensorRT and 7.8× over Tensorflow XLA.

1 March 2025
Verified
Conference Paper
Open access
ZZZhongcheng Zhang
Zhongcheng Zhang
YLYing Liu
Ying Liu
YZYuyang Zhang
Yuyang Zhang
ZCZhenchuan Chen
Zhenchuan Chen
JZJiacheng Zhao
Jiacheng Zhao
JXJingling Xue
Jingling Xue
Fully Homomorphic Encryption (FHE), particularly the CKKS scheme, enables computation on encrypted data, facilitating secure task offloading to untrusted servers. CKKS allows packing multiple complex values into a single ciphertext, crucial for fixed-point arithmetic in machine learning, while leveraging SIMD parallelism at the plaintext level. However, operations such as reductions can degrade performance by creating a large number of bubbles (or gaps) in intermediate ciphertexts, leading to wasted computational resources. We introduce Qiwu, a ciphertext-level vectorization approach that enhances performance by fusing multiple ciphertexts containing bubbles. Qiwu uses a DSL to specify zero bubbles in input ciphertexts and nonzero bubbles in output ciphertexts, employs data-flow analysis to track them, and formulates a fusion plan guided by a cost-benefit assessment. Implemented in an existing FHE compiler, Qiwu was evaluated on four applications (including three machine learning tasks) and three kernels. It achieves speedups of up to 18.0× on CPUs, averaging 3.4× (geometric mean), compared to the state-of-the-art compiler that exploit only plaintext-level parallelism.

1 January 2024
Verified
Conference Paper
Open access
PDF file
SZShuoming Zhang
Shuoming Zhang
JZJiacheng Zhao
Jiacheng Zhao
CXChunwei Xia
Chunwei Xia
Zheng WangZheng Wang
Zheng Wang
YCYunji Chen
Yunji Chen
HCHuimin Cui
Huimin Cui
Shuoming Zhang, Jiacheng Zhao, Chunwei Xia, Zheng Wang, Yunji Chen, Huimin Cui. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024.

9 January 2026 in CCF Transactions on High Performance Computing
Verified
Journal Article
Closed access
PDF file
SZShuoming Zhang
Shuoming Zhang
JZJiacheng Zhao
Jiacheng Zhao
QYQiuchu Yu
Qiuchu Yu
CXChunwei Xia
Chunwei Xia
Zheng WangZheng Wang
Zheng Wang
HCHuimin Cui
Huimin Cui