Shengen Yan

Shengen Yan

Auto-generated profile, based on publicly available information

Shengen Yan

Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

1 March 2014
Verified
Conference Paper
Closed access
CLChao Li
Chao Li
YYYi Yang
Yi Yang
HDHongwen Dai
Hongwen Dai
SYShengen Yan
Shengen Yan
FMFrank Mueller
Frank Mueller
HZHuiyang Zhou
Huiyang Zhou
On-chip caches are commonly used in computer systems to hide long off-chip memory access latencies. To manage on-chip caches, either software-managed or hardware-managed schemes can be employed. State-of-art accelerators, such as the NVIDIA Fermi or Kepler GPUs and Intel's forthcoming MIC “Knights Landing” (KNL), support both software-managed caches, aka. shared memory (GPUs) or near memory (KNL), and hardware-managed L1 data caches (D-caches). Furthermore, shared memory and the L1 D-cache on a GPU utilize the same physical storage and their capacity can be configured at runtime (same for KNL). In this paper, we present an in-depth study to reveal interesting and sometimes unexpected tradeoffs between shared memory and the hardware-managed L1 D- caches in GPU architecture. In our study, the kernels utilizing the L1 D-caches are generated from those leveraging shared memory to ensure that the same optimizations such as tiling are applied equally in both versions. Our detailed analyses reveal that rather than cache hit rates, the following tradeoffs often have more profound performance impacts. On one hand, the kernels utilizing the L1 caches may support higher degrees of thread-level parallelism, offer more opportunities for data to be allocated in registers, and sometimes result in lower dynamic instruction counts. On the other hand, the applications utilizing shared memory enable more coalesced accesses and tend to achieve higher degrees of memory-level parallelism. Overall, our results show that most benchmarks perform significantly better with shared memory than the L1 D-caches due to the high impact of memory-level parallelism and memory coalescing.


27 October 2025
Verified
Conference Paper
Open access
ZYZhihang Yuan
Zhihang Yuan
SWSiyuan Wang
Siyuan Wang
YSYuzhang Shang
Yuzhang Shang
HZHanling Zhang
Hanling Zhang
TFTongcheng Fang
Tongcheng Fang
YWYu Wang
Yu Wang


23 June 2024
Verified
Conference Paper
Open access
JMJinming Ma
Jinming Ma
XLXiuhong Li
Xiuhong Li
ZWZihan Wang
Zihan Wang
XZXingcheng Zhang
Xingcheng Zhang
SYShengen Yan
Shengen Yan
DLDahua Lin
Dahua Lin
As deep learning empowers various fields, many domain-specific non-neural network operators have been proposed to improve the accuracy of deep learning models. Researchers often use the imperative programming diagram (PyTorch) to express these new operators, leaving the fusion optimization of these operators to deep learning compilers. Unfortunately, the inherent side effects introduced by imperative tensor programs, especially tensor-level mutations, often make optimization extremely difficult. Previous works either fail to eliminate the side effects of tensor-level mutations or require programmers to manually analyze and transform them. In this paper, we present a holistic functionalization approach (TensorSSA) to optimizing imperative tensor programs beyond control flow boundaries. We first introduce TensorSSA intermediate representation for removing tensor-level mutation and expanding the scope and ability of operator fusion. Based on TensorSSA IR, we propose a TensorSSA conversion algorithm that performs functionalization crossing the boundary of control flow. TensorSSA achieves a 1.79X (1.34X on average) speedup in representative deep learning tasks than state-of-the-art works.