Taehyeong Park

Taehyeong Park

Auto-generated profile, based on publicly available information

Taehyeong Park

Yonsei University, Seoul, Republic of Korea

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2025
Verified
Conference Paper
Open access
HKHyeoncheol Kim
Hyeoncheol Kim
TKTaehoon Kim
Taehoon Kim
TPTaehyeong Park
Taehyeong Park
DKDonghyeon Kim
Donghyeon Kim
YYYongseung Yu
Yongseung Yu
YPYongjun Park
Yongjun Park
Real-time processing of deep learning models on conventional systems, such as CPUs and GPUs, is highly challenging due to memory bottlenecks. This is exacerbated in Large Language Models (LLMs), where the majority of executions are dominated by General Matrix Multiplication (GEMM) operations, which are relatively more memory-intensive than convolution operations. Processing-in-Memory (PIM), which provides high internal bandwidth, can be a promising alternative for LLM serving. However, since current PIM systems do not fully replace traditional memory, data transfer between the host and PIM-side memory is essential. Therefore, minimizing the transfer cost between the host and PIM is crucial for serving LLMs efficiently on the PIM. In this paper, we propose PIM-LLM, an end-to-end framework that accelerates LLMs using an efficient tiled GEMM library and several key target-aware optimizations on real-world PIM systems. We first propose PGEMMlib, which provides optimized tiling techniques for PIM, considering architecture specific characteristics to minimize unnecessary data transfer overhead and maximize parallelism. In addition, Tile-Selector explores optimized parameters and techniques for different GEMM shapes and available resources of PIM systems using an analytical model. To accelerate LLMs using PGEMMlib, we integrate it into the TVM deep learning compiler framework. We further optimize the LLM execution by applying several key optimizations: Build-time memory layout adjustment, PIM resource pooling, CPU/PIM cooperation support, and QKV generation fusion. Evaluation shows that PIM-LLM achieves significant performance gains of up to 45.75x over the TVM baseline for several well-known LLMs. We strongly believe that this work provides key insights for efficient LLM serving on real PIM devices.

8 June 2025
Verified
Conference Paper
Open access
IHInyong Hwang
Inyong Hwang
DKDonghyeon Kim
Donghyeon Kim
SKSeokwon Kang
Seokwon Kang
TPTaehyeong Park
Taehyeong Park
TKTaehoon Kim
Taehoon Kim
YPYongjun Park
Yongjun Park


10 November 2025
Verified
Conference Paper
Open access
MJMyung-Hwan Jang
Myung-Hwan Jang
MSMin-Kyeong Shin
Min-Kyeong Shin
TPTaehyeong Park
Taehyeong Park
YPYongjun Park
Yongjun Park
SKSang-Wook Kim
Sang-Wook Kim