Donghyeon Kim

Mr. Donghyeon Kim

orcid

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2025
Verified
Conference Paper
Open access
HKHyeoncheol Kim
Hyeoncheol Kim
TKTaehoon Kim
Taehoon Kim
TPTaehyeong Park
Taehyeong Park
DKDonghyeon Kim
Donghyeon Kim
YYYongseung Yu
Yongseung Yu
YPYongjun Park
Yongjun Park
Real-time processing of deep learning models on conventional systems, such as CPUs and GPUs, is highly challenging due to memory bottlenecks. This is exacerbated in Large Language Models (LLMs), where the majority of executions are dominated by General Matrix Multiplication (GEMM) operations, which are relatively more memory-intensive than convolution operations. Processing-in-Memory (PIM), which provides high internal bandwidth, can be a promising alternative for LLM serving. However, since current PIM systems do not fully replace traditional memory, data transfer between the host and PIM-side memory is essential. Therefore, minimizing the transfer cost between the host and PIM is crucial for serving LLMs efficiently on the PIM. In this paper, we propose PIM-LLM, an end-to-end framework that accelerates LLMs using an efficient tiled GEMM library and several key target-aware optimizations on real-world PIM systems. We first propose PGEMMlib, which provides optimized tiling techniques for PIM, considering architecture specific characteristics to minimize unnecessary data transfer overhead and maximize parallelism. In addition, Tile-Selector explores optimized parameters and techniques for different GEMM shapes and available resources of PIM systems using an analytical model. To accelerate LLMs using PGEMMlib, we integrate it into the TVM deep learning compiler framework. We further optimize the LLM execution by applying several key optimizations: Build-time memory layout adjustment, PIM resource pooling, CPU/PIM cooperation support, and QKV generation fusion. Evaluation shows that PIM-LLM achieves significant performance gains of up to 45.75x over the TVM baseline for several well-known LLMs. We strongly believe that this work provides key insights for efficient LLM serving on real PIM devices.

8 June 2025
Verified
Conference Paper
Open access
IHInyong Hwang
Inyong Hwang
DKDonghyeon Kim
Donghyeon Kim
SKSeokwon Kang
Seokwon Kang
TPTaehyeong Park
Taehyeong Park
TKTaehoon Kim
Taehoon Kim
YPYongjun Park
Yongjun Park

17 October 2025
Verified
Conference Paper
Open access
JKJeehyun Kim
Jeehyun Kim
DKDonghyeon Kim
Donghyeon Kim
SKSeokwon Kang
Seokwon Kang
BHBongjoon Hyun
Bongjoon Hyun
ILInho Lee
Inho Lee
YPYongjun Park
Yongjun Park

2 November 2020 in Electronics
Verified
Journal Article
Open access
PDF file
DKDonghyeon Kim
Donghyeon Kim
SKSeokwon Kang
Seokwon Kang
JLJunsu Lim
Junsu Lim
SJSunwook Jung
Sunwook Jung
WKWoosung Kim
Woosung Kim
YPYongjun Park
Yongjun Park
As recent heterogeneous systems comprise multi-core CPUs and multiple GPUs, efficient allocation of multiple data-parallel applications has become a primary goal to achieve both maximum total performance and efficiency. However, the efficient orchestration of multiple applications is highly challenging because a detailed runtime status such as expected remaining time and available memory size of each computing device is hidden. To solve these problems, we propose a dynamic data-parallel application allocation framework called ADAMS. Evaluations show that our framework improves the average total execution device time by 1.85× over the round-robin policy in the non-shared-memory system with small data set.

15 November 2022 in Korean Association For Learner-Centered Curriculum And Instruction
Verified
Journal Article
Closed access
EKEunjeong Kim
Eunjeong Kim
SNSookyong Nam
Sookyong Nam
DKDonghyeon Kim
Donghyeon Kim
JYJonghoon Yoo
Jonghoon Yoo
KIKorean Association For Learner-Centered Curriculum And Instruction
Korean Association For Learner-Centered Curriculum And Instruction
학교 내 대안교실의 운영 성과분석 의 이용 수, 등재여부, 발행기관, 저자, 초록, 목차, 참고문헌 등 논문에 관한 다양한 정보 및 관련논문 목록과 논문의 분야별 BEST, NEW 논문 목록을 확인 하실 수 있습니다.