Du-Seong Chang

Du-Seong Chang

Auto-generated profile, based on publicly available information

Du-Seong Chang

KT Corporation

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 April 2024
Verified
Conference Paper
Open access
HOHyungjun Oh
Hyungjun Oh
KKKihong Kim
Kihong Kim
JKJaemin Kim
Jaemin Kim
SKSungkyun Kim
Sungkyun Kim
JLJunyeol Lee
Junyeol Lee
JSJiwon Seo
Jiwon Seo
This paper presents ExeGPT, a distributed system designed for constraint-aware LLM inference. ExeGPT finds and runs with an optimal execution schedule to maximize inference throughput while satisfying a given latency constraint. By leveraging the distribution of input and output sequences, it effectively allocates resources and determines optimal execution configurations, including batch sizes and partial tensor parallelism. We also introduce two scheduling strategies based on Round-Robin Allocation and Workload-Aware Allocation policies, suitable for different NLP workloads. We evaluate ExeGPT on six LLM instances of T5, OPT, and GPT-3 and five NLP tasks, each with four distinct latency constraints. Compared to FasterTransformer, ExeGPT achieves up to 15.2× improvements in throughput and 6× improvements in latency. Overall, ExeGPT achieves an average throughput gain of 2.9× across twenty evaluation scenarios. Moreover, when adapting to changing sequence distributions, the cost of adjusting the schedule in ExeGPT is reasonably modest. ExeGPT proves to be an effective solution for optimizing and executing LLM inference for diverse NLP workload and serving conditions.

1 January 2024
Verified
Conference Paper
Open access
PDF file
JLJanghwan Lee
Janghwan Lee
SPSeongmin Park
Seongmin Park
SHSukjin Hong
Sukjin Hong
MKMinsoo Kim
Minsoo Kim
DCDu-Seong Chang
Du-Seong Chang
JCJungwook Choi
Jungwook Choi
Janghwan Lee, Seongmin Park, Sukjin Hong, Minsoo Kim, Du-Seong Chang, Jungwook Choi. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

27 March 2023
Verified
Conference Paper
Open access
JJJeesu Jung
Jeesu Jung
HSHyein Seo
Hyein Seo
SJSangkeun Jung
Sangkeun Jung
RCRiwoo Chung
Riwoo Chung
HRHwijung Ryu
Hwijung Ryu
DCDu-Seong Chang
Du-Seong Chang
Summarization is one of the important tasks of natural language processing used to distill information. Recently, the sequence-to-sequence method was applied, in a general manner, to summarization tasks. The problem is that a large amount of information must be pre-trained for a specific domain, and information other than input statements cannot be utilized. To compensate for this shortcoming, controllable summarization has recently been in the spotlight. We introduced three properties into controllable summarization: 1) a new human-machine communication input format, 2) a robust constraint-sensitive summarization method for these formats, and 3) a practical interactive summarization interface available to the user. Experiments on the Wizard-of-Wikipedia dataset show that applying this input format and the constraint-sensitive method enhances summarization performance compared to the typical method. A user study shows that the interactive summarization interface is practical and that participants are evaluating it positively.

1 January 2024
Verified
Conference Paper
Open access
PDF file
CPChaeHun Park
ChaeHun Park
KLKoanho Lee
Koanho Lee
HLHyesu Lim
Hyesu Lim
JKJaeseok Kim
Jaeseok Kim
JPJunmo Park
Junmo Park
JCJaegul Choo
Jaegul Choo
ChaeHun Park, Koanho Lee, Hyesu Lim, Jaeseok Kim, Junmo Park, Yu-Jung Heo, Du-Seong Chang, Jaegul Choo. Findings of the Association for Computational Linguistics ACL 2024. 2024.

1 January 2024
Verified
Conference Paper
Open access
PDF file
HKHyeonseok Kang
Hyeonseok Kang
HSHyein Seo
Hyein Seo
JJJeesu Jung
Jeesu Jung
SJSangkeun Jung
Sangkeun Jung
DCDu-Seong Chang
Du-Seong Chang
RCRiwoo Chung
Riwoo Chung
Hyeonseok Kang, Hyein Seo, Jeesu Jung, Sangkeun Jung, Du-Seong Chang, Riwoo Chung. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2024.

1 January 2024
Verified
Conference Paper
Open access
PDF file
EYEuiin Yi
Euiin Yi
TKTaehyeon Kim
Taehyeon Kim
HJHongseok Jeung
Hongseok Jeung
DCDu-Seong Chang
Du-Seong Chang
SYSe-Young Yun
Se-Young Yun
Euiin Yi, Taehyeon Kim, Hongseok Jeung, Du-Seong Chang, Se-Young Yun. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.