Sung-Guk Jo

Sung-Guk Jo

Auto-generated profile, based on publicly available information

Sung-Guk Jo

School of Software, Kunsan National University, Gunsan-si, South Korea

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 December 2023 in IEEE Access
Verified
Journal Article
Open access
SJSung-Guk Jo
Sung-Guk Jo
SPSeung-Hyeok Park
Seung-Hyeok Park
JKJeong-Jae Kim
Jeong-Jae Kim
Byoung-Won OnByoung-Won On
Byoung-Won On
Nowadays, pre-trained sequence-to-sequence models such as PEGASUS and BART have shown state-of-the-art results in abstractive summarization. In these models, during fine-tuning, the encoder transforms sentences to context vectors in the latent space and the decoder learns the summary generation task based on the context vectors. In our approach, we consider two clusters of salient and non-salient context vectors, using which the decoder can attend more over salient context vectors for summary generation. For this, we propose a novel cluster generator layer between the encoder and the decoder, which first generates two clusters of salient and non-salient vectors, and then normalizes and shrinks the clusters to make them apart in the latent space. Our experimental results show that the proposed model outperforms the state-of-the-art models such as BART and PEGASUS by learning these distinct cluster patterns, improving up to 2~30% in ROUGE and 0.1~0.8% in BERTScore in CNN/DailyMail and XSUM data sets.