Seongju Lee

Seongju Lee

Auto-generated profile, based on publicly available information

Seongju Lee

Gwangju Institute of Science and Technology (GIST)

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 November 2023 in Expert Systems with Applications
Verified
Journal Article
Open access
SLSeongju Lee
Seongju Lee
YYYeonguk Yu
Yeonguk Yu
SBSeunghyeok Back
Seunghyeok Back
HSHogeon Seo
Hogeon Seo
KLKyoobin Lee
Kyoobin Lee

29 November 2024
Verified
Book Chapter
Open access
PDF file
SLSeongju Lee
Seongju Lee
junseok leejunseok lee
junseok lee
YYYeonguk Yu
Yeonguk Yu
TKTaeri Kim
Taeri Kim
KLKyoobin Lee
Kyoobin Lee
Multi-agent trajectory prediction is crucial to autonomous driving and understanding the surrounding environment. Learning-based approaches for multi-agent trajectory prediction, such as primarily relying on graph neural networks, graph transformers, and hypergraph neural networks, have demonstrated outstanding performance on real-world datasets in recent years. However, the hypergraph transformer-based method for trajectory prediction is yet to be explored. Therefore, we present a MultiscAle Relational Transformer (MART) network for multi-agent trajectory prediction. MART is a hypergraph transformer architecture to consider individual and group behaviors in transformer machinery. The core module of MART is the encoder, which comprises a Pair-wise Relational Transformer (PRT) and a Hyper Relational Transformer (HRT). The encoder extends the capabilities of a relational transformer by introducing HRT, which integrates hyperedge features into the transformer mechanism, promoting attention weights to focus on group-wise relations. In addition, we propose an Adaptive Group Estimator (AGE) designed to infer complex group relations in real-world environments. Extensive experiments on three real-world datasets (NBA, SDD, and ETH-UCY) demonstrate that our method achieves state-of-the-art performance, enhancing ADE/FDE by 3.9%/11.8% on the NBA dataset. Code is available at https://github.com/gist-ailab/MART.

29 March 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
SSSungho Shin
Sungho Shin
JKJongwon Kim
Jongwon Kim
YYYeonguk Yu
Yeonguk Yu
SLSeongju Lee
Seongju Lee
KLKyoobin Lee
Kyoobin Lee
We propose the implementation of transfer learning from natural images to audio-based images using self-supervised learning schemes. Through self-supervised learning, convolutional neural networks (CNNs) can learn the general representation of natural images without labels. In this study, a convolutional neural network was pre-trained with natural images (ImageNet) via self-supervised learning; subsequently, it was fine-tuned on the target audio samples. Pre-training with the self-supervised learning scheme significantly improved the sound classification performance when validated on the following benchmarks: ESC-50, UrbanSound8k, and GTZAN. The network pre-trained via self-supervised learning achieved a similar level of accuracy as those pre-trained using a supervised method that require labels. Therefore, we demonstrated that transfer learning from natural images contributes to improvements in audio-related tasks, and self-supervised learning with natural images is adequate for pre-training scheme in terms of simplicity and effectiveness.

10 January 2023 in Sensors
Verified
Journal Article
Open access
PDF file
SSSungho Shin
Sungho Shin
SLSeongju Lee
Seongju Lee
Changhyun JunChanghyun Jun
Changhyun Jun
KLKyoobin Lee
Kyoobin Lee
A haptic sensor coupled to a gamepad or headset is frequently used to enhance the sense of immersion for game players. However, providing haptic feedback for appropriate sound effects involves specialized audio engineering techniques to identify target sounds that vary according to the game. We propose a deep learning-based method for sound event detection (SED) to determine the optimal timing of haptic feedback in extremely noisy environments. To accomplish this, we introduce the BattleSound dataset, which contains a large volume of game sound recordings of game effects and other distracting sounds, including voice chats from a PlayerUnknown’s Battlegrounds (PUBG) game. Given the highly noisy and distracting nature of war-game environments, we set the annotation interval to 0.5 s, which is significantly shorter than the existing benchmarks for SED, to increase the likelihood that the annotated label contains sound from a single source. As a baseline, we adopt mobile-sized deep learning models to perform two tasks: weapon sound event detection (WSED) and voice chat activity detection (VCAD). The accuracy of the models trained on BattleSound was greater than 90% for both tasks; thus, BattleSound enables real-time game sound recognition in noisy environments via deep learning. In addition, we demonstrated that performance degraded significantly when the annotation interval was greater than 0.5 s, indicating that the BattleSound with short annotation intervals is advantageous for SED applications that demand real-time inferences.

15 July 2026 in Intelligent Systems with Applications
Verified
Journal Article
Open access
JKJongwon Kim
Jongwon Kim
YPYoumin Park
Youmin Park
SHSeunghyeok Hyun
Seunghyeok Hyun
YHYunjae Heo
Yunjae Heo
SLSeongju Lee
Seongju Lee
KLKyoobin Lee
Kyoobin Lee

9 April 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
JKJongwon Kim
Jongwon Kim
YPYoumin Park
Youmin Park
SHSeunghyeok Hyun
Seunghyeok Hyun
YHYunjae Heo
Yunjae Heo
SLSeongju Lee
Seongju Lee
KLKyoobin Lee
Kyoobin Lee
Building training datasets for perception systems in autonomous driving and industrial inspection requires large volumes of pixel-level annotations, and the annotation cost increases with scene complexity and the number of object categories. Existing annotation platforms combine foundation models with active learning, and some offer confidence-based filtering. However, existing systems do not account for the class imbalance that arises during iterative label pool expansion, nor study how semi-supervised learning (SSL), calibration, and selective review interact across annotation rounds. We propose an annotation system that reduces the manual annotation effort through calibrated confidence scores: predictions below a minimum threshold are discarded, high-confidence predictions are accepted without human review, and the remaining uncertain predictions are flagged for manual inspection. A controlled annotation experiment on Cityscapes shows that the system reduces human annotation time by 1.9x and improves Average Precision (AP) by 1.8 points over an active-learning baseline with Mask2Former and SAM 2, while auto-accepting 74.3% of predictions with 85.8% precision at the final round. An offline ablation shows that SSL and calibration jointly reduce false positives by 40.4%, with auto-accept precision improving across rounds rather than declining under supervised-only training. Compared to unassisted manual polygon labeling, the proposed system reduces human annotation time by 3.2x while improving AP by 4.5 points under the same 150-image budget.