Junmo Kim

Dr. Junmo Kim


Research Focus & Metrics

Academic Career Length

18Years (2009-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 April 2020 in IEEE Access
Verified
Journal Article
Open access
BKByungju Kim
Byungju Kim
JKJunmo Kim
Junmo Kim
The training of deep neural networks heavily depends on the data distribution. In particular, these networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To resolve this problem, existing approaches typically propose novel loss functions to obtain better feature embedding. In this paper, we argue that drawing a better decision boundary is as important as learning better features. Based on our observations, we investigate how the class imbalance affects the decision boundary and deteriorates the performance. We also investigate the feature-distributional discrepancy between training and test time. Accordingly, we propose a novel, yet simple method for class imbalanced learning. Despite its simplicity, our method exhibits outstanding performance. Specifically, the experimental results show that we can significantly improve a network by scaling the weight vectors, even without additional training processes.

19 August 2020 in IEEE Access
Verified
Journal Article
Open access
DKDoyeon Kim
Doyeon Kim
DJDonggyu Joo
Donggyu Joo
JKJunmo Kim
Junmo Kim
Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video generation, especially on conditional inputs, remains a challenging and less explored area. To narrow this gap, we aim to train our model to produce a video corresponding to a given text description. We propose a novel training framework, Text-to-Image-to-Video Generative Adversarial Network (TiVGAN), which evolves frame-by-frame and finally produces a full-length video. In the first phase, we focus on creating a high-quality single video frame while learning the relationship between the text and an image. As the steps proceed, our model is trained gradually on more number of consecutive frames. This step-by-step learning process helps stabilize the training and enables the creation of high-resolution video based on conditional text descriptions. Qualitative and quantitative experimental results on various datasets demonstrate the effectiveness of the proposed method.



2 April 2018 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
BYByungIn Yoo
ByungIn Yoo
YKYoungjun Kwak
Youngjun Kwak
YKYoungsung Kim
Youngsung Kim
CCChangkyu Choi
Changkyu Choi
JKJunmo Kim
Junmo Kim
Accurate age estimation from a facial image is quite challenging, since physical age and apparent age can be quite different, and this difference is dependent on gender, ethnicity, and many other factors. Multitask deep learning is one of the approach to improve age estimation by employing auxiliary tasks, such as gender recognition, that are related to the primary task. However, in traditional multitask learning for age estimation, the relationship between the primary and auxiliary tasks is difficult to describe; how the auxiliary tasks enhance the model for the primary objective is ambiguous. In this letter, we propose a conditional multitask learning method that architecturally factorizes an age variable into gender-conditioned age probabilities in a deep neural network. The lack of accurate training labels with discrete age values is another critical limitation to training age estimation models. Therefore, we propose a label expansion method that increases the number of accurate labels from weakly supervised categorical labels. To verify the generality of the proposed method, we perform intensive experiments on the publicly available MORPH-II and FG-NET datasets. The proposed methods outperform state-of-the art methods in both age estimation and gender recognition accuracy. These performance gains are verified on well-known deep network architectures-VGG-16, CASIA-WebFace, and Alexnet-to confirm the proposed methods generality.

8 May 2018 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
WYWoo-Han Yun
Woo-Han Yun
DLDongjin Lee
Dongjin Lee
CPChankyu Park
Chankyu Park
JKJaehong Kim
Jaehong Kim
JKJunmo Kim
Junmo Kim
Automatic engagement recognition is a technique that is used to measure the engagement level of people in a specific task. Although previous research has utilized expensive and intrusive devices such as physiological sensors and pressure-sensing chairs, methods using RGB video cameras have become the most common because of the cost efficiency and noninvasiveness of video cameras. Automatic engagement recognition methods using video cameras are usually based on hand-crafted features and a statistical temporal dynamics modeling algorithm. This paper proposes a data-driven convolutional neural networks (CNNs)-based engagement recognition method that uses only facial images from input videos. As the amount of data in a dataset of children's engagement is insufficient for deep learning, pre-trained CNNs are utilized for low-level feature extraction from each video frame. In particular, a new layer combination for temporal dynamics modeling is employed to extract high-level features from low-level features. Experimental results on a database created using images of children from kindergarten demonstrate that the performance of the proposed method is superior to that of previous methods. The results indicate that the engagement level of children can be gauged automatically via deep learning even when the available database is deficient.