Nhu-Tai Do

Dr. Nhu-Tai Do

Chonnam National University
orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 April 2021 in Diagnostics
Verified
Journal Article
Open access
PDF file
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
SJSung Taek Jung
Sung Taek Jung
Hyung-Jeong YangHyung-Jeong Yang
Hyung-Jeong Yang
Soo-Hyung KimSoo-Hyung Kim
Soo-Hyung Kim
Tumor classification and segmentation problems have attracted interest in recent years. In contrast to the abundance of studies examining brain, lung, and liver cancers, there has been a lack of studies using deep learning to classify and segment knee bone tumors. In this study, our objective is to assist physicians in radiographic interpretation to detect and classify knee bone regions in terms of whether they are normal, begin-tumor, or malignant-tumor regions. We proposed the Seg-Unet model with global and patched-based approaches to deal with challenges involving the small size, appearance variety, and uncommon nature of bone lesions. Our model contains classification, tumor segmentation, and high-risk region segmentation branches to learn mutual benefits among the global context on the whole image and the local texture at every pixel. The patch-based model improves our performance in malignant-tumor detection. We built the knee bone tumor dataset supported by the physicians of Chonnam National University Hospital (CNUH). Experiments on the dataset demonstrate that our method achieves better performance than other methods with an accuracy of 99.05% for the classification and an average Mean IoU of 84.84% for segmentation. Our results showed a significant contribution to help the physicians in knee bone tumor detection.

1 December 2019 in Image and Vision Computing
Verified
Journal Article
Closed access
TLThai Son Ly
Thai Son Ly
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
SKSoo-Hyung Kim
Soo-Hyung Kim
HYHyung-Jeong Yang
Hyung-Jeong Yang
GLGuee-Sang Lee
Guee-Sang Lee

10 September 2020 in Applied Sciences
Verified
Journal Article
Open access
PDF file
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
Soo-Hyung KimSoo-Hyung Kim
Soo-Hyung Kim
Hyung-Jeong YangHyung-Jeong Yang
Hyung-Jeong Yang
Gueesang LeeGueesang Lee
Gueesang Lee
This study builds robust hand shape features from the two modalities of depth and skeletal data for the dynamic hand gesture recognition problem. For the hand skeleton shape approach, we use the movement, the rotations of the hand joints with respect to their neighbors, and the skeletal point-cloud to learn the 3D geometric transformation. For the hand depth shape approach, we use the feature representation from the hand component segmentation model. Finally, we propose a multi-level feature LSTM with Conv1D, the Conv2D pyramid, and the LSTM block to deal with the diversity of hand features. Therefore, we propose a novel method by exploiting robust skeletal point-cloud features from skeletal data, as well as depth shape features from the hand component segmentation model in order for the multi-level feature LSTM model to benefit from both. Our proposed method achieves the best result on the Dynamic Hand Gesture Recognition (DHG) dataset with 14 and 28 classes for both depth and skeletal data with accuracies of 96.07% and 94.40%, respectively.

1 November 2020
Verified
Conference Paper
Closed access
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
TNTram-Tran Nguyen-Quynh
Tram-Tran Nguyen-Quynh
SKSoo-Hyung Kim
Soo-Hyung Kim
Affective behavior analysis plays an important role in human-computer interaction, customer marketing, health monitoring. ABAW Challenge and Aff-Wild2 dataset raise the new challenge for classifying basic emotions and regression valence-arousal value under in-the-wild environments. In this paper, we present an affective expression analysis model that deals with the above challenges. Our approach includes STAT and Temporal Module for fine-tuning again face feature model. We experimented on Aff-Wild2 dataset, a large-scale dataset for ABAW Challenge with the annotations for both the categorical and valence-arousal emotion. We achieved the expression score 0.543 and valence-arousal score 0.534 on the validation set.

26 November 2020 in IEEE Access
Verified
Journal Article
Open access
TNTram-Tran Nguyen-Quynh
Tram-Tran Nguyen-Quynh
Soo-Hyung KimSoo-Hyung Kim
Soo-Hyung Kim
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
In this paper, we present an encoder-decoder architecture that exploits global and local semantics for the automatic image colorization problem. For the global semantics, the low-level encoding features are fine-tuned by the scene-context classification to integrate the global image style. Moreover, the architecture deals with the uncertainty and relations among the scene styles based on the label smoothing and pre-trained weights from Places365. For local semantics, three branches learn the mutual benefits at the pixel-level, in which average and multi-modal distributions are respectively created from regression and soft-encoding branches, while the segmentation branch determines to which object the pixel belongs. Our experiments, which involve training with the Coco-Stuff dataset and validation on DIV2K, Places365, and ImageNet, show that our results are very encouraging.

27 March 2021 in Sensors
Verified
Journal Article
Open access
PDF file
Nhu-Tai DoNhu-Tai Do
Nhu-Tai Do
Soo-Hyung KimSoo-Hyung Kim
Soo-Hyung Kim
Hyung-Jeong YangHyung-Jeong Yang
Hyung-Jeong Yang
Gueesang LeeGueesang Lee
Gueesang Lee
Soonja YeomSoonja Yeom
Soonja Yeom
Emotion recognition plays an important role in human–computer interactions. Recent studies have focused on video emotion recognition in the wild and have run into difficulties related to occlusion, illumination, complex behavior over time, and auditory cues. State-of-the-art methods use multiple modalities, such as frame-level, spatiotemporal, and audio approaches. However, such methods have difficulties in exploiting long-term dependencies in temporal information, capturing contextual information, and integrating multi-modal information. In this paper, we introduce a multi-modal flexible system for video-based emotion recognition in the wild. Our system tracks and votes on significant faces corresponding to persons of interest in a video to classify seven basic emotions. The key contribution of this study is that it proposes the use of face feature extraction with context-aware and statistical information for emotion recognition. We also build two model architectures to effectively exploit long-term dependencies in temporal information with a temporal-pyramid model and a spatiotemporal model with “Conv2D+LSTM+3DCNN+Classify” architecture. Finally, we propose the best selection ensemble to improve the accuracy of multi-modal fusion. The best selection ensemble selects the best combination from spatiotemporal and temporal-pyramid models to achieve the best accuracy for classifying the seven basic emotions. In our experiment, we take benchmark measurement on the AFEW dataset with high accuracy.