Pimpa Cheewaprakobkit

Dr. Pimpa Cheewaprakobkit

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 March 2023 in IEEE Transactions on Consumer Electronics
Verified
Journal Article
Closed access
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
Chih-Yang LinChih-Yang Lin
Chih-Yang Lin
KLKuan-Hung Lin
Kuan-Hung Lin
TSTimothy K. Shih
Timothy K. Shih
The detection and recognition of signboards have become increasingly important in the consumer electronics industry due to its wide range of potential applications. These applications include aiding visually impaired consumers in navigating through unfamiliar areas, identifying location landmarks for wayfinding, and providing targeted advertising and marketing services to consumers. However, the accuracy of signboard detection remains challenging due to the diversity of designs, which may incorporate text and images, and the complexity of environments, such as occlusion, shooting angles, and lighting conditions. Most existing detection methods struggle to distinguish small and similar signboards. In this paper, we propose robust signboard detection and recognition based on template generation. We also collected a new dataset that contains about 30,000 images, in 14 categories of signboards in Taiwan for training and free public use. The proposed method is a one-stage detector, which utilizes multi-scale features in the Darknet-19 network to learn object features effectively, detecting tiny and large objects. In addition, the proposed template generation method was designed to improve the overall accuracy. We compare our results with the Yolo series models. The results show that our proposed method more efficiently detects and recognizes signboards, achieving an mAP score of 95.99%, total parameters of 62.7M, and FPS of 8.3.

14 April 2024 in Sensors
Verified
Journal Article
Open access
PDF file
AEAvirmed Enkhbat
Avirmed Enkhbat
TSTimothy K. Shih
Timothy K. Shih
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
Human action recognition (HAR) is growing in machine learning with a wide range of applications. One challenging aspect of HAR is recognizing human actions while playing music, further complicated by the need to recognize the musical notes being played. This paper proposes a deep learning-based method for simultaneous HAR and musical note recognition in music performances. We conducted experiments on Morin khuur performances, a traditional Mongolian instrument. The proposed method consists of two stages. First, we created a new dataset of Morin khuur performances. We used motion capture systems and depth sensors to collect data that includes hand keypoints, instrument segmentation information, and detailed movement information. We then analyzed RGB images, depth images, and motion data to determine which type of data provides the most valuable features for recognizing actions and notes in music performances. The second stage utilizes a Spatial Temporal Attention Graph Convolutional Network (STA-GCN) to recognize musical notes as continuous gestures. The STA-GCN model is designed to learn the relationships between hand keypoints and instrument segmentation information, which are crucial for accurate recognition. Evaluation on our dataset demonstrates that our model outperforms the traditional ST-GCN model, achieving an accuracy of 81.4%.

3 September 2024 in IEEE Access
Verified
Journal Article
Open access
AEAvirmed Enkhbat
Avirmed Enkhbat
TSTimothy K. Shih
Timothy K. Shih
MGMunkhjargal Gochoo
Munkhjargal Gochoo
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
WAWisnu Aditya
Wisnu Aditya
YLYu-Ting Lin
Yu-Ting Lin
Human action recognition has recently attracted much attention in computer vision research. Its applications are widely found in video surveillance, human-computer interaction, entertainment, and autonomous driving. In this study, we developed a system for evaluating online music performances. This system conducts experiments to assess performance of playing the erhu, the most popular traditional stringed instrument in East Asia. Mastering the erhu poses a challenge, as players often struggle to enhance their skills due to incorrect techniques and a lack of guidance, resulting in limited progress. To address this issue, we propose hybrid models based on graph convolutional networks (GCN) and temporal convolutional networks (TCN) for action recognition to capture spatial relationships between different joints or keypoints in a human skeleton, and interactions between these joints. This can assist players in identifying errors while playing the instrument. In our research, we use RGB video as input, segmenting it into individual frames. For each frame, we extract keypoints, encompassing both image and keypoint information, which serve as input data for our model. Leveraging our innovative model architecture, we achieve an impressive accuracy rate exceeding 97% across various classes of hand error modules, thus providing valuable insights into the assessment of musical performances and demonstrates the potential of AI-based solutions to enhance the learning and correction of complex human actions in interactive learning environments.

18 December 2023 in Machine Graphics and Vision
Verified
Journal Article
Open access
PDF file
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
TSTimothy K. Shih
Timothy K. Shih
TLTimothy Lau
Timothy Lau
YLYu-Cheng Lin
Yu-Cheng Lin
Chih-Yang LinChih-Yang Lin
Chih-Yang Lin
Computer vision has gained significant attention in the field of information technology due to its widespread application that addresses real-world challenges, surpassing human intelligence in tasks such as image recognition, classification, natural language processing, and even game playing. Sudoku, a challenging puzzle that has captivated many people, exhibits a complexity that has attracted researchers to leverage deep learning techniques for its solution. However, the reliance on black-box neural networks has raised concerns about transparency and explainability. In response to this challenge, we present the Rule-based Explaining Module (REM), which is designed to provide explanations of the decision-making processes using Recurrent Relational Networks (RRN). Our proposed methodology is to bridge the gap between complex RRN models and human understanding by unveiling the specific rules applied by the model at each stage of the Sudoku puzzle solving process. Evaluating REM on the Minimum Sudoku dataset, we achieved an accuracy of over 98.00%.

6 November 2023 in IEEE Access
Verified
Journal Article
Open access
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
Chih-Yang LinChih-Yang Lin
Chih-Yang Lin
TSTimothy K. Shih
Timothy K. Shih
AEAvirmed Enkhbat
Avirmed Enkhbat
Deep neural network-based tracking tasks have experienced significant advancements in recent years. However, these networks continue to face challenges in effectively adapting to appearance changes in both target and background, as well as linking objects after extended periods. The primary challenge in tracking lies in the frequent changes in a target’s appearance throughout the tracking process, which can potentially reduce tracker robustness when faced with issues such as aspect ratio changes, occlusions, scale variations, and confusion from similar objects. To address this challenge, we propose a tracking architecture that combines a temporal convolutional network (TCN) and attention mechanism with spatial-temporal memory. The TCN component empowers the model to capture temporal dependencies, while the attention mechanism reduces computational complexity by focusing on crucial regions based on context. We leverage the target’s historical information stored in the spatial-temporal memory network to guide the tracker in better adapting to target deformation. Our model attains a 63.0% average overlap (AO) on the GOT-10K dataset, a 71.9% success score (AUC) on OTB2015, a 65.6% success score (AUC) on UAV123, and achieves 56.9% accuracy on the VOT2018 dataset. These outcomes demonstrate the high effectiveness of our proposed tracker in tracking a single object.

19 July 2025
Verified
Book Chapter
Closed access
PDF file
YLYu-Cheng Lin
Yu-Cheng Lin
CWCheng-Han Wu
Cheng-Han Wu
PCPimpa Cheewaprakobkit
Pimpa Cheewaprakobkit
YLYu-Wen Lei
Yu-Wen Lei
TSTimothy K. Shih
Timothy K. Shih