Kenneth Mejía Pérez

Mr. Kenneth Mejía Pérez

Autonomous University of Queretaro, Querétaro City, Mexico
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 May 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
Kenneth Mejía PérezKenneth Mejía Pérez
Kenneth Mejía Pérez
Diana-Margarita Cordova-EsparzaDiana-Margarita Cordova-Esparza
Diana-Margarita Cordova-Esparza
JTJuan Terven
Juan Terven
AHAna-Marcela Herrera-Navarro
Ana-Marcela Herrera-Navarro
TGTeresa García-Ramírez
Teresa García-Ramírez
Alfonso RamirezAlfonso Ramirez
Alfonso Ramirez
Automatic sign language recognition is a challenging task in machine learning and computer vision. Most works have focused on recognizing sign language using hand gestures only. However, body motion and facial gestures play an essential role in sign language interaction. Taking this into account, we introduce an automatic sign language recognition system based on multiple gestures, including hands, body, and face. We used a depth camera (OAK-D) to obtain the 3D coordinates of the motions and recurrent neural networks for classification. We compare multiple model architectures based on recurrent networks such as Long Short-Term Memories (LSTM) and Gated Recurrent Units (GRU) and develop a noise-robust approach. For this work, we collected a dataset of 3000 samples from 30 different signs of the Mexican Sign Language (MSL) containing features coordinates from the face, body, and hands in 3D spatial coordinates. After extensive evaluation and ablation studies, our best model obtained an accuracy of 97% on clean test data and 90% on highly noisy data.