In this paper, we present a novel approach that aims to solve one of the main challenges in hand gesture recognition tasks in static images, to compensate for the accuracy lost when trained models are used to interpret completely unseen data. The model presented here consists of two main data-processing stages. A deep neural network (DNN) for performing handshape segmentation and classification is used in which multiple architectures and input image sizes were tested and compared to derive the best model in terms of accuracy and processing time. For the experiments presented in this work, the DNN models were trained with 24,000 images of 24 signs from the American Sign Language alphabet and fine-tuned with 5200 images of 26 generated signs. The system was real-time tested with a community of 10 persons, yielding a mean average precision and processing rate of 81.74% and 61.35 frames-per-second, respectively. As a second data-processing stage, a bidirectional long short-term memory neural network was implemented and analyzed for adding spelling correction capability to our system, which scored a training accuracy of 98.07% with a dictionary of 370 words, thus, increasing the robustness in completely unseen data, as shown in our experiments.
23 December 2021 in IEEE Latin America Transactions
Traditional approaches to automatic classification of pollen grains consisted of classifiers working with feature extractors designed by experts, which modeled pollen grains aspects of special importance for biologists. Recently, a Deep Learning (DL) algorithm called Convolutional Neural Network (CNN) has shown a great improvement in performance in many computer vision tasks such as classification, due to this great performance the computational requirements have increased considerably; therefore, it is advisable to use new platforms such as the Graphics Processing Unit (GPU), which offer large computational resources for the development of new systems with CNN. This paper presents the GPU-Trained implementation of a DL system with the CNN algorithm, proposing a CNN model capable of running on a GPU in real-time for the automatic classification of 19 different pollen grains belonging to 14 different families, which are found in high concentrations in Mexico, and which are large interest in areas such as beekeeping, paleoecology, botany, allergology, agriculture among others. These areas seek to improve the collection of palynological data in terms of time and accuracy. In order to evaluate our model, evaluation tests were performed in the NVIDIA Jetson TX2 Developer Kit GPU. Experimental results achieves around 90% in CCR and Sensitivity in the proposed model. Additionally, the proposed model works at a processing speed of 6,826 Frames Per Second (FPS) and has approximately 50% fewer parameters than reported in related works.