Researchers have been developing Hand Gesture Recognition (HGR) systems to enhance natural, efficient, and authentic human-computer interaction, especially benefiting those who rely solely on hand gestures for communication. Despite significant progress, automatic and precise identification of hand gestures remains a considerable challenge in computer vision. Recent studies have focused on specific modalities like RGB images, skeleton data, and spatiotemporal interest points. This paper comprehensively reviews HGR techniques and data modalities from 2014 to 2024, exploring advancements in sensor technology and computer vision. We highlight accomplishments using various modalities, including RGB, Skeleton, Depth, Audio, Electromyography (EMG), Electroencephalography (EEG), and Multimodal approaches and identify areas needing further research. We reviewed over 200 articles from prominent databases, focusing on data collection, data settings, and gesture representation. Our review assesses the efficacy of HGR systems through their recognition accuracy and identifies a gap in research on continuous gesture recognition, indicating the need for improved vision-based gesture systems. The field has experienced steady research progress, including advancements in hand-crafted features and deep learning (DL) techniques. Additionally, we report on the promising developments in HGR methods and the area of multimodal approaches. We hope this survey will serve as a potential guideline for diverse data modality-based HGR research.
Achieving a reliable classification of motor imagery (MI) tasks is a major challenge in brain–computer interface (BCI) implementation. The set of relevant and discriminative features plays an important role in the classification scheme. This paper presents a supervised approach to select discriminative features for the enhancement of MI classification using multichannel electroencephalography (EEG) signal. The dimension of multiband feature space is reduced using the feature selection method. Each trial of the multichannel EEG signal representing MI tasks is decomposed into a finite set of narrowband signals. The common spatial pattern-based features are extracted from each subband. The features obtained from the multiple subbands are combined to derive a high-dimensional feature vector. The neighborhood component analysis-based feature selection method is implemented to select the features that are relevant in performing an accurate classification. It is a nearest-neighbor-based approach to learn the feature weights with regularization by maximizing the average leave-one-out classification accuracy over the labeled training data. The selected features are used to train the support vector machine for classification. The features relatively irrelevant to the classification task are discarded, yielding a reduction of feature dimension. The evaluation of the proposed method is performed using BCI Competition III dataset 4a and IV dataset 2b. Both are publicly available datasets and are used as types of benchmark data to evaluate the MI classification algorithm to implement BCI. The obtained simulation results confirm the superiority of the proposed method compared to the recently developed algorithms.
Analyzing electroencephalography (EEG) signals with machine learning approaches has become an attractive research domain for linking the brain to the outside world to establish communication in the name of the Brain-Computer Interface (BCI). Many researchers have been working on developing successful motor imagery (MI)-based BCI systems. However, they still face challenges in producing better performance with them because of the irrelevant features and high computational complexity. Selecting discriminative and relevant features to overcome the existing issues is crucial. In our proposed work, different feature selection algorithms have been studied to reduce the dimension of multiband feature space to improve MI task classification performance. In the procedure, we first decomposed the MI-based EEG signal into four sets of the narrowband signal. Then a common spatial pattern (CSP) approach was employed for each narrowband to extract and combine effective features, producing a high-dimensional feature vector. Three feature selection approaches, named correlation-based feature selection (CFS), minimum redundancy and maximum relevance (mRMR), and multi-subspace randomization and collaboration-based unsupervised feature selection (SRCFS), were used in this study to select the relevant and effective features for improving classification accuracy. Among them, the SRCFS feature selection approach demonstrated outstanding performance for MI classification compared to other schemes. The SRCFS is based on the multiple k-nearest neighbour graphs method for learning feature weight based on the Laplacian score and then discarding the irrelevant features based on the weight value, reducing the feature dimension. Finally, the selected features are fed into the support vector machines (SVM), linear discriminative analysis (LDA), and multi-layer perceptron (MLP) for classification. The proposed model is evaluated with two benchmark datasets, namely BCI Competition III dataset IVA and dataset IIIB, which are publicly available and mainly used to recognize the MI tasks. The LDA classifier with the SRCFS feature selection algorithm exhibits better performance. It proves the superiority of our proposed study compared to the other state-of-the-art BCI-based MI task classification systems.
Electroencephalography (EEG) is effectively employed to describe cognitive patterns corresponding to different tasks of motor functions for brain–computer interface (BCI) implementation. Explicit information processing is necessary to reduce the computational complexity of practical BCI systems. This paper presents an entropy-based approach to select effective EEG channels for motor imagery (MI) classification in brain–computer interface (BCI) systems. The method identifies channels with higher entropy scores, which is an indication of greater information content. It discards redundant or noisy channels leading to reduced computational complexity and improved classification accuracy. High entropy means a more disordered pattern, whereas low entropy means a less disordered pattern with less information. The entropy of each channel for individual trials is calculated. The weight of each channel is represented by the mean entropy of the channel over all the trials. A set of channels with higher mean entropy are selected as effective channels for MI classification. A limited number of sub-band signals are created by decomposing the selected channels. To extract the spatial features, the common spatial pattern (CSP) is applied to each sub-band space of EEG signals. The CSP-based features are used to classify the right-hand and right-foot MI tasks using a support vector machine (SVM). The effectiveness of the proposed approach is validated using two publicly available EEG datasets, known as BCI competition III–IV(A) and BCI competition IV–I. The experimental results demonstrate that the proposed approach surpasses cutting-edge techniques.
The major challenge in Brain Computer Interface (BCI) is to obtain reliable classification accuracy of motor imagery (MI) task. This paper mainly focuses on unsupervised feature selection for electroencephalography (EEG) classification leading to BCI implementation. The multichannel EEG signal is decomposed into a number of subband signals. The features are extracted from each subband by applying spatial filtering technique. The features are combined into a common feature space to represent the effective event MI classification. It may inevitably include some irrelevant features yielding the increase of dimension and mislead the classification system. The unsupervised discriminative feature selection (UDFS) is employed here to select the subset of extracted features. It effectively selects the dominant features to improve classification accuracy of motor imagery task acquired by EEG signals. The classification of MI tasks is performed by support vector machine. The performance of the proposed method is evaluated using publicly available dataset obtained from BCI Competition III (IVA). The experimental results show that the performance of this method is better than that of the recently developed algorithms.
1 April 2023 in Computer Science Journal of Moldova
Machine translation (MT) is the process of translating text from one language to another using bilingual data sets and grammatical rules. Recent works in the field of MT have popularized sequence-to-sequence models leveraging neural attention and deep learning. The success of neural attention models is yet to be construed into a robust framework for automated English-to-Bangla translation due to a lack of a comprehensive dataset that encompasses the diverse vocabulary of the Bangla language. In this study, we have proposed an English-to-Bangla MT system using an encoder-decoder attention model using the CCMatrix corpus. Our method shows that this model can outperform traditional SMT and RBMT models with a Bilingual Evaluation Understudy (BLEU) score of 15.68 despite being constrained by the limited vocabulary of the corpus. We hypothesize that this model can be used successfully for state-of-the-art machine translation with a more diverse and accurate dataset. This work can be extended further to incorporate several newer datasets using transfer learning techniques.