Gesture recognition, the basis of human–computer interaction (HCI), is a significant component for the development of smart home, VR, and senior care management. Most gesture recognition methods still depend on sensors worn by the user or video-based gestures for recognition, can be used for fine-grained gesture recognition. our paper implements a gesture recognition method that is independent of environment and gesture drawing direction, and it achieves gesture recognition classification by using small sample data. Wi-NN, proposed in this study, does not require the user to wear additional device. In this case, channel state information (CSI) extracted from Wi-Fi signal is used to capture the action information of the human body via CSI. After pre-processing to reduce the interference of environmental noise as much as possible, clear action information is extracted using the feature extraction method based on time domain to obtain the gesture action feature data. The gathered data are integrated with the weighted k-nearest neighbor (KNN) classification recognizer for classification task. The experiment outcomes revealed that the accuracy scores of the same gesture for different users and different gestures for the same user under the same environment were 93.1% and 89.6%, respectively. The experiments in different environments also achieved good recognition results, and by comparing with other experimental methods, the experiments in this paper have better recognition results. Evidently, good classification results were generated after the original data were processed and incorporated into the weighted KNN.
6 October 2023 in IEEE Transactions on Instrumentation and Measurement
Gesture recognition is the basis of human-computer interaction (HCI), and RFID has attracted wide attention for its advantages of lightweight, low cost, and universality. We propose RF-CGR, which implements cross-domain Chinese character gesture recognition intuitively and effectively. The fundamental concept of RF-CGR is to extract hand motion patterns from RFID phase information and display distinctive gesture features. Firstly, we build a signal sensing model to capture gesture information effectively. Secondly, we innovatively convert the Chinese character phase signal into an intuitive picture representation and use the gesture movement change pattern as input through data pre-processing operations. Finally, Modify-Visual Geometry Group Network (M-VGG) model is used for cross-domain gesture recognition. The M-VGG network learns high-level semantic features of gestures through spatiotemporal convolutions to extract cross-domain gesture features. Compared with other models, M-VGG has fewer parameters, and shorter training time, while still achieving high-accuracy gesture recognition. We evaluate its performance in three scenarios. The accuracy is 98.75% and 98% for new users and new scenarios respectively, significantly outperforming existing wireless signal-based gesture recognition methods.
As the basis of human-computer interaction (HCI), gesture recognition interprets user-performed gestures as commands, followed by the content execution expressed by users’ gestures. Gesture recognition through wireless signals denotes a novel branch of human perception. Despite the recent popularity of Radio Frequency Identification (RFID) following specific advantages (lightweight, low-cost, and universality), several intricacies remain unresolved in RFID sensing research. First, most studies performed simplified body movements assessments instead of identifying complex and fine-grained or subtle gestures. Second, users require extensive training in a novel discipline to collect training data in a specific pattern. Given the paucity of an intuitive and effective means of identifying user gestures, the RF-E-letter proposed in this study denotes an RFID recognition system for complex, fine-grained, and domain-independent gestures. A multi-label array was utilized to gather gesture signals. Fine-grained gesture data could be obtained pre-processing with a novel data-processing method. Seemingly irregular RFID phase data could be converted into intuitive images for the deep learning module input as convolutional neural networks (CNNs) encompass automatic extraction characteristics for complex space-time features. The average accuracy of new environments for novel users is 95.6% and 96.6%, respectively (significantly better than current RFID-based solutions), thus demonstrating effectiveness and versatility.
Recently, radio frequency identification (RFID) sensing has attracted much attention due to its contact-free nature, low cost, light weight and other advantages. RFID-based person detection has also become a hot research topic, but there are still some problems in the existing research. First, most of the current studies cannot identify numerous people at a time well. Second, in order to detect more accurately, it is necessary to evaluate the whole-body activity of a person, which will consume a lot of time to process the data and cannot be applied in time. To solve these problems, in this paper we propose RF-Detection, a person detection system using RFID. First of all, RF-Detection takes step length as the standard for person detection, divides step length into specific sections according to the relationship between step length and height, and achieves high accuracy for new user detection through a large amount of training for a specific step length. Secondly, RF-Detection can better identify the number of people in the same space by segmenting continuous people. Finally, the data collection was reduced by expanding the data set, and the deep learning method was used to further improve the accuracy. The results show that the overall recognition accuracy of RF-Detection is 98.93%.
Gesture recognition can help people with a speech impairment to communicate and promote the development of Human-Computer Interaction (HCI) technology. With the development of wireless technology, passive gesture recognition based on RFID has become a research hotspot. In this paper, we propose a low-cost, non-invasive and scalable gesture recognition technology, and successfully implement the RF-alphabet, a gesture recognition system for complex, fine-grained, domain-independent 26 English letters; the RF-alphabet has three major advantages: first, this paper achieves complete capture of complex, fine-grained gesture data by designing a dual-tag, dual-antenna layout. Secondly, to overcome the disadvantages of the large training sets and long training times of traditional deep learning. We design and combine the Difference threshold similarity calculation prediction model to extract digital signal features to achieve real-time feature analysis of gesture signals. Finally, the RF alphabet solves the problem of confusing the signal characteristics of letters. Confused letters are distinguished by comparing the phase values of feature points. The RF-alphabet ends up with an average accuracy of 90.28% and 89.7% in different domains for new users and new environments, respectively, by performing feature analysis on similar signals. The real-time, robustness, and scalability of the RF-alphabet are proven.