Human activity recognition (HAR) has emerged as a significant area of research due to its numerous possible applications, including ambient assisted living, healthcare, abnormal behaviour detection, etc. Recently, HAR using WiFi channel state information (CSI) has become a predominant and unique approach in indoor environments compared to others (i.e., sensor and vision) due to its privacy-preserving qualities, thereby eliminating the need to carry additional devices and providing flexibility of capture motions in both line-of-sight (LOS) and non-line-of-sight (NLOS) settings. Existing deep learning (DL)-based HAR approaches usually extract either temporal or spatial features and lack adequate means to integrate and utilize the two simultaneously, making it challenging to recognize different activities accurately. Motivated by this, we propose a novel DL-based model named spatio-temporal convolution with nested long short-term memory (STC-NLSTMNet), with the ability to extract spatial and temporal features concurrently and automatically recognize human activity with very high accuracy. The proposed STC-NLSTMNet model is mainly comprised of depthwise separable convolution (DS-Conv) blocks, feature attention module (FAM) and NLSTM. The DS-Conv blocks extract the spatial features from the CSI signal and add feature attention modules (FAM) to draw attention to the most essential features. These robust features are fed into NLSTM as inputs to explore the hidden intrinsic temporal features in CSI signals. The proposed STC-NLSTMNet model is evaluated using two publicly available datasets: Multi-environment and StanWiFi. The experimental results revealed that the STC-NLSTMNet model achieved activity recognition accuracies of 98.20% and 99.88% on Multi-environment and StanWiFi datasets, respectively. Its activity recognition performance is also compared with other existing approaches and our proposed STC-NLSTMNet model significantly improves the activity recognition accuracies by 4% and 1.88%, respectively, compared to the best existing method.
Epilepsy is a complex neurological condition that affects a large number of people worldwide. Electroencephalography (EEG) measures the electrical activity of the brain and is widely used in epilepsy diagnosis, but it usually requires manual inspection, which can be hours long, by a neurologist. Several automatic systems have been proposed to detect epilepsy but still have some unsolved issues. In this study, we proposed a dynamic method using a deep learning model (Epileptic-Net) to detect an epileptic seizure. The proposed method is largely heterogeneous and comprised of the dense convolutional blocks (DCB), feature attention modules (FAM), residual blocks (RB), and hypercolumn technique (HT). Firstly, DCB is used to get the discriminative features from the EEG samples. Then, FAM extracts the essential features from the samples. After that, RB learns more vital parts as it entirely uses information in the convolutional layer. Finally, HT retains the efficient local features extracted from the layers situated at the different levels of the model. Its performance has been evaluated on the University of Bonn EEG dataset, divided into five distinct classes. The proposed Epileptic-Net achieves the average accuracy of 99.95% in the two-class classification, 99.98% in the three-class classification, 99.96% in the four-class classification, and 99.96% in classifying the complicated five-class problem. Thus the proposed approach shows more competitive results than the existing model to detect epileptic seizures. We also hope that this method can support experts in achieving objective and reliable results, lowering the misdiagnosis rate, and assisting in decision-making.
In signals of opportunity (SOPs)-based positioning utilizing low Earth orbit (LEO) satellites, ephemeris data derived from two-line element files can introduce increasing error over time. To handle the erroneous measurement, an additional base receiver with a known position is often used to compensate for the effect of ephemeris error when positioning the user terminal (UT). However, this approach is insufficient for long baseline (distance between base receiver and UT) as it fails to adequately correct Doppler shift measurement errors caused by ephemeris inaccuracies, resulting in degraded positioning performance. Moreover, the lack of clock synchronization between the base receiver and UT exacerbates erroneous Doppler shift measurements. To address these challenges, we put forth a robust double-difference Doppler shift-based positioning framework, coined 3DPose, to handle the clock synchronization issue between the base receiver and UT, and positioning degradation due to the long baseline. The proposed 3DPose framework leverages double-difference Doppler shift measurements to eliminate the clock synchronization issue and incorporates a novel ephemeris error correction algorithm to enhance UT positioning accuracy in case of the long baseline. The algorithm specifically characterizes and corrects the Doppler shift measurement errors arising from erroneous ephemeris data, focusing on satellite position errors in the tangential direction. To validate the effectiveness of the proposed framework, we conduct comparative analyses across three different scenarios, contrasting its performance with the existing differential Doppler positioning method. The results demonstrate that the proposed 3DPose framework achieves an average reduction of 90% in 3-dimensional positioning errors compared to the benchmark algorithm.
Nowadays WiFi based human activity recognition (WiFi-HAR) has gained much attraction in an indoor environment due to its various benefits, including privacy and security, device free sensing, and cost-effectiveness. Recognition of human-human interactions (HHIs) using channel state information (CSI) signals is still challenging. Although some deep learning (DL) based architectures have been proposed in this regard, most of them suffer from limited recognition accuracy and are unable to support low computation resource devices due to having a large number of model parameters. To address these issues, we propose a dynamic method using a lightweight DL model (HHI-AttentionNet) to automatically recognize HHIs, which significantly reduces the parameters with increased recognition accuracy. In addition, we present an Antenna-Frame-Subcarrier Attention Mechanism (AFSAM) in our model that enhances the representational capability to recognize HHIs correctly. As a result, the HHI-AttentionNet model focuses on the most significant features, ignoring the irrelevant features, and reduces the impact of the complexity on the CSI signal. We evaluated the performance of the proposed HHI-AttentionNet model on a publicly available CSI-based HHI dataset collected from 40 individual pairs of subjects who performed 13 different HHIs. Its performance is also compared with other existing methods. These proved that the HHI-AttentionNet is the best model providing an average accuracy, F1 score, Cohen’s Kappa, and Matthews correlation coefficient of 95.47%, 95.45%, 0.951%, and 0.950%, respectively, for recognition of 13 HHIs. It outperforms the best existing model’s accuracy by more than 4%.
Wi-Fi based human activity recognition is emerging and preferable over other approaches due to its numerous advantages, including privacy considerations, ubiquitousness, and easy deployment. While existing literature predominantly focuses on identifying the activities of a single-user, recognizing multi-person interactions (MPIs) is increasingly significant due to their profound social implications. However, research in this area has not progressed due to the limitation of publicly available Wi-Fi datasets and the complexities of MPI recognition. Motivated by this, we develop and publicly release a Wi-Fi channel state information (CSI) based MPI recognition dataset, coined Wi-MIR, that uses three transmit and three receive antennas to capture 270 ( $ {3}\times {3}\times {30}$ ) subcarriers with a sampling rate of 950 Hz. This dataset consists of 3740 trials encompassing seventeen distinct MPIs and is collected by eleven human pairs in an indoor environment. We put forth a lightweight deep learning model with attention mechanisms for MPI recognition from CSI, named CSI-IRNet, that adeptly concentrates on pertinent features, filtering out irrelevant elements, and mitigating the impact of signal complexity within the CSI for recognizing MPIs accurately. In addition, we compare the developed Wi-MIR and the existing public dataset by evaluating the performance of MPI recognition on both datasets to highlight the strengths and advancements provided by Wi-MIR. The evaluation results show that Wi-MIR dataset demonstrates a superior recognition performance by utilizing more subcarriers with a higher sampling rate as well as covering more diverse kinds of MPIs (Bowing, Conversation, Exchanging objects, Helping standup, Helping walk, and Touching another person).
Global navigation satellite systems (GNSS) face significant challenges in urban and sub-urban areas due to non-line-of-sight (NLOS) propagation, multipath effects, and low received power levels, resulting in highly non-linear and non-Gaussian measurement error distributions. In light of this, conventional model-based positioning approaches, which rely on Gaussian error approximations, struggle to achieve precise localization under these conditions. To overcome these challenges, we put forth a novel learning-based framework, PC-DeepNet, that employs a permutation-invariant (PI) deep neural network (DNN) to estimate position corrections (PC). This approach is designed to ensure robustness against changes in the number and/or order of visible satellite measurements, a common issue in GNSS systems, while leveraging NLOS and multipath indicators as features to enhance positioning accuracy in challenging urban and sub-urban environments. To validate the performance of the proposed framework, we compare the positioning error with state-of-the-art model-based and learning-based positioning methods using two publicly available datasets. The results confirm that proposed PC-DeepNet achieves superior accuracy than existing model-based and learning-based methods while exhibiting lower computational complexity compared to previous learning-based approaches.
About Me
Md Shafiqual Islam, Research Assistant and PhD Student, Kwangwoon University, Seoul, South Korea
Md Shafiqual Islam, Research Assistant and PhD Student, Kwangwoon University, Seoul, South Korea