The widespread popularity of smartphones makes it possible to provide Location-Based Services (LBS) in a variety of complex scenarios. The location and contextual status, especially the Indoor/Outdoor switching, provides a direct indicator for seamless indoor and outdoor positioning and navigation. It is challenging to quickly detect indoor and outdoor transitions with high confidence due to a variety of signal variations in complex scenarios and the similarity of indoor and outdoor signal sources in the IO transition regions. In this paper, we consider the challenge of switching quickly in IO transition regions with high detection accuracy in complex scenarios. Towards this end, we analyze and extract spatial geometry distribution, time sequence and statistical features under different sliding windows from GNSS measurements in Android smartphones and present a novel IO detection method employing an ensemble model based on stacking and filtering the detection result by Hidden Markov Model. We evaluated our algorithm on four datasets. The results showed that our proposed algorithm was capable of identifying IO state with 99.11% accuracy in indoor and outdoor environment where we have collected data and 97.02% accuracy in new indoor and outdoor scenarios. Furthermore, in the scenario of indoor and outdoor transition where we have collected data, the recognition accuracy reaches 94.53% and the probability of switching delay within 3 s exceeds 80%. In the new scenario, the recognition accuracy reaches 92.80% and the probability of switching delay within 4 s exceeds 80%.
In recent years, with the widespread popularity of smart mobile devices, seamless location-based service (LBS) between indoor and outdoor space has becoming an emerging requirement. As the direct indicator of location and contextual status, accurate indoor/outdoor status guarantees stability and continuity for human localization and activity recognition. Rich-sensor smart phones have made possible various context sensing. However, it is challenging to realize fast and accurate indoor and outdoor switching detection in the dynamic and complex environments with variable sensory signals. Towards this end, we propose a multi-sensor Deep Learning model to predict the IO state, which consists of four parts: sensor vectors, 1D (one dimensional) Sensor DenseNet, LSTM and MLP. Unlike the traditional feature engineering and fixed threshold strategy, we utilize 1D Sensor DenseNet to extract higher-level features for different sensors, and then utilize LSTM to capture signal change pattern in time series. Finally, we leverage the MLP to classify indoor/outdoor scenes. We evaluated our proposed architecture on two datasets, one for only differentiating indoor and outdoor scenes and one for detecting the indoor/outdoor switching scenes. Extensive experimental results show that our proposed method outperforms the fixed threshold method, traditional machine learning based methods, and other existing neural network based methods in terms of switching delay and recognition accuracy.
4 July 2023 in IEEE Transactions on Neural Networks and Learning Systems
With the proliferation of intelligent sensors integrated into mobile devices, fine-grained human activity recognition (HAR) based on lightweight sensors has emerged as a useful tool for personalized applications. Although shallow and deep learning algorithms have been proposed for HAR problems in the past decades, these methods have limited capability to exploit semantic features from multiple sensor types. To address this limitation, we propose a novel HAR framework, DiamondNet, which can create heterogeneous multisensor modalities, denoise, extract, and fuse features from a fresh perspective. In DiamondNet, we leverage multiple 1-D convolutional denoising autoencoders (1-D-CDAEs) to extract robust encoder features. We further introduce an attention-based graph convolutional network to construct new heterogeneous multisensor modalities, which adaptively exploit the potential relationship between different sensors. Moreover, the proposed attentive fusion subnet, which jointly employs a global-attention mechanism and shallow features, effectively calibrates different-level features of multiple sensor modalities. This approach amplifies informative features and provides a comprehensive and robust perception for HAR. The efficacy of the DiamondNet framework is validated on three public datasets. The experimental results demonstrate that our proposed DiamondNet outperforms other state-of-the-art baselines, achieving remarkable and consistent accuracy improvements. Overall, our work introduces a new perspective on HAR, leveraging the power of multiple sensor modalities and attention mechanisms to significantly improve the performance.
7 September 2022 in IEEE Internet of Things Journal
Human activity recognition (HAR) based on wearable sensors has been a prosperous research topic in recent years. Considering that the sensor may be worn at diverse body positions, obtaining enough labeled human activity data for each body-worn position is usually expensive and labor-intensive. Furthermore, the variability and diversity of data distribution induced by different body-worn positions make the HAR model trained on data collected from one body position perform poorly for other body-worn positions. To achieve accurate HAR with low labeling cost, which we call unsupervised cross-position HAR, in this article, we propose a deep multiscale transfer learning (DMSTL) model. In the model, we first introduce an unsupervised source selection method to select the most similar source domain for transferring domain knowledge. Then, we develop a multiscale spatial–temporal Net (MSSTNet) to learn comprehensive multimodal representations from multiple feature subspaces. Finally, we design the category-level adaptation module and the domain-level adversarial module for learning domain-invariant features. We conduct extensive experiments on three public HAR data sets and demonstrate the reasonable generalization performance of the DMSTL, which remarkably outperforms other state-of-the-art baselines.
12 July 2022 in IEEE Transactions on Intelligent Transportation Systems
Accurate location data of ground vehicles is very important for various intelligent transportation applications. As one of the most commonly-used navigation solutions at present, the GNSS/INS integrated navigation still cannot meet the accuracy and stability command of current applications. This paper presents a National Marine Electronics Association (NMEA) protocol data-assisted high-accuracy navigation algorithm based on GNSS position error estimation using multi-task learning (MT-e&R), which can accurately estimate the GNSS position error and GNSS measurement noise covariance matrix with the assistance of protocol data and a multi-task learning model. Extensive experimental results on practical navigation data collected in various urban environments of Beijing demonstrate that our proposed approach can improve the performance of integrated navigation system. The positioning errors of integrated navigation equipped with single-frequency receiver are reduced by 36.17% and 39.58% for double-frequency receiver, which confirms the reasonable environmental adaptability of our proposed MT-e&R algorithm.
Human Activity Recognition (HAR) is crucial in fields such as human-computer interaction, motion estimation, and intelligent transportation. Yet, attaining high accuracy in HAR, especially in scenarios limited by computing resources, poses a considerable challenge. This paper presents SMLDist (Stage-Memory-Logits Distillation), a framework designed to build highly customizable HAR models that achieve optimal performance under various resource constraints. SMLDist prioritizes frequency-related features in its distillation process to bolster HAR classification robustness. We also introduce an auto-search mechanism within heterogeneous classifiers to boost performance further. Our evaluation addresses the challenges of generalizing across users, sensor placements, and recognizing a wide array of activity modes. Models crafted with SMLDist, leveraging a teacher-based approach that achieves a 40%-50% reduction in operational expenditure, surpass the performance of existing state-of-the-art architectures. When assessing computational costs and energy consumption on the Jetson Xavier AGX platform, SMLDist-based models show strong economic and environmental sustainability advantages. Our results indicate that SMLDist effectively alleviates the performance degradation typically associated with limited computational resources, underscoring its significant theoretical and practical contributions to the field of HAR.