After decades of research, there is still no solution for indoor localization like the GNSS (Global Navigation Satellite System) solution for outdoor environments. The major reasons for this phenomenon are the complex spatial topology and RF transmission environment. To deal with these problems, an indoor scene constrained method for localization is proposed in this paper, which is inspired by the visual cognition ability of the human brain and the progress in the computer vision field regarding high-level image understanding. Furthermore, a multi-sensor fusion method is implemented on a commercial smartphone including cameras, WiFi and inertial sensors. Compared to former research, the camera on a smartphone is used to “see” which scene the user is in. With this information, a particle filter algorithm constrained by scene information is adopted to determine the final location. For indoor scene recognition, we take advantage of deep learning that has been proven to be highly effective in the computer vision community. For particle filter, both WiFi and magnetic field signals are used to update the weights of particles. Similar to other fingerprinting localization methods, there are two stages in the proposed system, offline training and online localization. In the offline stage, an indoor scene model is trained by Caffe (one of the most popular open source frameworks for deep learning) and a fingerprint database is constructed by user trajectories in different scenes. To reduce the volume requirement of training data for deep learning, a fine-tuned method is adopted for model training. In the online stage, a camera in a smartphone is used to recognize the initial scene. Then a particle filter algorithm is used to fuse the sensor data and determine the final location. To prove the effectiveness of the proposed method, an Android client and a web server are implemented. The Android client is used to collect data and locate a user. The web server is developed for indoor scene model training and communication with an Android client. To evaluate the performance, comparison experiments are conducted and the results demonstrate that a positioning accuracy of 1.32 m at 95% is achievable with the proposed solution. Both positioning accuracy and robustness are enhanced compared to approaches without scene constraint including commercial products such as IndoorAtlas.

Indoor localization is one of the fundamentals of location-based services (LBS) such as seamless indoor and outdoor navigation, location-based precision marketing, spatial cognition of robotics, etc. Visual features take up a dominant part of the information that helps human and robotics understand the environment, and many visual localization systems have been proposed. However, the problem of indoor visual localization has not been well settled due to the tough trade-off of accuracy and cost. To better address this problem, a localization method based on image retrieval is proposed in this paper, which mainly consists of two parts. The first one is CNN-based image retrieval phase, CNN features extracted by pre-trained deep convolutional neural networks (DCNNs) from images are utilized to compare the similarity, and the output of this part are the matched images of the target image. The second one is pose estimation phase that computes accurate localization result. Owing to the robust CNN feature extractor, our scheme is applicable to complex indoor environments and easily transplanted to outdoor environments. The pose estimation scheme was inspired by monocular visual odometer, therefore, only RGB images and poses of reference images are needed for accurate image geo-localization. Furthermore, our method attempts to use lightweight datum to present the scene. To evaluate the performance, experiments are conducted, and the result demonstrates that our scheme can efficiently result in high location accuracy as well as orientation estimation. Currently the positioning accuracy and usability enhanced compared with similar solutions. Furthermore, our idea has a good application foreground, because the algorithms of data acquisition and pose estimation are compatible with the current state of data expansion.

Pedestrian walking speeds (PWS) can be used as a “body speedometer” to reveal health status information of pedestrians and positioning indoors with other locating methods. This paper proposes a pose awareness solution for estimating pedestrian walking speeds using the sensors built in smartphones. The smartphone usage pose is identified by using a machine learning approach based on data from multiple sensors. The data are then coupled tightly with an adaptive step detection solution to estimate the pedestrian walking speed. Field tests were carried out to verify the advantages of the proposed algorithms compared to existing solutions. The test results demonstrated that the features extracted from the data of the smartphone built-in sensors clearly reveal the characteristics of the pose pattern, with overall accuracy of 98.85% and a kappa statistic of 98.46%. The proposed walking speed estimation solution, running in real-time on a commercial smartphone, performed well, with a mean absolute error of 0.061 m/s, under a challenging walking process combining various usage poses including texting, calling, swinging, and in-pocket modes.

Containment is the first-priority measure in infection control to curb the spread of highly infectious diseases such as COVID-19. Home quarantine is one such measure to keep people at their accommodations for the incubation period (typically 14 days). Compared to dedicated monitoring centers, home quarantine is a more cost-effective and comfortable approach to isolate a large number of low-risk people. However, efficient monitoring of confinees inside their accommodations is a challenging problem because the quarantined locations are scattered throughout the city. We propose and study SignatureHome, an automated IoT-based geofencing algorithm to cost-effectively monitor confinees. The core principles of SignatureHome was adopted by the Hong Kong government and implemented as an app to enforce home quarantine order in March 2020 for hundreds of thousands of entrants from other regions.The system employs waterproof Bluetooth Low Energy wristbands that are uniquely paired with the confinees' smartphones. SignatureHome uses the identifiers of the environmental network facilities (Wi-Fi access points and cellular networks) as the home signature. By comparing the current observed signals of the phone with the home signature, the algorithm can efficiently determine whether the user is within the geofenced area. SignatureHome is computationally efficient, responsive, privacy-preserving, cost-effective, and adaptive to home diversity and changing environments. Our experimental results validate its design and high accuracy in terms of precision, recall, F-measure, and false alarm rate.

Accurate multispectral image segmentation is essential in remote sensing research. Traditional fuzzy clustering algorithms used to segment multispectral images have several disadvantages, including: (1) they usually only consider the pixels’ grayscale information and ignore the interaction between pixels; and, (2) they are sensitive to noise and outliers. To overcome these constraints, this study proposes a multispectral image segmentation algorithm based on fuzzy clustering combined with the Tsallis entropy and Gaussian mixture model. The algorithm uses the fuzzy Tsallis entropy as regularization item for fuzzy C-means (FCM) and improves dissimilarity measure using the negative logarithm of the Gaussian Mixture Model (GMM). The Hidden Markov Random Field (HMRF) is introduced to define prior probability of neighborhood relationship, which is used as weights of the Gaussian components. The Lagrange multiplier method is used to solve the segmentation model. To evaluate the proposed segmentation algorithm, simulated and real multispectral images were segmented using the proposed algorithm and two other algorithms for comparison (i.e., Tsallis Fuzzy C-means (TFCM), Kullback–Leibler Gaussian Fuzzy C-means (KLG-FCM)). The study found that the modified algorithm can accelerate the convergence speed, reduce the effect of noise and outliers, and accurately segment simulated images with small gray level differences with an overall accuracy of more than 98.2%. Therefore, the algorithm can be used as a feasible and effective alternative in multispectral image segmentation, particularly for those with small color differences.

With the rapid advances and the penetration of the Internet of Things and sensors, a massive amount of trajectory data, given by discrete locations at certain timestamps, have been extracted or collected. Knowing the similarity between trajectories is fundamental to understanding their spatial-temporal correlation, with direct and far-reaching applications in contact tracing, companion detection, personalized marketing, etc. In this work, we consider the general and realistic sensing scenario that the locations of the trajectories may be noisy, and that these trajectories are sporadically sampled with randomness and asynchrony from the underlying continuous paths. Most of the prior work on trajectory similarity has not sufficiently considered the temporal dimension, or the issues of location noise and sporadic sampling, while others have limitations of strong assumptions such as a fixed known speed of users or the availability of a large amount of training data.We propose a novel and effective spatial-temporal measure termed STS (Spatial-Temporal Similarity) to evaluate the spatial-temporal overlap between any two trajectories. In order to account for the location noise and sporadic sampling, STS models each location in a trajectory as an observable outcome drawn from a probability distribution. With that, it efficiently reduces the need for training data by estimating a personalized spatial-temporal probability distribution of the object position from its own trajectory. Based on that, it subsequently computes the co-location probability and hence derives the similarity of any two trajectories. We have conducted extensive experiments to evaluate STS using real large-scale indoor (mall) and outdoor (taxi) datasets. Our results show that STS is substantially more accurate and robust than the state-of-the-art approaches, with an improvement of 63% on precision and 85% on mean rank.