We propose a novel 6-degree-of-freedom (DoF) visual simultaneous localization and mapping (SLAM) method based on the structural regularity of man-made building environments. The idea is that we use the building structure lines as features for localization and mapping. Unlike other line features, the building structure lines encode the global orientation information that constrains the heading of the camera over time, eliminating the accumulated orientation errors and reducing the position drift in consequence. We extend the standard extended Kalman filter visual SLAM method to adopt the building structure lines with a novel parameterization method that represents the structure lines in dominant directions. Experiments have been conducted in both synthetic and real-world scenes. The results show that our method performs remarkably better than the existing methods in terms of position error and orientation error. In the test of indoor scenes of the public RAWSEEDS data sets, with the aid of a wheel odometer, our method produces bounded position errors about 0.79 m along a 967-m path although no loop-closing algorithm is applied.

Accurate indoor localization information of the quadrotor plays an important role in many Internet of Things applications. To improve the estimation accuracy and robustness, a fix-lag extended finite impulse response smoother (FEFIRS) algorithm is proposed for fusing the inertial navigation system (INS) and ultra wide band (UWB) data tightly, which employs distance between the UWB reference nodes and a blind node measured by the INS and UWB. The FEFIRS algorithm consists of an extended unbiased finite impulse response (EFIR) filter and a fix-lag unbiased FIR (UFIR) smoother. The EFIR filter is employed to improve the robustness, and the fix-lag UFIR smoother is capable of improving the accuracy. Based on extensive test investigations employing real data, the proposed FEFIRS has a higher accuracy and robustness than the Kalman-based solutions in tightly integrated INS/UWB-based indoor quadrotor localization.

In this paper, we propose a novel visual-inertial odometry (VIO) approach that adopts structural regularity in man-made environments. Instead of using Manhattan world assumption, we use Atlanta world model to describe such regularity. An Atlanta world is a world that contains multiple local Manhattan worlds with different heading directions. Each local Manhattan world is detected on the fly, and their headings are gradually refined by the state estimator when new observations are received. With full exploration of structural lines that aligned with each local Manhattan worlds, our VIO method becomes more accurate and robust, as well as more flexible to different kinds of complex man-made environments. Through benchmark tests and real-world tests, the results show that the proposed approach outperforms existing visual-inertial systems in large-scale man-made environments.

Smartphone positioning is an enabling technology used to create new business in the navigation and mobile location-based services (LBS) industries. This paper presents a smartphone indoor positioning engine named HIPE that can be easily integrated with mobile LBS. HIPE is a hybrid solution that fuses measurements of smartphone sensors with wireless signals. The smartphone sensors are used to measure the user’s motion dynamics information (MDI), which represent the spatial correlation of various locations. Two algorithms based on hidden Markov model (HMM) problems, the grid-based filter and the Viterbi algorithm, are used in this paper as the central processor for data fusion to resolve the position estimates, and these algorithms are applicable for different applications, e.g., real-time navigation and location tracking, respectively. HIPE is more widely applicable for various motion scenarios than solutions proposed in previous studies because it uses no deterministic motion models, which have been commonly used in previous works. The experimental results showed that HIPE can provide adequate positioning accuracy and robustness for different scenarios of MDI combinations. HIPE is a cost-efficient solution, and it can work flexibly with different smartphone platforms, which may have different types of sensors available for the measurement of MDI data. The reliability of the positioning solution was found to increase with increasing precision of the MDI data.

The inspection of insulators and their defects is of great significance for ensuring the safety and stability of power system. Small sample is one of the main issues of insulator defect detection based on neural networks. In this research, we release a dataset for insulators and self-explosive defects detection and provide a benchmark based on improved YOLOv5, named Foggy Insulator Network (FINet). In this work, a synthetic fog algorithm is implemented and optimized. A synthetic foggy insulator dataset (SFID) with 13 000 images is constructed and released. The YOLOv5 network is improved into SE-YOLOv5 by introducing the channel attention mechanism, and a robust detection model with 96.2% F1 score for insulators and their defects is trained from scratch and served as a benchmark. The synthetic fog algorithm proposed in this article can be widely used for data augmentation of various datasets. The trained model can be applied in the field of transmission line inspection. The source codes, datasets, and tutorials are available on GitHub.

This research focuses on sensing context, modeling human behavior and developing a new architecture for a cognitive phone platform. We combine the latest positioning technologies and phone sensors to capture human movements in natural environments and use the movements to study human behavior. Contexts in this research are abstracted as a Context Pyramid which includes six levels: Raw Sensor Data, Physical Parameter, Features/Patterns, Simple Contextual Descriptors, Activity-Level Descriptors, and Rich Context. To achieve implementation of the Context Pyramid on a cognitive phone, three key technologies are utilized: ubiquitous positioning, motion recognition, and human behavior modeling. Preliminary tests indicate that we have successfully achieved the Activity-Level Descriptors level with our LoMoCo (Location-Motion-Context) model. Location accuracy of the proposed solution is up to 1.9 meters in corridor environments and 3.5 meters in open spaces. Test results also indicate that the motion states are recognized with an accuracy rate up to 92.9% using a Least Square-Support Vector Machine (LS-SVM) classifier.