Robotic mining equipment plays an increasingly important role in the coal mining industry. Due to the complexity of the confined underground environment, available localization methods are limited, and restrict the development of coal mine robots (CMRs). Ultra-wideband (UWB) is a promising positioning sensor with high ranging accuracy. However, current applications about UWB positioning in coal mine focus mainly on position information, but rarely on orientation information. Positioning accuracy is often plagued by the loss of transmitted signals and multipath effects. In this paper, a pseudo-GPS positioning system in underground coal mine, composed by noisy UWB range measurements, is proposed to provide localization service for CMRs. An Error-State Kalman Filter (ESKF) is used for fusing measurements from the inertial measurement unit (IMU) and the established UWB positioning system. Then the complete six degree of freedom (6-DOF) state estimation can be realized. Meanwhile the biases of the IMU and the translation parameters of IMU w.r.t. UWB mobile node are also estimated online to adapt to long-term operation in harsh underground environments. In addition, an UWB anchor optimal deployment strategy is discussed to deploy UWB nodes appropriately in the laneway, and maintain realistic positioning accuracy for CMR in the meantime. A large number of field tests in different environments including the actual underground coal mine were conducted. The experimental results showed that our method could obtain the pose estimation performance close to the state-of-the-art lidar odometry approach that has been currently utilized in underground coal mine, providing robust and precise localization estimation for CMR applications.
Visual-inertial simultaneous localization and mapping (VI-SLAM) is popular research topic in robotics. Because of its advantages in terms of robustness, VI-SLAM enjoys wide applications in the field of localization and mapping, including in mobile robotics, self-driving cars, unmanned aerial vehicles, and autonomous underwater vehicles. This study provides a comprehensive survey on VI-SLAM. Following a short introduction, this study is the first to review VI-SLAM techniques from filtering-based and optimization-based perspectives. It summarizes state-of-the-art studies over the last 10 years based on the back-end approach, camera type, and sensor fusion type. Key VI-SLAM technologies are also introduced such as feature extraction and tracking, core theory, and loop closure. The performance of representative VI-SLAM methods and famous VI-SLAM datasets are also surveyed. Finally, this study contributes to the comparison of filtering-based and optimization-based methods through experiments. A comparative study of VI-SLAM methods helps understand the differences in their operating principles. Optimization-based methods achieve excellent localization accuracy and lower memory utilization, while filtering-based methods have advantages in terms of computing resources. Furthermore, this study proposes future development trends and research directions for VI-SLAM. It provides a detailed survey of VI-SLAM techniques and can serve as a brief guide to newcomers in the field of SLAM and experienced researchers looking for possible directions for future work.
An accurate description of laneway space with self-localization is a key issue when coal mine rescue robots (CMRRs) perform post-disaster exploration and rescue missions. 3D Simultaneous Localization and Mapping (SLAM) is an effective but time-critical and highly challenging task in complex laneway scenarios, especially after disasters. In this paper, we propose a novel real-time 3D SLAM based on Normal Distributed Transform (NDT) that employs pose graph optimization and loop closure to further improve mapping consistency. We innovatively extract floors and walls in the laneway as plane nodes to construct landmark constraints, in addition to applying pose nodes from the lidar odometry via NDT. A lightweight and effective loop detection method is conducted using odometry with an appearance-based approach to build a global consistent map. The proposed method was evaluated on a public dataset, and field tests in an underground coal mine were performed. Results indicate that our algorithm can achieve lower computational complexity and drift, which can provide pose estimation and environment description for CMRRs to realize remote control assistance and automatic navigation in coal mine rescue missions.
Distinguishing between coal and gangue in the production lines of mining factories based on the thermal energy and infrared radiation emission of an object is feasible. In this paper, we use an infrared camera (IC) to distinguish between coal and gangue in the industrial mining field. Additionally, this system is considered to be a binary classification system that has two classes. We analyze the infrared images of coal and gangue; then extract the appropriate texture features from the infrared images in order to develop an accurate classification system by using support vector machine (SVM). The method applied in this work essentially depends on feature extraction of images. The statistical features based on gray level information (GLI), grey-level cooccurrence matrix (GLCM) and visual features are executed. Thus, we suggest preparation steps to obtain one select feature before importing the data into the SVM classifier, and this approach is adopted as the fundamental basis for our work. We exploit only one feature of the infrared image, namely, Cb, which is extracted from the YCbCr color space, and then compute the mean value of Cb after heating and capturing the photos for the coal and gangue samples. The proposed method achieves a high classification accuracy 97.83 % by using Gaussian-SVM.
Mobile robots in complex underground coal mine environments are still unable to achieve accurate pose estimation and the real-time reconstruction of scenes with absolute geographic information. Integrated terrestrial-underground localization and mapping technologies have still not been effectively developed. This paper proposes a multimodal robust SLAM method based on wireless beacon-assisted geographic information transmission and lidar-IMU-UWB elastic fusion mechanism (LIU-SLAM). In order to obtain the pose estimation and scene models consistent with the geographic information, the construction of two kinds of absolute geographic information constraints based on UWB beacons is proposed. An elastic multimodal fusion state estimation mechanism is designed based on incremental factor graph optimization. A tightly coupled lidar-inertial odometry is firstly designed to construct the lidar-inertial local transformation constraints, which are further integrated with the absolute geographic constraints by UWB anchors through a loosely coupled approach. Extensive field tests based on coal mine robots have been conducted in scenarios such as underground garages and underground coal mine laneways. The results show that the proposed geodesic-coordinate driven multimode robust SLAM method can obtain absolute localization accuracy within 25 cm with practical robustness and real-time performance in different underground application scenarios. The wireless beacon-assisted geodesic-coordinate transmission strategy can provide a plug-and-play customized solution for precise positioning and scene modeling in complex scenarios of various coal mine robot application.