14 October 2018 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Human following in structured indoor environments has to face the challenge of full occlusion caused by the walls when the target person makes a turn at the corridor intersections. This may result in short-term, and even permanent loss of the target from the field of view of the robot. In this paper, human following with a mobile robot in presence of potential occlusions occurring at corridor intersections is addressed. The robot detects four different types of corridor intersections using the on-board laser scanner. Then, a potential-field-based human tracker is designed by integrating the intersection information into the potential function, in order to increase the visibility of the target, while maintaining the relative distance and orientation between the target and the robot. Simultaneously, the robot builds a multihypothesis topological map of the environment based on an improved generalized Voronoi graph, where the edges represent the corridors and the vertices are the virtual meet points extracted from the intersections. In such a way, simultaneous human following and topological mapping are achieved. Simulation and experimental results show that the proposed method can largely avoid occlusion of the target and obtain good performance of human following and topological mapping.
27 June 2019 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Target recognition is a challenging task for human following of mobile service robots. In this paper, we combine the principal-component-analysis (PCA)-based face recognition with the tracking-learning-detection applied to the human face (Face-TLD) to obtain an improvement, named as IFace-TLD. The proposed IFace-TLD can significantly improve the discrimination ability of the Face-TLD for ambiguous facial appearances. To further deal with motion uncertainties of the human head, especially the sudden motion change, which makes face-based target recognition methods unstable or even loses the target, a skeleton-based model is introduced to improve the accuracy and robustness of the target recognition. Specifically, within a walk half-cycle, the skeleton features are extracted from the upper-body three-dimensional skeleton coordinates. Then, the extracted skeleton features are fed into the support vector data description (SVDD) to identify the target person when the IFace-TLD becomes invalid. The seamless fusion of the skeleton recognition and the IFace-TLD, named as the SIFace-TLD, significantly enhances the robustness in complex scenarios, especially for people tracking from both front and behind. To achieve a complete human following system, the particle filter (PF) is adopted for estimating the state of the human motion. And then, a controller is designed to maintain the relative position between the robot and the target. Experimental results demonstrate that the proposed IFace-TLD is more accurate and flexible than the original Face-TLD. And the SIFace-TLD shows a robust performance to human motion uncertainties. Moreover, the developed controller can achieve a satisfactory human following performance.