This paper set out to investigate the usefulness of solving collision avoidance problems with the help of deep reinforcement learning in an unknown environment, especially in compact spaces, such as a narrow corridor. This research aims to determine whether a deep reinforcement learning-based collision avoidance method is superior to the traditional methods, such as potential field-based methods and dynamic window approach. Besides, the proposed obstacle avoidance method was developed as one of the capabilities to enable each robot in a novel robotic system, namely the Self-reconfigurable and Transformable Omni-Directional Robotic Modules (STORM), to navigate intelligently and safely in an unknown environment. A well-conceived hardware and software architecture with features that enable further expansion and parallel development designed for the ongoing STORM projects is also presented in this work. A virtual STORM module with skid-steer kinematics was simulated in Gazebo to reduce the gap between the simulations and the real-world implementations. Moreover, comparisons among multiple training runs of the neural networks with different parameters related to balance the exploitation and exploration during the training process, as well as tests and experiments conducted in both simulation and real-world, are presented in detail. Directions for future research are also provided in the paper.
This paper presents the path planning and motion control of a self-reconfigurable mobile robot system, focusing on module-to-module autonomous docking and alignment tasks. STORM, which stands for Self-configurable and Transformable Omni-Directional Robotic Modules, features a unique mode-switching ability and novel docking mechanism design. This enables the modules that make up STORM to dock with each other and form a variety configurations in or to perform a large array of tasks. The path planning and motion control presented here consists of two parallel schemes. A Lyapunov function-based precision controller is proposed to align the target docking mechanisms in a small range of the target position. Then, an optimization-based path planning algorithm is proposed to help find the fastest path and determine when to switch its locomotion mode in a much larger range. Both numerical simulations and real-world experiments were carried out to validate these proposed controllers.