We present a self-supervised approach for learning to predict traversable paths for wheeled mobile robots that require good traction to navigate. Our algorithm, termed WayFAST (Waypoint Free Autonomous Systems for Traversability), uses RGB and depth data, along with navigation experience, to autonomously generate traversable paths in outdoor unstructured environments. Our key inspiration is that traction can be estimated for rolling robots using kinodynamic models. Using traction estimates provided by an online receding horizon estimator, we are able to train a traversability prediction neural network in a self-supervised manner, without requiring heuristics utilized by previous methods. We demonstrate the effectiveness of WayFAST through extensive field testing in varying environments, ranging from sandy dry beaches to forest canopies and snow covered grass fields. Our results clearly demonstrate that WayFAST can learn to avoid geometric obstacles as well as untraversable terrain, such as snow, which would be difficult to avoid with sensors that provide only geometric data, such as LiDAR. Furthermore, we show that our training pipeline based on online traction estimates is more data-efficient than other heuristic-based methods.

Small robotic vehicles have been navigating agricultural fields in the pursuit of new possibilities to increase agricultural production and to meet the increasing food and energetic demands. However, a perception system with reliable awareness of the surroundings remains a challenge to achieve autonomous navigation. Camera and single-layer laser scanners have been the primary sources of information, yet the first suffers from outdoor light sensibility and both from occlusion by leaves. This paper describes a three-dimensional system acquisition for corn crops. The sensing core is a single-layer UTM30-LX laser scanner rotating around its axis, while an inertial sensor provides angular measurements. With the rotation, multiple layers are used to compose a 3D point cloud, which is represented by a two-dimensional occupancy grid. Each cell is filled according to the number of readings, and their weights derive from two procedures: firstly, a mask enhances vertical entities (stalks); secondly, two Gaussian functions on the expected position of the immediate neighboring rows weaken readings in the middle of the lane and farther rows. The resulting occupancy grid allows the representation of the cornrows by virtual walls, which are used as references to a wall follower algorithm. According to experimental results, the virtual walls are segmented with reduced influence from straying leaves and sparse weeds when compared to the segmentation done with single-layer laser scanner data. Indeed, 64.02% of 3D outputs are within 0.05 m limit error from expected lane width, while only 11.63% of single-layer laser data are within same limit.