To obtain more consistent measurements through the course of a wheat growing season, we conceived and designed an autonomous robotic platform that performs collision avoidance while navigating in crop rows using spatial artificial intelligence (AI). The main constraint the agronomists have is to not run over the wheat while driving. Accordingly, we have trained a spatial deep learning model that helps navigate the robot autonomously in the field while avoiding collisions with the wheat. To train this model, we used publicly available databases of prelabeled images of wheat, along with the images of wheat that we have collected in the field. We used the MobileNet single shot detector (SSD) as our deep learning model to detect wheat in the field. To increase the frame rate for real-time robot response to field environments, we trained MobileNet SSD on the wheat images and used a new stereo camera, the Luxonis Depth AI Camera. Together, the newly trained model and camera could achieve a frame rate of 18–23 frames per second (fps)—fast enough for the robot to process its surroundings once every 2–3 inches of driving. Once we knew the robot accurately detects its surroundings, we addressed the autonomous navigation of the robot. The new stereo camera allows the robot to determine its distance from the trained objects. In this work, we also developed a navigation and collision avoidance algorithm that utilizes this distance information to help the robot see its surroundings and maneuver in the field, thereby precisely avoiding collisions with the wheat crop. Extensive experiments were conducted to evaluate the performance of our proposed method. We also compared the quantitative results obtained by our proposed MobileNet SSD model with those of other state-of-the-art object detection models, such as the YOLO V5 and Faster region-based convolutional neural network (R-CNN) models. The detailed comparative analysis reveals the effectiveness of our method in terms of both model precision and inference speed.

Uncontrolled spread of eastern red cedar invades the United States Great Plains prairie ecosystems and lowers biodiversity across native grasslands. The eastern red cedar (ERC) infestations cause significant challenges for ranchers and landowners, including the high costs of removing mature red cedars, reduced livestock forage feed, and reduced revenue from hunting leases. Therefore, a fleet of autonomous ground vehicles (AGV) is proposed to address the ERC infestation. However, detecting the target tree or trunk in a rangeland environment is critical in automating an ERC cutting operation. A tree trunk detection method was developed in this study for ERC trees trained in natural rangeland environments using a deep learning-based YOLOv5 model. An action camera acquired RGB images in a natural rangeland environment. A transfer learning method was adopted, and the YOLOv5 was trained to detect the varying size of the ERC tree trunk. A trained model precision, recall, and average precision were 87.8%, 84.3%, and 88.9%. The model accurately predicted the varying tree trunk sizes and differentiated between trunk and branches. This study demonstrated the potential for using pretrained deep learning models for tree trunk detection with RGB images. The developed machine vision system could be effectively integrated with a fleet of AGVs for ERC cutting. The proposed ERC tree trunk detection models would serve as a fundamental element for the AGV fleet, which would assist in effective rangeland management to maintain the ecological balance of grassland systems.