The key to precise weeding in the field lies in the efficient detection of weeds. There are no studies on weed detection in potato fields. In view of the difficulties brought by the cross-growth of potatoes and weeds to the detection of weeds, the existing detection methods cannot meet the requirements of detection speed and detection accuracy at the same time. This study proposes an improved YOLOv4 model for weed detection in potato fields. The proposed algorithm replaces the backbone network CSPDarknet53 in the YOLOv4 network structure with the lightweight MobileNetV3 network and introduces Depthwise separable convolutions instead of partial traditional convolutions in the Path Aggregation Network (PANet), which reduces the computational cost of the model and speeds up its detection. In order to improve the detection accuracy, the convolutional block attention module (CBAM) is fused into the PANet structure, and the CBAM will process the input feature map with a channel attention mechanism (CAM) and spatial attention mechanism (SAM), respectively, which can enhance the extraction of useful feature information. The K-means++ clustering algorithm is used instead of the K-means clustering algorithm to update the anchor box information of the model so that the anchor boxes are more suitable for the datasets in this study. Various image processing methods such as CLAHE, MSR, SSR, and gamma are used to increase the robustness of the model, which eliminates the problem of overfitting. CIoU is used as the loss function, and the cosine annealing decay method is used to adjust the learning rate to make the model converge faster. Based on the above-improved methods, we propose the MC-YOLOv4 model. The mAP value of the MC-YOLOv4 model in weed detection in the potato field was 98.52%, which was 3.2%, 4.48%, 2.32%, 0.06%, and 19.86% higher than YOLOv4, YOLOv4-tiny, Faster R-CNN, YOLOv5 l, and SSD(MobilenetV2), respectively, and the average detection time of a single image was 12.49ms. The results show that the optimized method proposed in this paper outperforms other commonly used target detection models in terms of model footprint, detection time consumption, and detection accuracy. This paper can provide a feasible real-time weed identification method for the system of precise weeding in potato fields with limited hardware resources. This model also provides a reference for the efficient detection of weeds in other crop fields and provides theoretical and technical support for the automatic control of weeds.

The relative position of the orchard robot to the rows of fruit trees is an important parameter for achieving autonomous navigation. The current methods for estimating the position parameters between rows of orchard robots obtain low parameter accuracy. To address this problem, this paper proposes a machine vision-based method for detecting the relative position of orchard robots and fruit tree rows. First, the fruit tree trunk is identified based on the improved YOLOv4 model; second, the camera coordinates of the tree trunk are calculated using the principle of binocular camera triangulation, and the ground projection coordinates of the tree trunk are obtained through coordinate conversion; finally, the midpoints of the projection coordinates of different sides are combined, the navigation path is obtained by linear fitting with the least squares method, and the position parameters of the orchard robot are obtained through calculation. The experimental results show that the average accuracy and average recall rate of the improved YOLOv4 model for fruit tree trunk detection are 5.92% and 7.91% higher, respectively, than those of the original YOLOv4 model. The average errors of heading angle and lateral deviation estimates obtained based on the method in this paper are 0.57° and 0.02 m. The method can accurately calculate heading angle and lateral deviation values at different positions between rows and provide a reference for the autonomous visual navigation of orchard robots.

In order to guide the orchard management robot to realize autonomous steering in the row ends of a complex orchard environment, this paper proposes setting up steering markers in the form of fruit trees at the end of the orchard rows and realizing the rapid detection of the steering markers of the orchard management robot through the fast and accurate recognition and classification of different steering markers. First, a high-precision YOLOv7 model is used, and the depthwise separable convolution (DSC) is used instead of the 3 × 3 ordinary convolution, which improves the speed of model detection; at the same time, in order to avoid a decline in detection accuracy, the Convolutional Block Attention Module (CBAM) is added to the model, and the Focal loss function is introduced to improve the model’s attention to the imbalanced samples. Second, a binocular camera is used to quickly detect the steering markers, obtain the position information of the robot to the steering markers, and determine the starting point position of the robot’s autonomous steering based on the position information. Our experiments show that the average detection accuracy of the improved YOLOv7 model reaches 96.85%, the detection time of a single image reaches 15.47 ms, and the mean value of the localization error is 0.046 m. Comparing with the YOLOv4, YOLOv4-tiny, YOLOv5-s, and YOLOv7 models, the improved YOLOv7 model outperforms the other models in terms of combined detection time and detection accuracy. Therefore, the model proposed in this paper can quickly and accurately perform steering marker detection and steering start point localization, avoiding problems such as steering errors and untimely steering, shortening the working time and improving the working efficiency. This model also provides a reference and technical support for research on robot autonomous steering in other scenarios.

The relative position of the orchard robot to the rows of fruit trees is an important parameter for achieving autonomous navigations. The current methods for estimating the position parameters between rows of orchard robots obtain low parameter accuracy, and to address this problem, this paper proposes a machine vision-based method for detecting the relative position of orchard robots and fruit tree rows. Firstly, the fruit tree trunk is identified based on the improved YOLOv4 model; secondly, the camera coordinates of the tree trunk are calculated from the principle of binocular camera triangulation, and the ground projection coordinates of the tree trunk are obtained through coordinate conversion; finally, the midpoints of the projection coordinates of different sides are combined and the navigation path is obtained by linear fitting with the least squares method, and the position parameters of the orchard robot are obtained through calculation. The experimental results show that the average accuracy and average recall of the improved YOLOv4 model for fruit tree trunk detection are 97.05% and 95.42%, respectively, which are 5.92 and 7.91 percentage points higher than those of the original YOLOv4 model. The average errors of heading angle and lateral deviation estimates obtained based on the method in this paper are 0.57° and 0.02 m. The method can accurately calculate heading angle and lateral deviation values at different positions between rows, and can provide a reference for autonomous visual navigation of orchard robots.