Powdery mildew is a common disease in plants, and it is also one of the main diseases in the middle and final stages of cucumber (Cucumis sativus). Powdery mildew on plant leaves affects the photosynthesis, which may reduce the plant yield. Therefore, it is of great significance to automatically identify powdery mildew. Currently, most image-based models commonly regard the powdery mildew identification problem as a dichotomy case, yielding a true or false classification assertion. However, quantitative assessment of disease resistance traits plays an important role in the screening of breeders for plant varieties. Therefore, there is an urgent need to exploit the extent to which leaves are infected which can be obtained by the area of diseases regions. In order to tackle these challenges, we propose a semantic segmentation model based on convolutional neural networks (CNN) to segment the powdery mildew on cucumber leaf images at pixel level, achieving an average pixel accuracy of 96.08%, intersection over union of 72.11% and Dice accuracy of 83.45% on twenty test samples. This outperforms the existing segmentation methods, K-means, Random forest, and GBDT methods. In conclusion, the proposed model is capable of segmenting the powdery mildew on cucumber leaves at pixel level, which makes a valuable tool for cucumber breeders to assess the severity of powdery mildew.

Automatic recognition of mature fruits in a complex agricultural environment is still a challenge for an autonomous harvesting robot due to various disturbances existing in the background of the image. The bottleneck to robust fruit recognition is reducing influence from two main disturbances: illumination and overlapping. In order to recognize the tomato in the tree canopy using a low-cost camera, a robust tomato recognition algorithm based on multiple feature images and image fusion was studied in this paper. Firstly, two novel feature images, the a*-component image and the I-component image, were extracted from the L*a*b* color space and luminance, in-phase, quadrature-phase (YIQ) color space, respectively. Secondly, wavelet transformation was adopted to fuse the two feature images at the pixel level, which combined the feature information of the two source images. Thirdly, in order to segment the target tomato from the background, an adaptive threshold algorithm was used to get the optimal threshold. The final segmentation result was processed by morphology operation to reduce a small amount of noise. In the detection tests, 93% target tomatoes were recognized out of 200 overall samples. It indicates that the proposed tomato recognition method is available for robotic tomato harvesting in the uncontrolled environment with low cost.

In a GPS-hindered indoor environment, precise positioning is a challenge for mobile robots that perform accurate operations. For instance, during ridge-raising operations in plant factories, robots require positioning accuracy upto 5 cm, which is a pending issue in industry. To address this problem, we propose a ultraprecise simultaneous localization and mapping (SLAM) positioning method, namely, preciseSLAM, which tightly couples LiDAR, inertial measurement unit (IMU), and ultrasonic sensors to achieve ultraprecision, robustness, and real-time positioning performance. First, the preciseSLAM framework is established by fusing multimodal data from LiDAR, IMU, and ultrasonic sensors. Second, to effectively reduce naive SLAM positioning drift after long-term operation, a confidence zone optimization method is proposed for ultrasonic global positioning information. Finally, a factor graph optimization algorithm is developed to tightly couple four preciseSLAM factors, i.e., LiDAR odometry, IMU odometry, loop closure, and the specific ultrasonic global positioning factor. The proposed method effectively addresses the challenges in plant factory environments and can provide reliable and accurate positioning for intelligent robots. Experimental results demonstrate that preciseSLAM achieves a remarkable positioning accuracy of 5.4 cm in the indoor environment inside a plant factory. Compared with that of existing methods, preciseSLAM exhibits ultraprecision, superior robustness, and real-time performance. preciseSLAM provides a general-purpose positioning and navigation solution for robots in large-scale plant factories, which is among the very few methods that can deal with precise indoor positioning.

The automated measurement of crop phenotypic parameters is of great significance to the quantitative study of crop growth. The segmentation and classification of crop point cloud help to realize the automation of crop phenotypic parameter measurement. At present, crop spike-shaped point cloud segmentation has problems such as fewer samples, uneven distribution of point clouds, occlusion of stem and spike, disorderly arrangement of point clouds, and lack of targeted network models. The traditional clustering method can realize the segmentation of the plant organ point cloud with relatively independent spatial location, but the accuracy is not acceptable. This paper first builds a desktop-level point cloud scanning apparatus based on a structured-light projection module to facilitate the point cloud acquisition process. Then, the rice ear point cloud was collected, and the rice ear point cloud data set was made. In addition, data argumentation is used to improve sample utilization efficiency and training accuracy. Finally, a 3D point cloud convolutional neural network model called Panicle-3D was designed to achieve better segmentation accuracy. Specifically, the design of Panicle-3D is aimed at the multiscale characteristics of plant organs, combined with the structure of PointConv and long and short jumps, which accelerates the convergence speed of the network and reduces the loss of features in the process of point cloud downsampling. After comparison experiments, the segmentation accuracy of Panicle-3D reaches 93.4, which is higher than PointNet. Panicle-3D is suitable for other similar crop point cloud segmentation tasks.