In the fresh tomato market, it is crucial to sort and sell tomatoes based on their quality. This is important to enhance the competitiveness and profitability of the market. However, the manual sorting process is subjective and inefficient. To address this issue, we have developed an automatic tomato sorting system that uses the Raspberry PI 4B as the control platform for the robot arm. This system has been integrated with a human–computer interaction interface sorting system. Our experimental results indicate that this sorting method has an accuracy rate of 99.1% and an efficiency of 1350 tomatoes per hour. This development is in line with modern agricultural mechanization and intelligence needs.

Lettuce is an annual plant of the family Asteraceae. It is most often grown as a leaf vegetable, but sometimes for its stem and seeds, and its growth status and quality are evaluated based on its morphological phenotypic traits. However, traditional measurement methods are often labor-intensive and time-consuming due to manual measurements and may result in less accuracy. In this study, we proposed a new method utilizing RGB images and Mask R-Convolutional Neural Network (CNN) for estimating lettuce critical phenotypic traits. Leveraging publicly available datasets, we employed an improved Mask R-CNN model to perform a phenotypic analysis of lettuce images. This allowed us to estimate five phenotypic traits simultaneously, which include fresh weight, dry weight, plant height, canopy diameter, and leaf area. The enhanced Mask R-CNN model involved two key aspects: (1) replacing the backbone network from ResNet to RepVGG to enhance computational efficiency and performance; (2) adding phenotypic branches and constructing a multi-task regression model to achieve end-to-end estimation of lettuce phenotypic traits. Experimental results demonstrated that the present method achieved high accuracy and stable results in lettuce image segmentation, detection, and phenotypic estimation tasks, with APs for detection and segmentation being 0.8684 and 0.8803, respectively. Additionally, the R² values for the five phenotypic traits are 0.96, 0.9596, 0.9329, 0.9136, and 0.9592, with corresponding mean absolute percentage errors (MAPEs) of 0.1072, 0.1522, 0.0757, 0.0548, and 0.0899, respectively. This study presents a novel technical advancement based on digital knowledge for phenotypic analysis and evaluation of lettuce quality, which could lay the foundation for artificial intelligence expiation in fresh vegetable production.

Stem diameter is a critical phenotypic parameter for maize, integral to yield prediction and lodging resistance assessment. Traditionally, the quantification of this parameter through manual measurement has been the norm, notwithstanding its tedious and laborious nature. To address these challenges, this study introduces a non-invasive field-based system utilizing depth information from RGB-D cameras to measure maize stem diameter. This technology offers a practical solution for conducting rapid and non-destructive phenotyping. Firstly, RGB images, depth images, and 3D point clouds of maize stems were captured using an RGB-D camera, and precise alignment between the RGB and depth images was achieved. Subsequently, the contours of maize stems were delineated using 2D image processing techniques, followed by the extraction of the stem’s skeletal structure employing a thinning-based skeletonization algorithm. Furthermore, within the areas of interest on the maize stems, horizontal lines were constructed using points on the skeletal structure, resulting in 2D pixel coordinates at the intersections of these horizontal lines with the maize stem contours. Subsequently, a back-projection transformation from 2D pixel coordinates to 3D world coordinates was achieved by combining the depth data with the camera’s intrinsic parameters. The 3D world coordinates were then precisely mapped onto the 3D point cloud using rigid transformation techniques. Finally, the maize stem diameter was sensed and determined by calculating the Euclidean distance between pairs of 3D world coordinate points. The method demonstrated a Mean Absolute Percentage Error (MAPE) of 3.01%, a Mean Absolute Error (MAE) of 0.75 mm, a Root Mean Square Error (RMSE) of 1.07 mm, and a coefficient of determination (R²) of 0.96, ensuring accurate measurement of maize stem diameter. This research not only provides a new method of precise and efficient crop phenotypic analysis but also offers theoretical knowledge for the advancement of precision agriculture.

Effective lettuce cultivation requires precise monitoring of growth characteristics, quality assessment, and optimal harvest timing. In a recent study, a deep learning model based on multimodal data fusion was developed to estimate lettuce phenotypic traits accurately. A dual-modal network combining RGB and depth images was designed using an open lettuce dataset. The network incorporated both a feature correction module and a feature fusion module, significantly enhancing the performance in object detection, segmentation, and trait estimation. The model demonstrated high accuracy in estimating key traits, including fresh weight (fw), dry weight (dw), plant height (h), canopy diameter (d), and leaf area (la), achieving an R² of 0.9732 for fresh weight. Robustness and accuracy were further validated through 5-fold cross-validation, offering a promising approach for future crop phenotyping.

The target region and diameter of maize stems are important phenotyping parameters for evaluating crop vitality and estimating crop biomass. To address the issue that the target region and diameter of maize stems obtained after transplantation may not accurately reflect the true growth conditions of maize, a phenotyping monitoring technology based on an internal gradient algorithm is proposed for acquiring the target region and diameter of maize stems. Observations were conducted during the small bell stage of maize. First, color images of maize plants were captured by an Intel RealSense D435i camera. The color information in the color image was extracted by the hue saturation value (HSV) color space model. The maximum between-class variance (Otsu) algorithm was applied for image threshold segmentation to obtain the main stem of maize. Median filtering, image binarization, and morphological opening operations were then utilized to remove noise from the images. Subsequently, the morphological gradient algorithm was applied to acquire the target region of maize stems. The similarity between the three types of gradient images and the manually segmented image was evaluated by pixel ratio extraction and image quality assessment indicators. Evaluation results indicated that the internal gradient algorithm could more accurately obtain the target region of maize stems. Finally, a checkerboard was employed as a reference for measurement assistance, and the stem diameter of maize was calculated by the pinhole imaging principle. The mean absolute error of stem diameter was 1.92 mm, the mean absolute percentage error (MAPE) was 5.16%, and the root mean square error (RMSE) was 2.25 mm. The R² value was 0.79. With an R² greater than 0.7 and a MAPE within 6%, the phenotyping monitoring technology based on the internal gradient algorithm was proven to accurately measure the diameter of maize stems. The application of phenotyping monitoring technology based on the internal gradient algorithm in field conditions provides technological support for smart agriculture.

Introduction: In precision agriculture, accurate measurement of maize stem diameter during the jointing stage is crucial for lodging resistance assessment and yield prediction. However, existing methods have certain limitations: manual measurement is time-consuming and highly subjective, while two-dimensional image recognition can only capture local features and fails to reconstruct the true three-dimensional structure of the stem. Therefore, there is a critical need for an accurate and automated three-dimensional stem diameter measurement approach. Methods: This study proposes a three-dimensional stem diameter measurement method that integrates an improved PointNet++ segmentation network with structural feature fitting, focusing on the position of the second above-ground internode of maize plants. Specifically, multi-view image reconstruction is employed to generate three-dimensional point clouds of maize stems, and Relative Position Encoding, the Local Group Rearrangement Module, and the Local Region Self-Attention mechanism are incorporated into the PointNet++ network to achieve precise segmentation of stems from the ground. On this basis, a structural feature fitting strategy is applied, where principal axis analysis and ellipse fitting are utilized to extract cross-sectional features, thereby obtaining the major axis and minor axis parameters for stem diameter estimation. Results: Experimental results demonstrate that the proposed method maintains high accuracy under complex field conditions, achieving a mean absolute error (MAE) of 1.27 mm (R² = 0.87) for major-axis stem diameter and 1.38 mm (R² = 0.82) for minor-axis stem diameter. Discussion: The proposed method effectively overcomes the limitations of traditional manual and two-dimensional measurement techniques. It provides a robust and accurate solution for maize stem diameter measurement during the jointing stage. This approach offers technical support for intelligent maize growth monitoring, lodging resistance analysis, and three-dimensional phenotypic trait extraction.