Machine vision technology has dramatically improved the efficiency, speed, and quality of fruit-picking robots in complex environments. Target recognition technology for fruit is an integral part of the recognition systems of picking robots. The traditional digital image processing technology is a recognition method based on hand-designed features, which makes it difficult to achieve better recognition as it results in dealing with the complex and changing orchard environment. Numerous pieces of literature have shown that extracting special features by training data with deep learning has significant advantages for fruit recognition in complex environments. In addition, to realize fully automated picking, reconstructing fruits in three dimensions is a necessary measure. In this paper, we systematically summarize the research work on target recognition techniques for picking robots in recent years, analyze the technical characteristics of different approaches, and conclude their development history. Finally, the challenges and future development trends of target recognition technology for picking robots are pointed out.
In order to improve the efficiency of fine segmentation and obstacle removal in the road of tea plantation in hilly areas, a lightweight and high-precision DR-YOLO instance segmentation algorithm is proposed to realize environment awareness. Firstly, the road data of tea gardens in hilly areas were collected under different road conditions and light conditions, and data sets were generated. YOLOv8n-seg, which has the highest operating efficiency, was selected as the basic model. The MSDA-CBAM and DR-Neck feature fusion network were added to the YOLOv8-seg model to improve the feature extraction capability of the network and the feature fusion capability and efficiency of the model. Experimental results show that, compared with the YOLOv8-seg model, the DR-YOLO model proposed in this study has 2.0% improvement in AP@0.5 and 1.1% improvement in Precision. In this study, the DR-YOLO model is pruned and quantitatively compressed, which greatly improves the model inference speed with little reduction in AP. After deploying on Jetson, compared with the YOLOv8n-seg model, the Precision of DR-YOLO is increased by 0.6%, the AP@0.5 is increased by 1.6%, and the inference time is reduced by 17.1%, which can effectively improve the level of agricultural intelligent automation and realize the efficient operation of the instance segmentation model at the edge.
The purpose of this research work is to perform detailed exergetic, energetic and techno-economic analysis of the black tea drying process in the gas-type industrial dryer. Exergy–energy and techno-economic methodology was applied to investigate the heat loss, exergetic and energetic performance, exergy efficiency, improvement potential rate, sustainability index and techno-economic performance of a drying system. The results showed that the heat loss of exhaust air in the late drying process played a main contributing role in the heat loss and exergy loss of the whole drying system. Therefore, the exergy efficiency of the initial drying period and the redrying period varied from 38.08% to 65.09% and 24.76% to 26.97%, respectively. In addition, the improvement potential rate and sustainability index of the whole system varied from 6.93 kW to 12.94 kW and 1.33 to 2.86, respectively. The improvement potential obtained in the present work indicated that the drying operation is greatly in need of exergy performance improvement. Finally, the net present value and payback period obtained from techno-economic analysis were 179,442.03 USD and 5.3 years, the result is useful for investors or contractors to refer to and make investment decisions.
Accurately detecting tea bud leaves is crucial for the automation of tea picking robots. However, challenges arise due to tea stem occlusion and overlapping of buds and leaves, presenting varied shapes of one bud–one leaf targets in the field of view, making precise segmentation of tea bud leaves challenging. To improve the segmentation accuracy of one bud–one leaf targets with different shapes and fine granularity, this study proposes a novel semantic segmentation model for tea bud leaves. The method designs a hierarchical Transformer block based on a self-attention mechanism in the encoding network, which is beneficial for capturing long-range dependencies between features and enhancing the representation of common features. Then, a multi-path feature aggregation module is designed to effectively merge the feature outputs of encoder blocks with decoder outputs, thereby alleviating the loss of fine-grained features caused by downsampling. Furthermore, a refined polarized attention mechanism is employed after the aggregation module to perform polarized filtering on features in channel and spatial dimensions, enhancing the output of fine-grained features. The experimental results demonstrate that the proposed Unet-Enhanced model achieves segmentation performance well on one bud–one leaf targets with different shapes, with a mean intersection over union (mIoU) of 91.18% and a mean pixel accuracy (mPA) of 95.10%. The semantic segmentation network can accurately segment tea bud leaves, providing a decision-making basis for the spatial positioning of tea picking robots.
In unstructured tea garden environments, accurate recognition and pose estimation of tea bud leaves are critical for autonomous harvesting robots. Due to variations in imaging distance, tea bud leaves exhibit diverse scale and pose characteristics in camera views, which significantly complicates the recognition and pose estimation process. This study proposes a method using an RGB-D camera for precise recognition and pose estimation of tea bud leaves. The approach first constructs an for tea bud leaves, followed by a dynamic weight estimation strategy to achieve adaptive pose estimation. Quantitative experiments demonstrate that the instance segmentation model achieves an mAP@50 of 92.0% for box detection and 91.9% for mask detection, improving by 3.2% and 3.4%, respectively, compared to the YOLOv8s-seg instance segmentation model. The pose estimation results indicate a maximum angular error of 7.76°, a mean angular error of 3.41°, a median angular error of 3.69°, and a median absolute deviation of 1.42°. The corresponding distance errors are 8.60 mm, 2.83 mm, 2.57 mm, and 0.81 mm, further confirming the accuracy and robustness of the proposed method. These results indicate that the proposed method can be applied in unstructured tea garden environments for non-destructive and precise harvesting with autonomous tea bud-leave harvesting robots.