The advent of mobile robots in agriculture has signaled a digital transformation with new automation technologies optimize a range of labor-intensive, resources-demanding, and time-consuming agri-field operations. To that end a generally accepted technical lexicon for mobile robots is lacking as pertinent terms are often used interchangeably. This creates confusion among research and practice stakeholders. In addition, a consistent definition of planning attributes in automated agricultural operations is still missing as relevant research is sparse. In this regard, a “narrative” review was adopted (1) to provide the basic terminology over technical aspects of mobile robots used in autonomous operations and (2) assess fundamental planning aspects of mobile robots in agricultural environments. Based on the synthesized evidence from extant studies, seven planning attributes have been included: (i) high-level control-specific attributes, which include reasoning architecture, the world model, and planning level, (ii) operation-specific attributes, which include locomotion–task connection and capacity constraints, and (iii) physical robot-specific attributes, which include vehicle configuration and vehicle kinematics.
In the pursuit of optimizing the efficiency, flexibility, and adaptability of agricultural practices, human–robot interaction (HRI) has emerged in agriculture. Enabled by the ongoing advancement in information and communication technologies, this approach aspires to overcome the challenges originating from the inherent complex agricultural environments. Τhis paper systematically reviews the scholarly literature to capture the current progress and trends in this promising field as well as identify future research directions. It can be inferred that there is a growing interest in this field, which relies on combining perspectives from several disciplines to obtain a holistic understanding. The subject of the selected papers is mainly synergistic target detection, while simulation was the main methodology. Furthermore, melons, grapes, and strawberries were the crops with the highest interest for HRI applications. Finally, collaboration and cooperation were the most preferred interaction modes, with various levels of automation being examined. On all occasions, the synergy of humans and robots demonstrated the best results in terms of system performance, physical workload of workers, and time needed to execute the performed tasks. However, despite the associated progress, there is still a long way to go towards establishing viable, functional, and safe human–robot interactive systems.
Incorporating hand gesture recognition in human–robot interaction has the potential to provide a natural way of communication, thus contributing to a more fluid collaboration toward optimizing the efficiency of the application at hand and overcoming possible challenges. A very promising field of interest is agriculture, owing to its complex and dynamic environments. The aim of this study was twofold: (a) to develop a real-time skeleton-based recognition system for five hand gestures using a depth camera and machine learning, and (b) to enable a real-time human–robot interaction framework and test it in different scenarios. For this purpose, six machine learning classifiers were tested, while the Robot Operating System (ROS) software was utilized for “translating” the gestures into five commands to be executed by the robot. Furthermore, the developed system was successfully tested in outdoor experimental sessions that included either one or two persons. In the last case, the robot, based on the recognized gesture, could distinguish which of the two workers required help, follow the “locked” person, stop, return to a target location, or “unlock” them. For the sake of safety, the robot navigated with a preset socially accepted speed while keeping a safe distance in all interactions.
This study aimed to propose an approach for orchard trees segmentation using aerial images based on a deep learning convolutional neural network variant, namely the U-net network. The purpose was the automated detection and localization of the canopy of orchard trees under various conditions (i.e., different seasons, different tree ages, different levels of weed coverage). The implemented dataset was composed of images from three different walnut orchards. The achieved variability of the dataset resulted in obtaining images that fell under seven different use cases. The best-trained model achieved 91%, 90%, and 87% accuracy for training, validation, and testing, respectively. The trained model was also tested on never-before-seen orthomosaic images or orchards based on two methods (oversampling and undersampling) in order to tackle issues with out-of-the-field boundary transparent pixels from the image. Even though the training dataset did not contain orthomosaic images, it achieved performance levels that reached up to 99%, demonstrating the robustness of the proposed approach.
Automated agricultural operations must be planned and organized to reduce risk and failure potential while optimizing productivity and efficiency. However, the diversity of natural outdoor environments and the varied data types and volumes required to represent an agricultural setting comprise critical challenges for the deployment of fully automated agricultural operations. In this regard, this study develops an integrated system for enabling an unmanned aerial vehicle (UAV) supported route planning system for unmanned ground vehicles (UGVs) in the semi-structured environment of orchards. The research focus is on the underpinning planning system components (i.e., world representation or map generation or perception and path planning). In particular, the system comprises a digital platform that receives as input a geotagged depiction of an orchard, which is obtained by a UAV. The pre-processed data define the agri-field’s tracks that are transformed into a grid-based map capturing accessible areas. The grid map is then used to generate a topological path planning solution. Subsequently, the solution is translated into a sequence of coordinates that define the calculated optimal path for the UGV to traverse. The applicability of the developed system was validated in routing scenarios in a walnuts’ orchard using a UGV. The contribution of the proposed system entails noise reduction techniques for the accurate representation of a semi-deterministic agricultural environment for enabling accuracy in the route planning of utilized automated machinery.
Within the transition from precision agriculture (task-specific approach) to smart farming (system-specific approach) there is a need to build and evaluate robotic systems that are part of an overall integrated system under a continuous two-way connection and interaction. This paper presented an initial step in creating an integrated system for agri-robotics, enabling two-way communication between an unmanned ground vehicle (UGV) and a farm management information system (FMIS) under the general scope of smart farming implementation. In this initial step, the primary task of route-planning for the agricultural vehicles, as a prerequisite for the execution of any field operation, was selected as a use-case for building and evaluating this integration. The system that was developed involves advanced route-planning algorithms within the cloud-based FMIS, a comprehensive algorithmic package compatible with agricultural vehicles utilizing the Robot Operating System (ROS), and a communicational and computational unit (CCU) interconnecting the FMIS algorithms, the corresponding user interface, and the vehicles. Its analytical module provides valuable information about UGVs’ performance metrics, specifically performance indicators of working distance, non-working distance, overlapped area, and field-traversing efficiency. The system was demonstrated via the implementation of two robotic vehicles in route-execution tasks in various operational configurations, field features, and cropping systems (open field, row crops, orchards). The case studies showed variability in the operational performance of the field traversal efficiency to be between 79.2% and 93%, while, when implementing the optimal route-planning functionality of the system, there was an improvement of up to 9.5% in the field efficiency. The demonstrated results indicate that the user can obtain better control over field operations by making alterations to ensure optimum field performance, and the user can have complete supervision of the operation.