Automated weeding is an important research area in agrorobotics. Weeds can be removed mechanically or with the precise usage of herbicides. Deep Learning techniques achieved state of the art results in many computer vision tasks, however their deployment on low-cost mobile computers is still challenging. The described system contains several novelties, compared both with its previous version and related work. It is a part of a project of the automatic weeding machine, developed by the Warsaw University of Technology and MCMS Warka Ltd. Obtained models reach satisfying accuracy (detecting 47–67% of weed area, misclasifing as weed 0.1–0.9% of crop area) at over 10 FPS on the Raspberry Pi 3B+ computer. It was tested for four different plant species at different growth stadiums and lighting conditions. The system performing semantic segmentation is based on Convolutional Neural Networks. Its custom architecture combines U-Net, MobileNets, DenseNet and ResNet concepts. Amount of needed manual ground truth labels was significantly decreased by the usage of the knowledge distillation process, learning final model which mimics an ensemble of complex models on a large database of unlabeled data. Further decrease of the inference time was obtained by two custom modifications: in the usage of separable convolutions in DenseNet block and in the number of channels in each layer. In the authors’ opinion, the described novelties can be easily transferred to other agrorobotics tasks.

This article presents an energy-efficient method of controlling unmanned aircraft (fixed-wing UAVs), which consists of three groups of algorithms: aerial vehicle route planning, in-flight control, and algorithms to correct the preplanned flight trajectory. All algorithms shall take into account the existence of obstacles that the UAV must avoid and wind gusts in the UAV’s area of operation. Tests were carried out on the basis of the UAV mathematical model, stabilization and navigation algorithms, and Dryden turbulence model, considering the parameters of the UAV’s propulsion system. The work includes a detailed description of constructing a network of connection that is used to plan a UAV mission. It presents the algorithm for determining the actual distances between the different points in the field of action, which takes into account the existence of obstacles. The algorithm shall be based on methods for determining the flight trajectory on a hexagonal grid. It presents the developed proprietary UAV path planning algorithm based on a model from a group of algorithms of mixed integer linear problem (MILP) optimization. It presents the manner in which the pre-prepared flight path was used by UAV controllers that supervised the flight along the preset path. It details the architecture of contemporary unmanned aerial vehicles, which have embedded capability to realize autonomous missions, which require the integration of UAV systems into the route planning algorithms set out in the article. Particular attention has been paid to the planning and implementation methods of UAV missions under conditions where wind gusts are present, which support the determination of UAV flight routes to minimize the vehicle’s energy consumption. The models developed were tested within a computer architecture based on ARM processors using the hardware-in-the-loop (HIL) technique, which is commonly used to control unmanned vehicles. The presented solution makes use of two computers: FCC (flight control computer) based on a real-time operating system (RTOS) and MC (mission computer) based on Linux and integrated with the Robot Operating System (ROS). A new contribution of this work is the integration of planning and monitoring methods for the implementation of missions aimed at minimizing energy consumption of the vehicle, taking into account wind conditions.

This article presents a framework for planning a drone swarm mission in a hostile environment. Elements of the planning framework are discussed in detail, including methods of planning routes for drone swarms using mixed integer linear programming (MILP) and methods of detecting potentially dangerous objects using EO/IR camera images and synthetic aperture radar (SAR). Methods of detecting objects in the field are used in the mission planning process to re-plan the swarm’s flight paths. The route planning model is discussed using the example of drone formations managed by one UAV that communicates through another UAV with the ground control station (GCS). This article presents practical examples of using algorithms for detecting dangerous objects for re-planning of swarm routes. A novelty in the work is the development of these algorithms in such a way that they can be implemented on mobile computers used by UAVs and integrated with MILP tasks. The methods of detection and classification of objects in real time by UAVs equipped with SAR and EO/IR are presented. Different sensors require different methods to detect objects. In the case of infrared or optoelectronic sensors, a convolutional neural network is used. For SAR images, a rule-based system is applied. The experimental results confirm that the stream of images can be analyzed in real-time.

The article presents real-time object detection and classification methods by unmanned aerial vehicles (UAVs) equipped with a synthetic aperture radar (SAR). Two algorithms have been extensively tested: classic image analysis and convolutional neural networks (YOLOv5). The research resulted in a new method that combines YOLOv5 with post-processing using classic image analysis. It is shown that the new system improves both the classification accuracy and the location of the identified object. The algorithms were implemented and tested on a mobile platform installed on a military-class UAV as the primary unit for online image analysis. The usage of objective low-computational complexity detection algorithms on SAR scans can reduce the size of the scans sent to the ground control station.

The article presents the application of a hyperspectral camera in mobile robot navigation. Hyperspectral cameras are imaging systems that can capture a wide range of electromagnetic spectra. This feature allows them to detect a broader range of colors and features than traditional cameras and to perceive the environment more accurately. Several surface types, such as mud, can be challenging to detect using an RGB camera. In our system, the hyperspectral camera is used for ground recognition (e.g., grass, bumpy road, asphalt). Traditional global path planning methods take the shortest path length as the optimization objective. We propose an improved A* algorithm to generate the collision-free path. Semantic information makes it possible to plan a feasible and safe path in a complex off-road environment, taking traveling time as the optimization objective. We presented the results of the experiments for data collected in a natural environment. An important novelty of this paper is using a modified nearest neighbor method for hyperspectral data analysis and then using the data for path planning tasks in the same work. Using the nearest neighbor method allows us to adjust the robotic system much faster than using neural networks. As our system is continuously evolving, we intend to examine the performance of the vehicle on various road surfaces, which is why we sought to create a classification system that does not require a prolonged learning process. In our paper, we aimed to demonstrate that the incorporation of a hyperspectral camera can not only enhance route planning but also aid in the determination of parameters such as speed and acceleration.