Crop and weed discrimination in natural field environments is still challenging for implementing automatic agricultural practices, such as weed control. Some weed control methods have been proposed. However, these methods are still restricted as they are implemented under controlled conditions. The development of a sound weed control system begins by recognizing the crop and the different weed plants presented in the field. In this work, a classification approach of Zea mays L. (Crop), narrow-leaf weeds (NLW), and broadleaf weeds (BLW) from multi-plant images are presented. Moreover, a large image dataset was generated. Images were captured in natural field conditions, in different locations, and growing stages of the plants. The extraction of regions of interest (ROI) is carried out employing connected component analysis (CCA), whereas the classification of ROIs is based on Convolutional Neural Networks (CNN) and compared with a shallow learning approach. To measure the classification performance of both methods, accuracy, precision, recall, and F1-score metrics were used. The best alternative for the weed classification task at early stages of growth and in natural corn field environments was the CNN-based approach, as indicated by the 97% accuracy value obtained.
18 November 2020 in Journal of the Brazilian Society of Mechanical Sciences and Engineering
Autonomous landing of Unmanned Aerial Vehicles (UAVs) in crowded scenarios is crucial for successful deployment of UAVs in populated areas, particularly in emergency landing situations where the highest priority is to avoid hurting people. In this work, a new visual-based algorithm for identifying Safe Landing Zones (SLZ) in crowded scenarios is proposed, considering a camera mounted on a UAV, where the people in the scene move with unknown dynamics. To do so, a density map is generated for each image frame using a Deep Neural Network, from where a binary occupancy map is obtained aiming to overestimate the people's location for security reasons. Then, the occupancy map is projected to the head's plane, and the SLZ candidates are obtained as circular regions with a minimum security radius, within the head's plane. Finally, to keep track of the SLZ candidates, a multiple instance tracking algorithm is implemented using Kalman Filters along with the Hungarian algorithm for data association. Several scenarios were studied to prove the validity of the proposed strategy, including public datasets and real uncontrolled scenarios with people moving in public squares, taken from a UAV in flight. The study showed promising results in the search of preventing the UAV from hurting people during emergency landing.
Conception and development of an Unmanned Aerial Vehicle (UAV) capable of detecting, tracking and following a moving object with unknown dynamics is presented in this work, considering a human face as a case of study. Object detection is accomplished by a Haar cascade classifier. Once an object is detected, it is tracked with the help of a Kalman Filter (KF), and an estimation of the relative position with respect to the target is obtained. A linear controller is used to validate the proposed vision scheme and for regulating the aerial robot's position in order to keep a constant distance with respect to the mobile target, employing as well the extra available information from the embedded sensors. The proposed system was extensively tested in real-time experiments, through different conditions, using a commercial quadcopter connected via wireless to a ground station running under the Robot Operative System (ROS). The proposed overall strategy shows a good performance even under disadvantageous conditions as outdoor flight, being robust against illumination changes, image noise and the presence of other people in the scene.