A rapid and precise large-scale agricultural disaster survey is a basis for agricultural disaster relief and insurance but is labor-intensive and time-consuming. This study applies Unmanned Aerial Vehicles (UAVs) images through deep-learning image processing to estimate the rice lodging in paddies over a large area. This study establishes an image semantic segmentation model employing two neural network architectures, FCN-AlexNet, and SegNet, whose effects are explored in the interpretation of various object sizes and computation efficiency. Commercial UAVs imaging rice paddies in high-resolution visible images are used to calculate three vegetation indicators to improve the applicability of visible images. The proposed model was trained and tested on a set of UAV images in 2017 and was validated on a set of UAV images in 2019. For the identification of rice lodging on the 2017 UAV images, the F1-score reaches 0.80 and 0.79 for FCN-AlexNet and SegNet, respectively. The F1-score of FCN-AlexNet using RGB + ExGR combination also reaches 0.78 in the 2019 images for validation. The proposed model adopting semantic segmentation networks is proven to have better efficiency, approximately 10 to 15 times faster, and a lower misinterpretation rate than that of the maximum likelihood method.

To meet demand for agriculture products, researchers have recently focused on precision agriculture to increase crop production with less input. Crop detection based on computer vision with unmanned aerial vehicle (UAV)-acquired images plays a vital role in precision agriculture. In recent years, machine learning has been successfully applied in image processing for classification, detection and segmentation. Accordingly, the aim of this study is to detect rice seedlings in paddy fields using transfer learning from two machine learning models, EfficientDet-D0 and Faster R-CNN, and to compare the results to the legacy approach—histograms of oriented gradients (HOG)-based support vector machine (SVM) classification. This study relies on a significant UAV image dataset to build a model to detect tiny rice seedlings. The HOG-SVM classifier was trained and achieved an F1-score of 99% in both training and testing. The performance of HOG-SVM, EfficientDet and Faster R-CNN models, respectively, were measured in mean average precision (mAP), with 70.0%, 95.5% and almost 100% in training and 70.2%, 83.2% and 88.8% in testing, and mean Intersection-over-Union (mIoU), with 46.5%, 67.6% and 99.6% in training and 46.6%, 57.5% and 63.7% in testing. The three models were also measured with three additional datasets acquired on different dates to evaluate model applicability with various imaging conditions. The results demonstrate that both CNN-based models outperform HOG-SVM, with a 10% higher mAP and mIoU. Further, computation speed is at least 1000 times faster than that of HOG-SVM with sliding window. Overall, the adoption of transfer learning allows for rapid establishment of object detection applications with promising performance.

Recently, unmanned aerial vehicles (UAVs) have been broadly applied to the remote sensing field. For a great number of UAV images, deep learning has been reinvigorated and performed many results in agricultural applications. The popular image datasets for deep learning model training are generated for general purpose use, in which the objects, views, and applications are for ordinary scenarios. However, UAV images possess different patterns of images mostly from a look-down perspective. This paper provides a verified annotated dataset of UAV images that are described in data acquisition, data preprocessing, and a showcase of a CNN classification. The dataset collection consists of one multi-rotor UAV platform by flying a planned scouting routine over rice paddies. This paper introduces a semi-auto annotation method with an ExGR index to generate the training data of rice seedlings. For demonstration, this study modified a classical CNN architecture, VGG-16, to run a patch-based rice seedling detection. The k-fold cross-validation was employed to obtain an 80/20 dividing ratio of training/test data. The accuracy of the network increases with the increase of epoch, and all the divisions of the cross-validation dataset achieve a 0.99 accuracy. The rice seedling dataset provides the training-validation dataset, patch-based detection samples, and the ortho-mosaic image of the field.

In recent years, edge computing and deep learning have been successfully performed processing and classification tasks in a variety of fields including agriculture. Therefore, this research aims to use unmanned aerial vehicle (UAV) for agriculture applications with integrating edge computing and deep learning techniques. This research experiment was carried out in the NCHU Experimental Farm. The DJI Matrice 100 drone with ASUS Tinker Board S embedded system, which connects a Logitech C925e webcam to capture images are used in this study. The ASUS Tinker Board S runs a folder monitoring program and sends images over the 4G LTE network to the backend server whenever new images are captured and stored. The backend server runs a pre-trained image semantic segmentation model and provides image inference service. The image inference results with the associated segmented image will be sent to the mobile device of the drone controller, and a dynamic flight control action can be triggered. The image semantic segmentation model adopts SegNet network architecture. For a comparison purpose, another network architecture, FCN-AlexNet, was also trained and validated. The preliminary results show SegNet outperformed FCN-AlexNet in image semantic segmentation tasks in terms of the evaluation between training and validation. The average inference speed of the semantic image segmentation model is 0.7s with segmentation identification accuracy is 89%. The promising results shed light on many agriculture applications, such as crop growth condition assessment, fertilizer management, and yield prediction. Additionally, this research provides possible solutions for the labor shortage issue of agriculture which is a common challenge in an aging community like Taiwan and many countries worldwide.

This study proposes rule-based multi-task deep learning for highly efficient rice lodging identification by introducing prior knowledge to improve the efficiency of disaster investigation using unmanned aerial vehicle (UAV) images. Multi-task learning combines rule-based loss functions and learns the best loss function to train a model conforming to prior knowledge. Rule-based and multi-task learning optimizes the integration of rule-based and deep learning networks and dynamically adjusts the loss function model. Lastly, edge computing is deployed on the edge computing host to improve model efficiency for instant inference. This study inferred fifty-one 4096 × 4096 tagged UAV images taken in 2019 and calculated the confusion matrix and accuracy indices. The recall rate of the modified model in the normal rice category was increased by 13.7%. The affecting factor may be caused by changes in spatial resolution and differences in spectral values in different periods, which can be solved by adding part of the 2019 image transfer training to adjust the learning characteristics. The prior knowledge of a deep learning network can be deployed on edge computing devices to collect high-resolution images by regional routes planning within inferred disaster-damaged farmlands, providing efficient disaster survey tools with high detection accuracy.