Tomato leaf disease seriously affects the yield of tomato. It is extremely vital for agricultural economy to identify agricultural diseases. The traditional data augmentation methods, such as rotation, flip and translation, are severely limited, which cannot achieve good generalization results. To improve the recognition accuracy of tomato leaf diseases, a new method of data augmentation by generative adversarial networks (GANs) is proposed for leaf disease recognition in this work. Generated images augmented by deep convolutional generative adversarial networks (DCGAN) and original images as the input of GoogLeNet, this model can achieve a top-1 average identification accuracy of 94.33%. By adjusting the hyper-parameters, modifying the architecture of the convolutional neural networks, and selecting different generative adversarial networks, an improved model for training and testing 5 classes of tomato leaf images was obtained. Meanwhile, images generated by DCGAN not only enlarge the size of the data set, but also have the characteristics of diversity, which makes the model have a good generalization effect. We have also visually confirmed that the images generated by DCGAN have much better quality and are more convincing through the t-Distributed Stochastic Neighbor Embedding (t-SNE) and Visual Turing Test. Experiments with tomato leaf disease identification show that DCGAN can generate data that approximate to real images, which can be used to (1) provide a larger data set for the training of large neural networks, and improve the performance of the recognition model through highly discriminating image generation technology; (2) reduce the cost of data collection; (3) enhance the diversity of data and the generalization ability of the recognition models.
This paper applies deep convolutional neural network (CNN) to identify tomato leaf disease by transfer learning. AlexNet, GoogLeNet, and ResNet were used as backbone of the CNN. The best combined model was utilized to change the structure, aiming at exploring the performance of full training and fine-tuning of CNN. The highest accuracy of 97.28% for identifying tomato leaf disease is achieved by the optimal model ResNet with stochastic gradient descent (SGD), the number of batch size of 16, the number of iterations of 4992, and the training layers from the 37 layer to the fully connected layer (denote as “fc”). The experimental results show that the proposed technique is effective in identifying tomato leaf disease and could be generalized to identify other plant diseases.
In practice, early detection of disease is of high importance to practical value, corresponding measures can be taken at the early stage of plant disease. However, in the early stage of disease or when a rare disease occurs, there are limited training samples in practice, which makes machine learning especially deep learning models hardly work well while the stronger representative ability needs large-scale training data. To solve this problem, a fine grained-GAN based grape leaf spot identification method was proposed for local spot area image data augmentation to the generated local spot area images which were added and fed them into deep learning models for training to further strengthen the generalization ability of the classification models, which can effectively improve the accuracy and robustness of the prediction. Including 500 early-stage grape leaf spot images every category were fed into the proposed fine grained-GAN for local spot area data augmentation, 1000 local spot area sub images every category were generated in this study. The improved faster R-CNN was integrated in fine grained-GAN as local spot area detector. After that, the segmented sub-images and generated sub-images were mixed as training data input into the deep learning models, while the original segmented sub-images were used for testing. Experimental results showed that the proposed method had achieved higher identification accuracy on five state-of-art deep learning models; especially ResNet-50 had got 96.27% accuracy, which obtained significant improvements than other data augmentation methods and verified its satisfactory performance. This is of great practical significance for rare diseases or limited training samples.