Maize is susceptible to infect pest disease, and early disease detection is key to preventing the reduction of maize yields. The raw data used for plant disease detection are commonly RGB images and hyperspectral images (HSI). RGB images can be acquired rapidly and low-costly, but the detection accuracy is not satisfactory. On the contrary, using HSIs tends to obtain higher detection accuracy, but HSIs are difficult and high-cost to obtain in field. To overcome this contradiction, we have proposed the maize spectral recovery disease detection framework which includes two parts: the maize spectral recovery network based on the advanced hyperspectral recovery convolutional neural network (HSCNN+) and the maize disease detection network based on the convolutional neural network (CNN). Taking raw RGB data as input of the framework, the output reconstructed HSIs are used as input of disease detection network to achieve disease detection task. As a result, the detection accuracy obtained by using the low-cost raw RGB data almost as same as that obtained by using HSIs directly. The HSCNN+ is found to be fit to our spectral recovery model and the reconstruction fidelity was satisfactory. Experimental results demonstrate that the reconstructed HSIs efficiently improve detection accuracy compared with raw RGB image in tested scenarios, especially in complex environment scenario, for which the detection accuracy increases by 6.14%. The proposed framework has the advantages of fast, low cost and high detection precision. Moreover, the framework offers the possibility of real-time and precise field disease detection and can be applied in agricultural robots.
Corn ear damage caused by peeling significantly influence the output and quality of corn harvest. Ear damage recognition is the basis to adjust working parameters and to reduce damage. Image processing is attracting increasing attentions in the field of agriculture. Conventional image processing methods are difficult to be used for recognizing corn ear damage caused by peeling in field harvesting. To address the this problem, in this paper, we propose a peeling damage recognition method based on RGB image. For our method, we develop a dictionary-learning-based method to recognize corn kernels and a thresholding method to recognize ear damage regions. To obtain better performance, we also develop the corroding algorithm and the expanding algorithm for the post-processing of recognized results. The experimental results demonstrate the practicality and accuracy of the proposed method. This study could provide the theoretical basis to develop online peeling damage detection system for corn ear harvesters.
Precise object classification based on Hyperspectral imagery with limited training data presents a challenging task. We propose a tensor-based dictionary self-taught learning (TDSL) classification method to provide some insight into these challenges. The idea of TDSL is to utilize a small amount of unlabeled data to improve the supervised classification. The TDSL trains tensor feature extractors from unlabeled data, extracts joint spectral-spatial tensor features and performs classification on the labeled data set. These two data sets can be gathered over different scenes even by different sensors. Therefore, TDSL can complete cross-scene and cross-sensor classification tasks. For training tensor feature extractors on unlabeled data, we propose a sparse tensor-based dictionary learning algorithm for three-dimensional samples. In the algorithm, we initialize dictionaries using Tucker decomposition and update these dictionaries based on the K higher-order singular value decomposition. These dictionaries are feature extractors, which are used to extract sparse joint spectral-spatial tensor features on the labeled data set. To provide classification results, the support vector machine as the classifier is applied to the tensor features. The TDSL with the majority vote (TDSLMV) can reduce the misclassified pixels in homogenous regions and at the edges of different homogenous regions, which further refines the classification. The proposed methods are evaluated on Indian Pines, Pavia University, and Houston2013 datasets. The classification results show that TDSLMV achieves as high as , , and accuracies, respectively. Compared with several state-of-the-art methods, the classification accuracies of the proposed methods are improved by at least .
The frame of corn harvester is prone to vibration bending and torsional deformation due to the vibration caused by field road bumps and fluctuations. It poses a serious challenge to the reliability of machinery. Therefore it is critical to explore the vibration mechanism, and to identify the vibration states under different working conditions. To address the above problem, a vibration state identification method is proposed in this paper. An improved empirical mode decomposition (EMD) algorithm was used to decrease noise for signals of high noise and non-stationary vibration in the field. The support vector machine (SVM) model was used for identification of frame vibration states under different working conditions. The results showed that: (1) an improved EMD algorithm could effectively reduce noise interference and restore the effective information of the original signal. (2) based on improved EMD – SVM method identify the vibration states of the frame with the accuracy of 99.21%. (3) The corn ears in grain tank were not sensitive to low order vibration, but had an absorption effect on high order vibration. The proposed method has the potential to be applied for accurately identifying vibration state and improving frame safety.
Jittering sieve is a significant component of corn harvester, and it is used to separate kernels from impurities. The sieves may be blocked by kernels during the separating process, leading to the reduction of working performance. Unfortunately, the automatic recognition of blockage has not been studied yet. To address this issue, in this study we develop machine-vision-based algorithms to divide the jittering sieve into sub-sieves and to recognize kernel blockages. Additionally, we propose the metric to evaluate blocking level of each sub-sieve, aiming to provide the basis for automatic blockage clearing. The performance of the proposed algorithm is verified through simulation experiments on real images. The success ratio of edge determination reaches 100%. The mean cross-correlation coefficient of the blockage levels and the actual numbers of blocked kernels for all test scenes is 0.932. The results demonstrate the proposed algorithm can be used for accurate blockage recognition, and the proposed metric is appropriate for evaluating the blockage level.