Deep learning has been proved to be an advanced technology for big data analysis with a large number of successful cases in image processing, speech recognition, object detection, and so on. Recently, it has also been introduced in food science and engineering. To our knowledge, this review is the first in the food domain. In this paper, we provided a brief introduction of deep learning and detailedly described the structure of some popular architectures of deep neural networks and the approaches for training a model. We surveyed dozens of articles that used deep learning as the data analysis tool to solve the problems and challenges in food domain, including food recognition, calories estimation, quality detection of fruits, vegetables, meat and aquatic products, food supply chain, and food contamination. The specific problems, the datasets, the preprocessing methods, the networks and frameworks used, the performance achieved, and the comparison with other popular solutions of each research were investigated. We also analyzed the potential of deep learning to be used as an advanced data mining tool in food sensory and consume researches. The result of our survey indicates that deep learning outperforms other methods such as manual feature extractors, conventional machine learning algorithms, and deep learning as a promising tool in food quality and safety inspection. The encouraging results in classification and regression problems achieved by deep learning will attract more research efforts to apply deep learning into the field of food in the future.
• Traits obtained by high-throughput phenotyping perform similarly or even better in GWAS than those obtained by traditional, manual methods. • Dynamic phenotyping contributing a lot for GWAS to identify time-specific loci. • High-throughput phenotyping, allowing noncontact and dynamic measurement, possesses great potential to provide high quality trait data for GWAS. • Future research should focus on the development of low-cost high-throughput phenotyping techniques and efficiency data/image analysis algorithm. • Research of using various high-throughput phenotyping techniques and GWAS on more diverse plant species and traits is urgently needed.
The feasibility of using hyperspectral imaging with convolutional neural network (CNN) to identify rice seed varieties was studied. Hyperspectral images of 4 rice seed varieties at two different spectral ranges (380–1030 nm and 874–1734 nm) were acquired. The spectral data at the ranges of 441–948 nm (Spectral range 1) and 975–1646 nm (Spectral range 2) were extracted. K nearest neighbors (KNN), support vector machine (SVM) and CNN models were built using different number of training samples (100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 1500, 2000, 2500 and 3000). KNN, SVM and CNN models in the Spectral range 2 performed slightly better than those in the Spectral range 1. The model performances improved with the increase in the number of training samples. The improvements were not significant when the number of training samples was large. CNN model performed better than the corresponding KNN and SVM models in most cases, which indicated the effectiveness of using CNN to analyze spectral data. The results of this study showed that CNN could be adopted in spectral data analysis with promising results. More varieties of rice need to be studied in future research to extend the use of CNNs in spectral data analysis.
Hyperspectral imaging has attracted great attention as a non-destructive and fast method for seed quality and safety assessment in recent years. The capability of this technique for classification and grading, viability and vigor detection, damage (defect and fungus) detection, cleanness detection and seed composition determination is illustrated by presentation of applications in quality and safety determination of seed in this review. The summary of hyperspectral imaging technology for seed quality and safety inspection for each category is also presented, including the analyzed spectral range, sample varieties, sample status, sample numbers, features (spectral features, image features, feature extraction methods), signal mode and data analysis strategies. The successful application of hyperspectral imaging in seed quality and safety inspection proves that many routine seed inspection tasks can be facilitated with hyperspectral imaging.
We investigated the feasibility and potentiality of presymptomatic detection of tobacco disease using hyperspectral imaging, combined with the variable selection method and machine-learning classifiers. Images from healthy and TMV-infected leaves with 2, 4, and 6 days post infection were acquired by a pushbroom hyperspectral reflectance imaging system covering the spectral range of 380–1023 nm. Successive projections algorithm was evaluated for effective wavelengths (EWs) selection. Four texture features, including contrast, correlation, entropy, and homogeneity were extracted according to grey-level co-occurrence matrix (GLCM). Additionally, different machine-learning algorithms were developed and compared to detect and classify disease stages with EWs, texture features and data fusion respectively. The performance of chemometric models with data fusion manifested better results with classification accuracies of calibration and prediction all above 80% than those only using EWs or texture features; the accuracies were up to 95% employing back propagation neural network (BPNN), extreme learning machine (ELM), and least squares support vector machine (LS-SVM) models. Hence, hyperspectral imaging has the potential as a fast and non-invasive method to identify infected leaves in a short period of time (i.e. 48 h) in comparison to the reference images (5 days for visible symptoms of infection, 11 days for typical symptoms).
A near-infrared (NIR) hyperspectral imaging system was developed in this study. NIR hyperspectral imaging combined with multivariate data analysis was applied to identify rice seed cultivars. Spectral data was exacted from hyperspectral images. Along with Partial Least Squares Discriminant Analysis (PLS-DA), Soft Independent Modeling of Class Analogy (SIMCA), K-Nearest Neighbor Algorithm (KNN) and Support Vector Machine (SVM), a novel machine learning algorithm called Random Forest (RF) was applied in this study. Spectra from 1,039 nm to 1,612 nm were used as full spectra to build classification models. PLS-DA and KNN models obtained over 80% classification accuracy, and SIMCA, SVM and RF models obtained 100% classification accuracy in both the calibration and prediction set. Twelve optimal wavelengths were selected by weighted regression coefficients of the PLS-DA model. Based on optimal wavelengths, PLS-DA, KNN, SVM and RF models were built. All optimal wavelengths-based models (except PLS-DA) produced classification rates over 80%. The performances of full spectra-based models were better than optimal wavelengths-based models. The overall results indicated that hyperspectral imaging could be used for rice seed cultivar identification, and RF is an effective classification technique.