Maturity grading and identification of Camellia oleifera are prerequisites to determining proper harvest maturity windows and safeguarding the yield and quality of Camellia oil. One problem in Camellia oleifera production and research is the worldwide confusion regarding the grading and identification of Camellia oleifera fruit maturity. To solve this problem, a Camellia oleifera fruit maturity grading and identification model based on the unsupervised image clustering model DeepCluster has been developed in the current study. The proposed model includes the following two branches: a maturity grading branch and a maturity identification branch. The proposed model jointly learns the parameters of the maturity grading branch and maturity identification branch and used the maturity clustering assigned from the maturity grading branch as pseudo-labels to update the parameters of the maturity identification branch. The maturity grading experiment was conducted using a training set consisting of 160 Camellia oleifera fruit samples and 2628 Camellia oleifera fruit digital images collected using a smartphone. The proposed model for grading Camellia oleifera fruit samples and images in training set into the following three maturity levels: unripe (47 samples and 883 images), ripe (62 samples and 1005 images), and overripe (51 samples and 740 images). Results suggest that there was a significant difference among the maturity stages graded by the proposed method with respect to seed oil content, seed soluble protein content, seed soluble sugar content, seed starch content, dry seed weight, and moisture content. The maturity identification experiment was conducted using a testing set consisting of 160 Camellia oleifera fruit digital images (50 unripe, 60 ripe, and 50 overripe) collected using a smartphone. According to the results, the overall accuracy of maturity identification for Camellia oleifera fruit was 91.25%. Moreover, a Gradient-weighted Class Activation Mapping (Grad-CAM) visualization analysis reveals that the peel regions, crack regions, and seed regions were the critical regions for Camellia oleifera fruit maturity identification. Our results corroborate a maturity grading and identification application of unsupervised image clustering techniques and are supported by additional physical and quality properties of maturity. The current findings may facilitate the harvesting process of Camellia oleifera fruits, which is especially critical for the improvement of Camellia oil production and quality.
Oil tea (Camellia oleifera Abel.) is a high-quality woody oil crop unique to China and has extremely high economic value and ecological benefits. One problem in oil tea production and research is the worldwide confusion regarding oil tea cultivar nomenclature. The purpose of this study was to automatic recognize some oil tea cultivars using bilinear attention network. For this purpose, we explored this possibility utilizing the bilinear attention network for five common China cultivars Ganshi 83-4, Changlin 53, Changlin 3, Ganshi 84-8, and Gan 447. We adopted the bilinear EfficientNet-B0 network and the convolutional block attention module (CBAM) to build BA-EfficientNet model being able to automatically and accurately recognize oil tea cultivars. In addition, the InceptionV3, VGG16, and ResNet50 algorithms were compared with the proposed BA-EfficientNet. The comparative test results show that BA-EfficientNet can accurately recognize oil tea cultivars in the test set, with overall accuracy and kappa coefficients reaching 91.59% and 0.89, respectively. Compared with algorithms such as InceptionV3, VGG16, and ResNet50, the BA-EfficientNet algorithm has obvious advantages in most evaluation indicators used in the experiment. In addition, the ablation experiments were designed to quantitatively evaluate the specific effects of bilinear networks and CBAM modules on oil tea cultivar recognition results. The results demonstrate that BA-EfficientNet is useful for solving the problem of recognizing oil tea cultivars under natural conditions. This paper attempts to explore new thinking for the application of deep learning methods in the field of oil tea cultivar recognition under natural conditions.
The maturity grading of walnuts during harvesting relies on experience. In this paper, walnut images in a natural environment were collected to construct a dataset, and deep learning algorithms were utilized to combine walnut internal physical and chemical indicators to carry out research on walnut maturity detection methods and further research on walnut oil content prediction by combining walnut images with walnut oil content indicators. The main contents of this paper include collecting walnut images in a natural environment, constructing datasets, and using deep learning algorithms combined with internal physical and chemical indexes of walnuts to study walnut maturity detection and oil content prediction methods. First, two walnut image acquisition schemes were designed, and a total of 9504 images were collected from 23 August to 21 September 2021. The dataset was expanded to 18,504 images through data preprocessing and image enhancement. A self-supervised Gaussian attention network (GATCluster) walnut ripeness detection method based on image clustering is proposed to develop ripeness criteria through unsupervised clustering, and the accuracy of the criteria is verified by analysis of variance (ANOVA). The maturity detection accuracy of the test set of 1500 images is 88.33%. Secondly, a walnut oil content prediction method based on improved ResNet34 is proposed. The feature extraction capability is improved by introducing the Squeeze-and-Excitation Networks (SENet) channel attention mechanism and the convolutional self-attention module. The prediction results on 50 images show that the root mean square error, average absolute percentage error, and regression coefficient are 2.96, 0.103, and 0.8822, respectively. The experiments show that the method performs well in predicting the oil content of walnuts at different maturity levels.