In view of the time-consuming and laborious manual picking and sorting of strawberries, the direct impact of image recognition accuracy on automatic picking and the rapid development of deep learning(DL), a Faster Regions with Convolutional Neural Network features (R-CNN) strawberry recognition method that combines Mixup data augmentation, a ResNet(Residual Network)50 backbone feature extraction network and a Soft-NMS (Non-Maximum Suppression) algorithm, named the MRS Faster R-CNN, is proposed. In this paper, the transfer learning backbone feature extraction network VGG (Visual Geometry Group) 16 and ResNet50 are compared, and the superior ResNet50 is selected as the backbone network of MRS Faster R-CNN. The data augmentation method of Mixup image fusion is used to improve the learning and generalization ability of the model. The redundant bboxes (bounding boxes) are removed through Soft-NMS to obtain the best region proposal. The freezing phase is added to the training process, effectively reducing the occupation of video memory and shortening the training time. After experimental verification, the optimized model improved the AP (Average Precision) values of mature and immature strawberries by 0.26% and 5.34%, respectively, and the P(Precision) values by 0.81% and 6.34%, respectively, compared to the original model (R Faster R-CNN). Therefore, the MRS Faster R-CNN model proposed in this paper has great potential in the field of strawberry recognition and maturity classification and improves the recognition rate of small fruit and overlapping occluded fruit, thus providing an excellent solution for mechanized picking and sorting.
Existing person search methods mainly focus on searching for the target person using database images. However, this is different from real-world surveillance videos which involve a temporal relationship between video frames. To solve this problem, we propose an efficient person search method that employs spatio-temporal features in surveillance videos. This method not only considers the spatial features of persons in each frame, but also utilizes the temporal relationship of the same person between adjacent frames. For this purpose, the spatial features are extracted by combining Yolo network with Resnet-50 model, and the temporal relationship is processed by gated recurrent unit. The spatio-temporal features are generated by the following average pooling layer and used to represent persons in the videos. To ensure search efficiency, locality sensitive hashing is used to organize massive spatio-temporal features and calculate the similarity. A surveillance video database is also constructed to evaluate the proposed method, and the experimental results demonstrate that our method improves search accuracy while ensuring search efficiency.
12 December 2022 in Neural Computing and Applications
To enhance the precision of cottonseed impurity detection and address issues such as high miss-detection rates and suboptimal performance, this paper introduces an improved YOLOv11 algorithm, termed YOLOv11-SMS. Initially, the algorithm integrates a local self-attention mechanism (LRSA) to design the C2PSA-SL module, which augments the model’s ability to learn local information while maintaining global feature awareness. Furthermore, the feature extraction stage and the network head incorporate a multi-branch reparameterized convolution (MBRConv) module, enhancing feature extraction capabilities while preserving the model’s lightweight properties. Lastly, a spatial adaptive modulation (SAFM) module is introduced to optimize the detection of small targets. Experimental results demonstrate that YOLOv11-SMS outperforms the baseline model, with mAP@50–95 increasing from 79.42% to 82.49%, an improvement of 3.07 percentage points. The average mIOU increased from 90.98% to 94.18%, representing a 3.2 percentage point improvement. Moreover, the model achieves an impressive real-time inference speed of 178.63 frames per second (FPS), effectively balancing detection accuracy and speed, offering an efficient and precise solution for cottonseed impurity detection.