Shilei Lyu

Dr. Shilei Lyu


Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 January 2022 in Sensors
Verified
Journal Article
Open access
PDF file
SLShilei Lyu
Shilei Lyu
RLRuiyao Li
Ruiyao Li
YZYawen Zhao
Yawen Zhao
Zhen LiZhen Li
Zhen Li
FRfan renjie
fan renjie
SLSiying Liu
Siying Liu
Green citrus detection in citrus orchards provides reliable support for production management chains, such as fruit thinning, sunburn prevention and yield estimation. In this paper, we proposed a lightweight object detection YOLOv5-CS (Citrus Sort) model to realize object detection and the accurate counting of green citrus in the natural environment. First, we employ image rotation codes to improve the generalization ability of the model. Second, in the backbone, a convolutional layer is replaced by a convolutional block attention module, and a detection layer is embedded to improve the detection accuracy of the little citrus. Third, both the loss function CIoU (Complete Intersection over Union) and cosine annealing algorithm are used to get the better training effect of the model. Finally, our model is migrated and deployed to the AI (Artificial Intelligence) edge system. Furthermore, we apply the scene segmentation method using the “virtual region” to achieve accurate counting of the green citrus, thereby forming an embedded system of green citrus counting by edge computing. The results show that the mAP@.5 of the YOLOv5-CS model for green citrus was 98.23%, and the recall is 97.66%. The inference speed of YOLOv5-CS detecting a picture on the server is 0.017 s, and the inference speed on Nvidia Jetson Xavier NX is 0.037 s. The detection and counting frame rate of the AI edge system-side counting system is 28 FPS, which meets the counting requirements of green citrus.
1

11 July 2023 in Remote Sensing
Verified
Journal Article
Open access
PDF file
JXJiaxing Xie
Jiaxing Xie
JHJiajun Hua
Jiajun Hua
SCShaonan Chen
Shaonan Chen
PWPeiwen Wu
Peiwen Wu
鹏高鹏 高
鹏 高
Jianqiang LuJianqiang Lu
Jianqiang Lu
Crop classification of large-scale agricultural land is crucial for crop monitoring and yield estimation. Hyperspectral image classification has proven to be an effective method for this task. Most current popular hyperspectral image classification methods are based on image classification, specifically on convolutional neural networks (CNNs) and recurrent neural networks (RNNs). In contrast, this paper focuses on methods based on semantic segmentation and proposes a new transformer-based approach called HyperSFormer for crop hyperspectral image classification. The key enhancement of the proposed method is the replacement of the encoder in SegFormer with an improved Swin Transformer while keeping the SegFormer decoder. The entire model adopts a simple and uniform transformer architecture. Additionally, the paper introduces the hyper patch embedding (HPE) module to extract spectral and local spatial information from the hyperspectral images, which enhances the effectiveness of the features used as input for the model. To ensure detailed model processing and achieve end-to-end hyperspectral image classification, the transpose padding upsample (TPU) module is proposed for the model’s output. In order to address the problem of insufficient and imbalanced samples in hyperspectral image classification, the paper designs an adaptive min log sampling (AMLS) strategy and a loss function that incorporates dice loss and focal loss to assist model training. Experimental results using three public hyperspectral image datasets demonstrate the strong performance of HyperSFormer, particularly in the presence of imbalanced sample data, complex negative samples, and mixed sample classes. HyperSFormer outperforms state-of-the-art methods, including fast patch-free global learning (FPGA), a spectral–spatial-dependent global learning framework (SSDGL), and SegFormer, by at least 2.7% in the mean intersection over union (mIoU). It also improves the overall accuracy and average accuracy values by at least 0.9% and 0.3%, respectively, and the kappa coefficient by at least 0.011. Furthermore, ablation experiments were conducted to determine the optimal hyperparameter and loss function settings for the proposed method, validating the rationality of these settings and the fusion loss function.

23 December 2021 in Sensors
Verified
Journal Article
Open access
PDF file
HHHeqing Huang
Heqing Huang
THTongbin Huang
Tongbin Huang
Zhen LiZhen Li
Zhen Li
SLShilei Lyu
Shilei Lyu
THTao Hong
Tao Hong
Citrus fruit detection can provide technical support for fine management and yield determination of citrus orchards. Accurate detection of citrus fruits in mountain orchards is challenging because of leaf occlusion and citrus fruit mutual occlusion of different fruits. This paper presents a citrus detection task that combines UAV data collection, AI embedded device, and target detection algorithm. The system used a small unmanned aerial vehicle equipped with a camera to take full-scale pictures of citrus trees; at the same time, we extended the state-of-the-art model target detection algorithm, added the attention mechanism and adaptive fusion feature method, improved the model’s performance; to facilitate the deployment of the model, we used the pruning method to reduce the amount of model calculation and parameters. The improved target detection algorithm is ported to the edge computing end to detect the data collected by the unmanned aerial vehicle. The experiment was performed on the self-made citrus dataset, the detection accuracy was 93.32%, and the processing speed at the edge computing device was 180 ms/frame. This method is suitable for citrus detection tasks in the mountainous orchard environment, and it can help fruit growers to estimate their yield.

27 March 2023 in Agronomy
Verified
Journal Article
Open access
PDF file
QDQiufang Dai
Qiufang Dai
YGYuanhang Guo
Yuanhang Guo
Zhen LiZhen Li
Zhen Li
SSShuran Song
Shuran Song
SLShilei Lyu
Shilei Lyu
ZCZiwei Chen
Ziwei Chen
The rapid and accurate identification of citrus leaf diseases is crucial for the sustainable development of the citrus industry. Because citrus leaf disease samples are small, unevenly distributed, and difficult to collect, we redesigned the generator structure of FastGAN and added small batch standard deviations to the discriminator to produce an enhanced model called FastGAN2, which was used for generating citrus disease and nutritional deficiency (zinc and magnesium deficiency) images. The performance of the existing model degrades significantly when the training and test data exhibit large differences in appearance or originate from different regions. To solve this problem, we propose an EfficientNet-B5 network incorporating adaptive angular margin (Arcface) loss with the adversarial weight perturbation mechanism, and we call it EfficientNet-B5-pro. The FastGAN2 network can be trained using only 50 images. The Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) are improved by 31.8% and 59.86%, respectively, compared to the original FastGAN network; 8000 images were generated using the FastGAN2 network (2000 black star disease, 2000 canker disease, 2000 healthy, 2000 deficiency). Only images generated by the FastGAN2 network were used as the training set to train the ten classification networks. Real images, which were not used to train the FastGAN2 network, were used as the test set. The average accuracy rates of the ten classification networks exceeded 93%. The accuracy, precision, recall, and F1 scores achieved by EfficientNet-B5-pro were 97.04%, 97.32%, 96.96%, and 97.09%, respectively, and they were 2.26%, 1.19%, 1.98%, and 1.86% higher than those of EfficientNet-B5, respectively. The classification network model can be successfully trained using only the images generated by FastGAN2, and EfficientNet-B5-pro has good generalization and robustness. The method used in this study can be an effective tool for citrus disease and nutritional deficiency image classification using a small number of samples.

3 August 2023 in Agronomy
Verified
Journal Article
Open access
PDF file
XXXiuyun Xue
Xiuyun Xue
QLQin Luo
Qin Luo
MBMaofeng Bu
Maofeng Bu
Zhen LiZhen Li
Zhen Li
SLShilei Lyu
Shilei Lyu
SSShuran Song
Shuran Song
The accurate and rapid acquisition of fruit tree canopy parameters is fundamental for achieving precision operations in orchard robotics, including accurate spraying and precise fertilization. In response to the issue of inaccurate citrus tree canopy segmentation in complex orchard backgrounds, this paper proposes an improved DeepLabv3+ model for fruit tree canopy segmentation, facilitating canopy parameter calculation. The model takes the RGB-D (Red, Green, Blue, Depth) image segmented canopy foreground as input, introducing Dilated Spatial Convolution in Atrous Spatial Pyramid Pooling to reduce computational load and integrating Convolutional Block Attention Module and Coordinate Attention for enhanced edge feature extraction. MobileNetV3-Small is utilized as the backbone network, making the model suitable for embedded platforms. A citrus tree canopy image dataset was collected from two orchards in distinct regions. Data from Orchard A was divided into training, validation, and test set A, while data from Orchard B was designated as test set B, collectively employed for model training and testing. The model achieves a detection speed of 32.69 FPS on Jetson Xavier NX, which is six times faster than the traditional DeepLabv3+. On test set A, the mIoU is 95.62%, and on test set B, the mIoU is 92.29%, showing a 1.12% improvement over the traditional DeepLabv3+. These results demonstrate the outstanding performance of the improved DeepLabv3+ model in segmenting fruit tree canopies under different conditions, thus enabling precise spraying by orchard spraying robots.

24 September 2020 in Sensors
Verified
Journal Article
Open access
PDF file
JHJie Hu
Jie Hu
TWTuan Wang
Tuan Wang
JYJiacheng Yang
Jiacheng Yang
Yubin LanYubin Lan
Yubin Lan
SLShilei Lyu
Shilei Lyu
Yali ZhangYali Zhang
Yali Zhang
Unmanned Aerial Vehicles (UAVs) have been widely applied for pesticide spraying as they have high efficiency and operational flexibility. However, the pesticide droplet drift caused by wind may decrease the pesticide spraying efficiency and pollute the environment. A precision spraying system based on an airborne meteorological monitoring platform on manned agricultural aircrafts is not adaptable for. So far, there is no better solution for controlling droplet drift outside the target area caused by wind, especially by wind gusts. In this regard, a UAV trajectory adjustment system based on Wireless Sensor Network (WSN) for pesticide drift control was proposed in this research. By collecting data from ground WSN, the UAV utilizes the wind speed and wind direction as inputs to autonomously adjust its trajectory for keeping droplet deposition in the target spraying area. Two optimized algorithms, namely deep reinforcement learning and particle swarm optimization, were applied to generate the newly modified flight route. At the same time, a simplified pesticide droplet drift model that includes wind speed and wind direction as parameters was developed and adopted to simulate and compute the drift distance of pesticide droplets. Moreover, an LSTM-based wind speed prediction model and a RNN-based wind direction prediction model were established, so as to address the problem of missing the latest wind data caused by communication latency or a lack of connection with the ground nodes. Finally, experiments were carried out to test the communication latency between UAV and ground WSN, and to evaluate the proposed scheme with embedded Raspberry Pi boards in UAV for feasibility verification. Results show that the WSN-assisted UAV trajectory adjustment system is capable of providing a better performance of on-target droplet deposition for real time pesticide spraying with UAV.