Shengyong Xu

Dr. Shengyong Xu

1 College of Engineering, Huazhong Agricultural University, Wuhan 430070, China
+1

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 July 2021 in Sensors
Verified
Journal Article
Open access
PDF file
XTXiaowen Teng
Xiaowen Teng
Guangsheng ZhouGuangsheng Zhou
Guangsheng Zhou
YWYuxuan Wu
Yuxuan Wu
Chenglong HuangChenglong Huang
Chenglong Huang
WDWanjing Dong
Wanjing Dong
Shengyong XuShengyong Xu
Shengyong Xu
The three-dimensional reconstruction method using RGB-D camera has a good balance in hardware cost and point cloud quality. However, due to the limitation of inherent structure and imaging principle, the acquired point cloud has problems such as a lot of noise and difficult registration. This paper proposes a 3D reconstruction method using Azure Kinect to solve these inherent problems. Shoot color images, depth images and near-infrared images of the target from six perspectives by Azure Kinect sensor with black background. Multiply the binarization result of the 8-bit infrared image with the RGB-D image alignment result provided by Microsoft corporation, which can remove ghosting and most of the background noise. A neighborhood extreme filtering method is proposed to filter out the abrupt points in the depth image, by which the floating noise point and most of the outlier noise will be removed before generating the point cloud, and then using the pass-through filter eliminate rest of the outlier noise. An improved method based on the classic iterative closest point (ICP) algorithm is presented to merge multiple-views point clouds. By continuously reducing both the size of the down-sampling grid and the distance threshold between the corresponding points, the point clouds of each view are continuously registered three times, until get the integral color point cloud. Many experiments on rapeseed plants show that the success rate of cloud registration is 92.5% and the point cloud accuracy obtained by this method is 0.789 mm, the time consuming of a integral scanning is 302 s, and with a good color restoration. Compared with a laser scanner, the proposed method has considerable reconstruction accuracy and a significantly ahead of the reconstruction speed, but the hardware cost is much lower when building a automatic scanning system. This research shows a low-cost, high-precision 3D reconstruction technology, which has the potential to be widely used for non-destructive measurement of rapeseed and other crops phenotype.

14 January 2023 in Agriculture
Verified
Journal Article
Open access
PDF file
Shengyong XuShengyong Xu
Shengyong Xu
YZYi Zhang
Yi Zhang
WDWanjing Dong
Wanjing Dong
ZBZhilong Bie
Zhilong Bie
CPChengli Peng
Chengli Peng
Yuan HuangYuan Huang
Yuan Huang
It is important to propose the correct decision for culling and replenishing seedlings in factory seedling nurseries to improve the quality of seedlings and save resources. To solve the problems of inefficiency and subjectivity of the existing traditional manual culling and replenishment of seeds, this paper proposes an automatic method to discriminate the early growth condition of seedlings. Taking watermelon plug seedlings as an example, Azure Kinect was used to collect data of its top view three times a day, at 9:00, 14:00, and 19:00. The data were collected from the time of germination to the time of main leaf growth, and the seedlings were manually determined to be strong or weak on the last day of collection. Pre-processing, image segmentation, and point cloud processing methods were performed on the collected data to obtain the plant height and leaf area of each seedling. The plant height and leaf area on the sixth day were predicted using an LSTM recurrent neural network for the first three days. The R squared for plant height and leaf area prediction were 0.932 and 0.901, respectively. The dichotomous classification of normal and abnormal seedlings was performed using six machine learning classification methods, such as random forest, SVM, and XGBoost, for day six data. The experimental results proved that random forest had the highest classification accuracy of 84%. Finally, the appropriate culling and replenishment decisions are given based on the classification results. This method can provide some technical support and a theoretical basis for factory seedling nurseries and transplanting robots.

1 December 2022 in Plants
Verified
Journal Article
Open access
PDF file
BHBinbin Han
Binbin Han
YLYaqin Li
Yaqin Li
ZBZhilong Bie
Zhilong Bie
CPChengli Peng
Chengli Peng
Yuan HuangYuan Huang
Yuan Huang
Shengyong XuShengyong Xu
Shengyong Xu
In this paper, a novel point cloud segmentation and completion framework is proposed to achieve high-quality leaf area measurement of melon seedlings. In particular, the input of our algorithm is the point cloud data collected by an Azure Kinect camera from the top view of the seedlings, and our method can enhance measurement accuracy from two aspects based on the acquired data. On the one hand, we propose a neighborhood space-constrained method to effectively filter out the hover points and outlier noise of the point cloud, which can enhance the quality of the point cloud data significantly. On the other hand, by leveraging the purely linear mixer mechanism, a new network named MIX-Net is developed to achieve segmentation and completion of the point cloud simultaneously. Different from previous methods that separate these two tasks, the proposed network can better balance these two tasks in a more definite and effective way, leading to satisfactory performance on these two tasks. The experimental results prove that our methods can outperform other competitors and provide more accurate measurement results. Specifically, for the seedling segmentation task, our method can obtain a 3.1% and 1.7% performance gain compared with PointNet++ and DGCNN, respectively. Meanwhile, the R2 of leaf area measurement improved from 0.87 to 0.93 and MSE decreased from 2.64 to 2.26 after leaf shading completion.

10 March 2025 in Frontiers in Plant Science
Verified
Journal Article
Open access
PDF file
SWSixiao Wu
Sixiao Wu
CHChanghao Hu
Changhao Hu
BTBoyuan Tian
Boyuan Tian
YHYuan Huang
Yuan Huang
SYShuo Yang
Shuo Yang
Shengyong XuShengyong Xu
Shengyong Xu
Introduction: Applying 3D reconstruction techniques to individual plants has enhanced high-throughput phenotyping and provided accurate data support for developing "digital twins" in the agricultural domain. High costs, slow processing times, intricate workflows, and limited automation often constrain the application of existing 3D reconstruction platforms.Methods: We develop a 3D reconstruction platform for complex plants to overcome these issues. Initially, a video acquisition system is built based on "camera to plant" mode. Then, we extract the keyframes in the videos. After that, Zhang Zhengyou's calibration method and Structure from Motion(SfM)are utilized to estimate the camera parameters. Next, Camera poses estimated from SfM were automatically calibrated using camera imaging trajectories as prior knowledge. Finally, Object-Based NeRF we proposed is utilized for the fine-scale reconstruction of plants. The OB-NeRF algorithm introduced a new ray sampling strategy that improved the efficiency and quality of target plant reconstruction without segmenting the background of images. Furthermore, the precision of the reconstruction was enhanced by optimizing camera poses. An exposure adjustment phase was integrated to improve the algorithm's robustness in uneven lighting conditions. The training process was significantly accelerated through the use of shallow MLP and multi-resolution hash encoding. Lastly, the camera imaging trajectories contributed to the automatic localization of target plants within the scene, enabling the automated extraction of Mesh. Results and discussion: Our pipeline reconstructed high-quality neural radiance fields of the target plant from captured videos in just 250 seconds, enabling the synthesis of novel viewpoint images and the extraction of Mesh. OB-NeRF surpasses NeRF in PSNR evaluation and reduces the reconstruction time from over 10 hours to just 30 Seconds. Compared to Instant-NGP, NeRFacto, and NeuS, OB-NeRF achieves higher reconstruction quality in a shorter reconstruction time. Moreover, Our reconstructed 3D model demonstrated superior texture and geometric fidelity compared to those generated by COLMAP and Kinect-based reconstruction methods. The $R^2$ was 0.9933,0.9881 and 0.9883 for plant height, leaf length, and leaf width, respectively. The MAE was 2.0947, 0.1898, and 0.1199 cm. The 3D reconstruction platform introduced in this study provides a robust foundation for high-throughput phenotyping and the creation of agricultural “digital twins”.

5 October 2020 in Mathematical Problems in Engineering
Verified
Journal Article
Open access
PDF file
SMShuai Mu
Shuai Mu
HQHaibo Qin
Haibo Qin
JWJia Wei
Jia Wei
QWQingkang Wen
Qingkang Wen
SLSihan Liu
Sihan Liu
Shengyong XuShengyong Xu
Shengyong Xu
Sheep body segmentation robot can improve production hygiene, product quality, and cutting accuracy, which is a huge change for traditional manual segmentation. With reference to the New Zealand sheep body segmentation specification, a vision system for Cartesian coordinate robot cutting half-sheep was developed and tested. The workflow of the vision system was designed and the image acquisition device with an Azure Kinect sensor was developed. Furthermore, a LabVIEW software with the image processing algorithm was then integrated with the RGBD image acquisition device in order to construct an automatic vision system. Based on Deeplab v3+ networks, an image processing system for locating ribs and spine was employed. Taking advantage of the location characteristics of ribs and spine in the split half-sheep, a calculation method of cutting line based on the key points is designed to determine five cutting curves. The seven key points are located by convex points of ribs and spine and the root of hind leg. Using the conversion relation between depth image and the space coordinates, the 3D coordinates of the curves were computed. Finally, the kinematics equation of the rectangular coordinate robot arm is established, and the 3D coordinates of the curves are converted into the corresponding motion parameters of the robot arm. The experimental results indicated that the automatic vision system had a success rate of 98.4% in the cutting curves location, 4.2 s time consumption per half-sheep, and approximately 1.3 mm location error. The positioning accuracy and speed of the vision system can meet the requirements of the sheep cutting production line. The vision system shows that there is potential to automate even the most challenging processing operations currently carried out manually by human operators.

14 July 2023 in Frontiers in Plant Science
Verified
Journal Article
Open access
YQYuhui Qiao
Yuhui Qiao
QLQingxi Liao
Qingxi Liao
MZMoran Zhang
Moran Zhang
BHBinbin Han
Binbin Han
CPChengli Peng
Chengli Peng
Shengyong XuShengyong Xu
Shengyong Xu
In this study, we propose a high-throughput and low-cost automatic detection method based on deep learning to replace the inefficient manual counting of rapeseed siliques. First, a video is captured with a smartphone around the rapeseed plants in the silique stage. Feature point detection and matching based on SIFT operators are applied to the extracted video frames, and sparse point clouds are recovered using epipolar geometry and triangulation principles. The depth map is obtained by calculating the disparity of the matched images, and the dense point cloud is fused. The plant model of the whole rapeseed plant in the silique stage is reconstructed based on the structure-from-motion (SfM) algorithm, and the background is removed by using the passthrough filter. The downsampled 3D point cloud data is processed by the DGCNN network, and the point cloud is divided into two categories: sparse rapeseed canopy siliques and rapeseed stems. The sparse canopy siliques are then segmented from the original whole rapeseed siliques point cloud using the sparse-dense point cloud mapping method, which can effectively save running time and improve efficiency. Finally, Euclidean clustering segmentation is performed on the rapeseed canopy siliques, and the RANSAC algorithm is used to perform line segmentation on the connected siliques after clustering, obtaining the three-dimensional spatial position of each silique and counting the number of siliques. The proposed method was applied to identify 1457 siliques from 12 rapeseed plants, and the experimental results showed a recognition accuracy greater than 97.80%. The proposed method achieved good results in rapeseed silique recognition and provided a useful example for the application of deep learning networks in dense 3D point cloud segmentation.