In order to realize the real-time and accurate detection of potted flowers on benches, in this paper we propose a method based on the ZED 2 stereo camera and the YOLO V4-Tiny deep learning algorithm for potted flower detection and location. First, an automatic detection model of flowers was established based on the YOLO V4-Tiny convolutional neural network (CNN) model, and the center points on the pixel plane of the flowers were obtained according to the prediction box. Then, the real-time 3D point cloud information obtained by the ZED 2 camera was used to calculate the actual position of the flowers. The test results showed that the mean average precision (MAP) and recall rate of the training model was 89.72% and 80%, respectively, and the real-time average detection frame rate of the model deployed under Jetson TX2 was 16 FPS. The results of the occlusion experiment showed that when the canopy overlap ratio between the two flowers is more than 10%, the recognition accuracy will be affected. The mean absolute error of the flower center location based on 3D point cloud information of the ZED 2 camera was 18.1 mm, and the maximum locating error of the flower center was 25.8 mm under different light radiation conditions. The method in this paper establishes the relationship between the detection target of flowers and the actual spatial location, which has reference significance for the machinery and automatic management of potted flowers on benches.
Three-dimensional (3D) plant canopy structure analysis is an important part of plant phenotype studies. To promote the development of plant canopy structure measurement based on 3D reconstruction, we reviewed the latest research progress achieved using visual sensors to measure the 3D plant canopy structure from four aspects, including the principles of 3D plant measurement technologies, the corresponding instruments and specifications of different visual sensors, the methods of plant canopy structure extraction based on 3D reconstruction, and the conclusion and promise of plant canopy measurement technology. In the current research phase on 3D structural plant canopy measurement techniques, the leading algorithms of every step for plant canopy structure measurement based on 3D reconstruction are introduced. Finally, future prospects for a standard phenotypical analytical method, rapid reconstruction, and precision optimization are described.