The Global Wheat Head Detection (GWHD) dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions. With an associated competition hosted in Kaggle, GWHD_2020 has successfully attracted attention from both the computer vision and agricultural science communities. From this first experience, a few avenues for improvements have been identified regarding data size, head diversity, and label reliability. To address these issues, the 2020 dataset has been reexamined, relabeled, and complemented by adding 1722 images from 5 additional countries, allowing for 81,553 additional wheat heads. We now release in 2021 a new version of the Global Wheat Head Detection dataset, which is bigger, more diverse, and less noisy than the GWHD_2020 version.

Novel high-throughput phenotyping (HTP) approaches are needed to advance the understanding of genotype-to-phenotype and accelerate plant breeding. The first generation of HTP has examined simple spectral reflectance traits from images and sensors but is limited in advancing our understanding of crop development and architecture. Lodging is a complex trait that significantly impacts yield and quality in many crops including wheat. Conventional visual assessment methods for lodging are time-consuming, relatively low-throughput, and subjective, limiting phenotyping accuracy and population sizes in breeding and genetics studies. Here, we demonstrate the considerable power of unmanned aerial systems (UAS) or drone-based phenotyping as a high-throughput alternative to visual assessments for the complex phenological trait of lodging, which significantly impacts yield and quality in many crops including wheat. We tested and validated quantitative assessment of lodging on 2,640 wheat breeding plots over the course of 2 years using differential digital elevation models from UAS. High correlations of digital measures of lodging to visual estimates and equivalent broad-sense heritability demonstrate this approach is amenable for reproducible assessment of lodging in large breeding nurseries. Using these high-throughput measures to assess the underlying genetic architecture of lodging in wheat, we applied genome-wide association analysis and identified a key genomic region on chromosome 2A, consistent across digital and visual scores of lodging. However, these associations accounted for a very minor portion of the total phenotypic variance. We therefore investigated whole genome prediction models and found high prediction accuracies across populations and environments. This adequately accounted for the highly polygenic genetic architecture of numerous small effect loci, consistent with the previously described complex genetic architecture of lodging in wheat. Our study provides a proof-of-concept application of UAS-based phenomics that is scalable to tens-of-thousands of plots in breeding and genetic studies as will be needed to uncover the genetic factors and increase the rate of gain for complex traits in crop breeding.

Plant height is an important morphological and developmental phenotype that directly indicates overall plant growth and is widely predictive of final grain yield and biomass. Currently, manually measuring plant height is laborious and has become a bottleneck for genetics and breeding programs. The goal of this research was to evaluate the performance of five different sensing technologies for field-based high throughput plant phenotyping (HTPP) of sorghum [Sorghum bicolor (L.) Moench] height. With this purpose, (1) an ultrasonic sensor, (2) a LIDAR-Lite v2 sensor, (3) a Kinect v2 camera, (4) an imaging array of four high-resolution cameras were evaluated on a ground vehicle platform, and (5) a digital camera was evaluated on an unmanned aerial vehicle platform to obtain the performance baselines to measure the plant height in the field. Plot-level height was extracted by averaging different percentiles of elevation observations within each plot. Measurements were taken on 80 single-row plots of a US × Chinese sorghum recombinant inbred line population. The performance of each sensing technology was also qualitatively evaluated through comparison of device cost, measurement resolution, and ease and efficiency of data analysis. We found the heights measured by the ultrasonic sensor, the LIDAR-Lite v2 sensor, the Kinect v2 camera, and the imaging array had high correlation with the manual measurements (r ≥ 0.90), while the heights measured by remote imaging had good, but relatively lower correlation to the manual measurements (r = 0.73). These results confirmed the ability of the proposed methodologies for accurate and efficient HTPP of plant height and can be extended to a range of crops. The evaluation approach discussed here can guide the field-based HTPP research in general.

The development of high-throughput genotyping and phenotyping has provided access to many tools to accelerate plant breeding programs. Unmanned Aerial Systems (UAS)-based remote sensing is being broadly implemented for field-based high-throughput phenotyping due to its low cost and the capacity to rapidly cover large breeding populations. The Structure-from-Motion photogrammetry processes aerial images taken from multiple perspectives over a field to an orthomosaic photo of a complete field experiment, allowing spectral or morphological trait extraction from the canopy surface for each individual field plot. However, some phenotypic information observable in each raw aerial image seems to be lost to the orthomosaic photo, probably due to photogrammetry processes such as pixel merging and blending. To formally assess this, we introduced a set of image processing methods to extract phenotypes from orthorectified raw aerial images and compared them to the negative control of extracting the same traits from processed orthomosaic images. We predict that standard measures of accuracy in terms of the broad-sense heritability of the remote sensing spectral traits will be higher using the orthorectified photos than with the orthomosaic image. Using three case studies, we therefore compared the broad-sense heritability of phenotypes in wheat breeding nurseries including, (1) canopy temperature from thermal imaging, (2) canopy normalized difference vegetation index (NDVI), and (3) early-stage ground cover from multispectral imaging. We evaluated heritability estimates of these phenotypes extracted from multiple orthorectified aerial images via four statistical models and compared the results with heritability estimates of these phenotypes extracted from a single orthomosaic image. Our results indicate that extracting traits directly from multiple orthorectified aerial images yielded increased estimates of heritability for all three phenotypes through proper modeling, compared to estimation using traits extracted from the orthomosaic image. In summary, the image processing methods demonstrated in this study have the potential to improve the quality of the plant trait extracted from high-throughput imaging. This, in turn, can enable breeders to utilize phenomics technologies more effectively for improved selection.