Remote sensing can transform the speed, scale, and cost of biodiversity and forestry surveys. Data acquisition currently outpaces the ability to identify individual organisms in high resolution imagery. We outline an approach for identifying tree-crowns in RGB imagery while using a semi-supervised deep learning detection network. Individual crown delineation has been a long-standing challenge in remote sensing and available algorithms produce mixed results. We show that deep learning models can leverage existing Light Detection and Ranging (LIDAR)-based unsupervised delineation to generate trees that are used for training an initial RGB crown detection model. Despite limitations in the original unsupervised detection approach, this noisy training data may contain information from which the neural network can learn initial tree features. We then refine the initial model using a small number of higher-quality hand-annotated RGB images. We validate our proposed approach while using an open-canopy site in the National Ecological Observation Network. Our results show that a model using 434,551 self-generated trees with the addition of 2848 hand-annotated trees yields accurate predictions in natural landscapes. Using an intersection-over-union threshold of 0.5, the full model had an average tree crown recall of 0.69, with a precision of 0.61 for the visually-annotated data. The model had an average tree detection rate of 0.82 for the field collected stems. The addition of a small number of hand-annotated trees improved the performance over the initial self-supervised model. This semi-supervised deep learning approach demonstrates that remote sensing can overcome a lack of labeled training data by generating noisy data for initial training using unsupervised methods and retraining the resulting models with high quality labeled data.
28 August 2020 in Methods in Ecology and Evolution
Remote sensing can transform the speed, scale, and cost of biodiversity and forestry surveys. Data acquisition currently outpaces the ability to identify individual organisms in high resolution imagery. We outline an approach for identifying tree-crowns in RGB imagery while using a semi-supervised deep learning detection network. Individual crown delineation has been a long-standing challenge in remote sensing and available algorithms produce mixed results. We show that deep learning models can leverage existing Light Detection and Ranging (LIDAR)-based unsupervised delineation to generate trees that are used for training an initial RGB crown detection model. Despite limitations in the original unsupervised detection approach, this noisy training data may contain information from which the neural network can learn initial tree features. We then refine the initial model using a small number of higher-quality hand-annotated RGB images. We validate our proposed approach while using an open-canopy site in the National Ecological Observation Network. Our results show that a model using 434,551 self-generated trees with the addition of 2848 hand-annotated trees yields accurate predictions in natural landscapes. Using an intersection-over-union threshold of 0.5, the full model had an average tree crown recall of 0.69, with a precision of 0.61 for the visually-annotated data. The model had an average tree detection rate of 0.82 for the field collected stems. The addition of a small number of hand-annotated trees improved the performance over the initial self-supervised model. This semi-supervised deep learning approach demonstrates that remote sensing can overcome a lack of labeled training data by generating noisy data for initial training using unsupervised methods and retraining the resulting models with high quality labeled data.
Comparison of the taxonomic, phylogenetic, and trait dimensions of beta diversity may uncover the mechanisms that generate and maintain biodiversity, such as geographic isolation, environmental filtering, and convergent adaptation. We developed an approach to predict the relationship between environmental and geographic distance and the dimensions of beta diversity. We tested these predictions using hummingbird assemblages in the northern Andes. We expected taxonomic beta diversity to result from recent geographic barriers limiting dispersal, and we found that cost distance, which includes barriers, was a better predictor than Euclidean distance. We expected phylogenetic beta diversity to result from historical connectivity and found that differences in elevation were the best predictors of phylogenetic beta diversity. We expected high trait beta diversity to result from local adaptation to differing environments and found that differences in elevation were correlated with trait beta diversity. When combining beta diversity dimensions, we observe that high beta diversity in all dimensions results from adaption to different environments between isolated assemblages. Comparisons with high taxonomic, low phylogenetic, and low trait beta diversity occurred among lowland assemblages separated by the Andes, suggesting that geographic barriers have recently isolated lineages in similar environments. We provide insight into mechanisms governing hummingbird biodiversity patterns and provide a framework that is broadly applicable to other taxonomic groups.
15 December 2014 in Methods in Ecology and Evolution