Quantification of three-dimensional green volume (3DGV) plays a crucial role in assessing environmental benefits to urban green space (UGS) at a regional level. However, precisely estimating regional 3DGV based on satellite images remains challenging. In this study, we developed a parametric estimation model to retrieve 3DGV in UGS through combining Sentinel-1 and Sentinel-2 images. Firstly, UAV images were used to calculate the referenced 3DGV based on mean of neighboring pixels (MNP) algorithm. Secondly, we applied the canopy height model (CHM) and Leaf Area Index (LAI) derived from Sentinel-1 and Sentinel-2 images to construct estimation models of 3DGV. Then, we compared the accuracy of estimation models to select the optimal model. Finally, the estimated 3DGV maps were generated using the optimal model, and the referenced 3DGV was employed to evaluate the accuracy of maps. Results indicated that the optimal model was the combination of LAI power model and CHM linear model (3DGV = 37.13·LAI−0.3·CHM + 38.62·LAI1.8 + 13.8, R2 = 0.78, MPE = 8.71%). We validated the optimal model at the study sites and achieved an overall accuracy (OA) of 75.15%; then, this model was used to map 3DGV distribution at the 10 m resolution in Kunming city. These results demonstrated the potential of combining Sentinel-1 and Sentinel-2 images to construct an estimation model for 3DGV retrieval in UGS.
Accurately mapping tree species is crucial for forest management and conservation. Most previous studies relied on features derived from optical imagery, and digital elevation data and the potential of synthetic aperture radar (SAR) imagery and other environmental factors have, generally, been underexplored. Therefore, the aim of this study is to evaluate the potential of fusing freely available multi-modal data for accurately mapping tree species. Sentinel-2, Sentinel-1, and various environmental datasets over a large mountainous forest in Southwest China were obtained and analyzed using Google Earth Engine (GEE). Seven data cases considering the individual or joint performance of different features, and four additional cases considering a novel clustering-based feature selection method, were analyzed. All 11 cases were assessed using three machine learning algorithms, including random forest (RF), support vector machine (SVM), and extreme gradient boosting tree (XGBoost). The best performance, with an overall accuracy of 77.98%, was attained from the case with all features and the random forest classifier. Sentinel-2 data alone exhibited similar performance as environmental data in terms of overall accuracy. Similar species, such as oak and birch, cannot be spectrally discriminated based on Sentinel-2-based features alone. The addition of SAR features improved discrimination, especially when distinguishing between some coniferous and deciduous species, but also decreased accuracy for oak. The analysis based on different data cases and feature importance rankings indicated that environmental features are important. The random forest outperformed other models, and a better prediction was achieved for planted tree species compared to that for the natural forest. These results suggest that accurately mapping tree species over large mountainous areas is feasible with freely accessible multi-modal data, especially when considering environmental factors.
Deep convolutional neural networks have greatly enhanced the semantic segmentation of remote sensing images. However, most networks are primarily designed to process imagery with red, green, and blue bands. Although it is feasible to directly utilize established networks and pre-trained models for remotely sensed images, they suffer from imprecise land object contour localization and unsatisfactory segmentation results. These networks still need to explore the domain knowledge embedded in images. Therefore, we boost the segmentation performance of remote sensing images by augmenting the network input with multiple nonlinear spectral indices, such as vegetation and water indices, and introducing a novel holistic attention edge detection network (HAE-RNet). Experiments were conducted on the GID and Vaihingen datasets. The results showed that the NIR-NDWI/DSM-GNDVI-R-G-B (6C-2) band combination produced the best segmentation results for both datasets. The edge extraction block benefits better contour localization. The proposed network achieved a state-of-the-art performance in both the quantitative evaluation and visual inspection.
23 July 2013 in IEEE Geoscience and Remote Sensing Letters
This letter proposes an improved mean-shift filtering method. The method is added as a preprocessing step for regional segmentation methods, which aims at benefiting segmentations in a more general way. Using this method, first, a logistic regression model between two edge cues and semantic object boundaries is established. Then, boundary posterior probabilities are predicted by the model and associated with weights in the mean-shift filtering iteration. Finally, the filtered image, instead of the original image, is put into segmentation methods. In experiments, the regression model is trained with an aerial image, which is tested with an aerial image and a QuickBird image. Two popular segmentation methods are adopted for evaluations. Both quantitative and qualitative evaluations reveal that the presented procedure facilitates a superior image segmentation result and higher classification accuracy.
Deep learning has achieved remarkable performance in semantically segmenting remotely sensed images. However, the high-frequency detail loss caused by continuous convolution and pooling operations and the uncertainty introduced when annotating low-contrast objects with weak boundaries induce blurred object boundaries. Therefore, a dual-stream network MAE-BG, consisting of an edge detection (ED) branch and a smooth branch with boundary guidance (BG), is proposed. The ED branch is designed to enhance the weak edges that need to be preserved, simultaneously suppressing false responses caused by local texture. This mechanism is achieved by introducing improved multiple-attention edge detection blocks (MAE). Furthermore, two specific ED branches with MAE are designed to combine with typical deep convolutional (DC) and Codec infrastructures and result in two configurations of MAE-A and MAE-B. Meanwhile, multiscale edge information extracted by MAE networks is fed into the backbone networks to complement the detail loss caused by convolution and pooling operations. This results in smooth networks with BG. After that, the segmentation results with improved boundaries are obtained by stacking the output of the ED and smooth branches. The proposed algorithms were evaluated on the ISPRS Potsdam and Inria Aerial Image Labelling datasets. Comprehensive experiments show that the proposed method can precisely locate object boundaries and improve segmentation performance. The MAE-A branch leads to an overall accuracy (OA) of 89.16%, a mean intersection over union (MIOU) of 80.25% for Potsdam, and an OA of 96.61% and MIOU of 86.63% for Inria. Compared with the results without the proposed edge optimization blocks, the OAs from the Potsdam and Inria datasets increase by 5.49% and 7.64%, respectively.
GaoFen-2 (GF-2) is a civilian optical satellite self-developed by China equipped with both multispectral and panchromatic sensors, and is the first satellite in China with a resolution below 1 m. Because the pan-sharpening methods on GF-2 imagery have not been a focus of previous works, we propose a novel pan-sharpening method based on guided image filtering and compare the performance to state-of-the-art methods on GF-2 images. Guided image filtering was introduced to decompose and transfer the details and structures from the original panchromatic and multispectral bands. Thereafter, an adaptive model that considers the local spectral relationship was designed to properly inject spatial information back into the original spectral bands. Four pairs of GF-2 images acquired from urban, water body, cropland, and forest areas were selected for the experiments. Both quantitative and visual inspections were used for the assessment. The experimental results demonstrated that for GF-2 imagery acquired over different scenes, the proposed approach consistently achieves high spectral fidelity and enhances spatial details, thereby benefitting the potential classification procedures.