Different from object counting in surveillance scenes, remote sensing object counting encounters knotty challenges due to its tiny scale and cluttered background. However, existing remote sensing counting methods pursue favorable performance by sacrificing resolution to obtain semantic information, resulting in the loss of significant features of tiny-scale objects. To surmount the above issue, we propose a novel hierarchical kernel interaction network, dubbed HKINet, for remote sensing object counting. HKINet is comprised of several hierarchical kernel interaction modules (HKIMs) to simultaneously preserve high-resolution features and extract deep-layer semantic information. Specifically speaking, HKIM hierarchically performs multiresolution convolutions to avoid information loss in low resolution. Moreover, a scale interaction block (SIB) is used to combine multiresolution features for semantic information interaction. Finally, hierarchical resolutions are fused to output the prediction density map. To validate the superiority of our proposed HKINet, we conduct extensive experiments on four remote sensing object counting datasets, e.g., RSOC, CARPK, PUCPR+, and DroneCrowd datasets, and experimental results demonstrate HKINet outperforms other state-of-the-art remote sensing counting methods in terms of mean absolute error (MAE) and root mean squared error (RMSE).
The detection and monitoring of changes in urban buildings, as a major place for human activities, have been considered profoundly in the field of remote sensing. In recent years, comparing with other traditional methods, the deep learning-based methods have become the mainstream methods for urban building change detection due to their strong learning ability and robustness. Unfortunately, often, it is difficult and costly to obtain sufficient samples for the change detection method development. As a result, the application of the deep learning-based building change detection methods is limited in practice. In our work, we proposed a novel multi-task network based on the idea of transfer learning, which is less dependent on change detection samples by appropriately selecting high-dimensional features for sharing and a unique decoding module. Different from other multi-task change detection networks, with the help of a high-accuracy building mask, our network can fully utilize the prior information from building detection branches and further improve the change detection result through the proposed object-level refinement algorithm. To evaluate the proposed method, experiments on the publicly available WHU Building Change Dataset were conducted. The experimental results show that the proposed method achieves F1 values of 0.8939, 0.9037, and 0.9212, respectively, when 10%, 25%, and 50% of change detection training samples are used for network training under the same conditions, thus, outperforming other methods.
Forest resources have important ecological and environmental values, and monitoring forest changes using remote sensing images is essential for resource management and ecological protection. However, current forest change detection methods fail to simultaneously integrate fine spatial information with temporal dynamic data, making them susceptible to pseudo changes induced by seasonal factors. In this paper, we propose a forest change detection method called STFNet that integrates multi-source spatiotemporal information. By combining fine spatial details of high-resolution images with dynamic information from time-series images, STFNet enhances the accuracy of forest change detection, alleviating the problem of information fusion difficulties caused by inconsistent granularity in spatiotemporal spectral features from different sources. In STFNet, we propose a cross-attention-based temporal differential feature fusion module (CATFF) to capture spatiotemporal dependencies within time-series images and a multiresolution contextual differential feature fusion module (MCDF) to achieve efficient spatial contexture fusion across multiresolution images. To validate our method, we conduct experiments using Gaofen and Sentinel-2 satellite images. Experimental results demonstrate that STFNet achieves excellent performance with an F1-score of 87.65%, outperforming state-of-the-art methods by at least 2.02%. Our ablation study further confirms the effectiveness of our method in leveraging time-series information to detect forest changes and suppress seasonal interference.
Cloud, one of the poor atmospheric conditions, significantly reduces the usability of optical remote-sensing data and hampers follow-up applications. Thus, the identification of cloud remains a priority for various remote-sensing activities, such as product retrieval, land-use/cover classification, object detection, and especially for change detection. However, the complexity of clouds themselves make it difficult to detect thin clouds and small isolated clouds. To accurately detect clouds in satellite imagery, we propose a novel neural network named the Pyramid Contextual Network (PCNet). Considering the limited applicability of a regular convolution kernel, we employed a Dilated Residual Block (DRB) to extend the receptive field of the network, which contains a dilated convolution and residual connection. To improve the detection ability for thin clouds, the proposed new model, pyramid contextual block (PCB), was used to generate global information at different scales. FengYun-3D MERSI-II remote-sensing images covering China with 14,165 × 24,659 pixels, acquired on 17 July 2019, are processed to conduct cloud-detection experiments. Experimental results show that the overall precision rates of the trained network reach and the overall recall rates reach , which performs better both in quantity and quality than U-Net, UNet++, UNet3+, PSPNet and DeepLabV3+.