23 September 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
This paper investigates the safety risks associated with sea ice along the Arctic Route by using polar sea ice images obtained by Gaofen-3 (GF3) Synthetic Aperture Radar (SAR) satellites. We collected three SAR datasets, representative of GF3 satellites' operational modes, and constructed semantic segmentation datasets through meticulous annotation using concurrent optical satellite imagery obtained by Landsat satellites to ensure precision. We propose SI-CTFNet, an innovative sea ice semantic segmentation model that integrates Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) for enhanced multi-scale feature extraction. SI-CTFNet features a dual-pathway architecture designed to optimize feature extraction, complemented by the BiAFusion module, which effectively merges local and global features to improve decoding accuracy. Additionally, we introduce the MSDAM module to facilitate a comprehensive multi-scale contextual analysis, addressing the diverse distribution of ice types in the imagery. The model incorporates advanced decoding techniques, including a progressive upsampling (PUP) approach for the CNN-fusion branch and an efficient All-MLP module for the Transformer branch. Performance evaluations across three distinct datasets reveal that SI-CTFNet significantly outperforms existing methods in key metrics and maintains efficacy with supplementary Sentinel1A C-band satellite data. Furthermore, we present a streamlined variant of SI-CTFNet, which achieves a threefold increase in inference speed with minimal reduction in classification accuracy. The ultimate objective of this work is to advance a precise sea ice forecasting and navigation system for polar regions, aimed at automating sea ice classification within a smart polar shipping framework.
29 May 2023 in IEEE Transactions on Geoscience and Remote Sensing
Multispectral remote sensing images (RSI), including hyperspectral and multispectral images, contain adequate information of ground objects and areas and play important roles in environmental monitoring, weather forecasting, urban planning, etc. However, due to many inevitable external effects on the remote sensing pathway, remote sensing images are often degraded by blur. The fields of multispectral remote sensing image deblurring have witnessed great improvements in recent years, including both optimization-based and deep-learning-based methods. However, issues are to be addressed in the remote sensing image deblurring field, such as the incompatibility of general regularizations, lack of spectral correlations for multispectral RSIs, demands of blind deblurring for real world applications, and high costs of computation. To address these problems, we incorporate a novel prior exploiting gradient information similarity between different spectral bands, and we name it auxiliary band gradient information (ABGI) prior. We show that the ABGI prior is applicable to all gradient sparsity regularizations by a simple subtract-then-add step. Specifically, we apply ABGI prior to the patch-wise minimal pixel (PMP) prior based deblurring method, and we also prove that the PMP prior exhibits sparsity for clear natural RSIs. We estimate our method on remote sensing image datasets of different spectral types and geographic resolutions. Compared to other state-of-the-art deblurring methods, our method shows superior performance on both simulated and real world blur.
7 June 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
With the continuous development of edge computing, real-time processing of satellite images has gradually become a research hotspot. However, the current semantic segmentation methods for SAR images are suboptimal in terms of segmentation performance and inference speed. Therefore, we propose a fast fine semantic segmentation network for building regions in SAR images, called FFSSNet. The architecture of this network comprises a feature extractor, a Feature Reprocessing Module (FRM), a Multi-scale Feature Deep Fusion Module (MFDFM), and an auxiliary branch. Aiming at the problem of low signal-to-noise ratio of SAR images, the network extracts multi-scale features rich in context information through a feature extractor with a large receptive field. After that, through the FRM and MFDFM, the semantic information in each scale is deeply extracted and fused. This makes the feature maps contain semantic information of all scales. In addition, we design an auxiliary branch for reducing misclassification of pixels in non-target regions. We test the network using two completely different datasets. Compared with other state-of-the-art methods, our proposed method has the better performance in terms of segmentation accuracy, inference speed and generalisation ability.