9 May 2024 in IEEE Geoscience and Remote Sensing Letters
Change detection (CD) plays a crucial role in remote sensing analysis. Semantic change detection (SCD) further expands CD by incorporating land use and land cover (LULC) segmentation before and after the changes, identifying specific change categories alongside the change area detection. While recent studies combining change area detection and bitemporal LULC segmentation within a multitask framework demonstrate promising performance, they often only utilize pixels in changed areas with change classification labels in LULC segmentation training, overlooking substantial unlabeled LULC data in unchanged areas, which restricts the model’s effectiveness. Accordingly, we propose an enhanced multitask SCD method with semi-supervised learning in LULC segmentation, effectively leveraging the extensive unlabeled LULC data and improving the overall performance of the multitask framework. Besides, we introduce a novel loss tailored for this semi-supervised method based on the unique relationship between bitemporal pixel labels in change areas and change classification. Optimization of the semi-supervised loss weighting further refines the training. Experiments on the public dataset validate the effectiveness of these improvements, especially in enhancing change classification performance. Applying our method to the naive model yields improvements in SeK and Fscd, with the increases of up to 2%. The code will be available after the acceptance at https://github.com/ijnokml/scd-enhanced .
7 August 2023 in IEEE Geoscience and Remote Sensing Letters
Change detection plays an important role in Earth surface analysis. Current change detection methods have achieved good performance in large flat areas, but change detection of detailed parts is still a great challenge, and the loss of detail causes many faults around the change boundaries and on small objects. By analyzing the feature map of the widely used U-Net architecture in existing methods, we ascribe the detail loss to the depletion of detailed features during the top-to-down delivery in the U-Net architecture. The Feature Refine Change Detection(FRCD) model is proposed in which the detection results are predicted directly from the multiscale features instead of the U-Net architecture. By direct prediction, the representation ability of details is enhanced, and thus the detection accuracy of boundaries and small objects improves. Moreover, the normal upsampling in direct prediction is replaced with the deformable upsampling, which delivers detailed information from the low-level to the high-level via the deformable convolution, allowing the results to further fit boundaries in the FRCD model. Experimental results on two datasets confirm the effectiveness of FRCD compared to state-of-the-art methods, and the change detection results of boundaries and small objects are improved significantly by the proposed method. Code will be available after the acceptance of the paper in https://github.com/ijnokml/cdfr.