Shuang Zhang

Shuang Zhang

Auto-generated profile, based on publicly available information

Shuang Zhang

Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 January 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Verified
Journal Article
Open access
BSBaikai Sui
Baikai Sui
YCYungang Cao
Yungang Cao
XBXueqin Bai
Xueqin Bai
SZShuang Zhang
Shuang Zhang
RWRenzhe Wu
Renzhe Wu
Edge optimization of semantic segmentation results is a challenging issue in remote sensing image processing. This paper proposes a semantic segmentation model guided by a block-in-block edge detection network named BIBED-Seg. This is a two-stage semantic segmentation model, where edges are extracted first and then segmented. We do two key works: The first work is edge detection, and we present BIBED, a block-in-block edge detection network, to extract the accurate boundary features. Here, the edge detection of multi-scale feature fusion is first realized by creating the block-in-block residual network structure and devising the multi-level loss function. Second, we add the channel and spatial attention module into the residual structure to improve high-resolution remote sensing images' boundary positioning and detection accuracy by focusing on their channel and spatial dimensions. Finally, we evaluate our method on ISPRS Potsdam and Vaihingen data sets and obtain ODS F-measure of 0.6671 and 0.7432, higher than other excellent edge detection methods. The second work is two-stage segmentation. First, the proposed BIBED is individually pre-trained, and subsequently, the pre-trained model is introduced into the entire segmentation network to extract boundary features. In the second segmentation stage, the edge detection network is used to constrain semantic segmentation results by loss cycles and feature bootstrapping. Our best model obtains the OA of 90.2%, 87.7%, and 81.5%, the IOU of 76.0%, 69.6%, and 61.3% on the ISPRS and WHDLD datasets, respectively.

21 July 2023 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
SZShuang Zhang
Shuang Zhang
YCYungang Cao
Yungang Cao
BSBaikai Sui
Baikai Sui
Extracting building instances from remote sensing images has various applications. However, existing instance segmentation methods have difficulty maintaining regular and angular building boundaries, corrupting the mask quality. This letter proposes a boundary-optimized instance segmentation method based on the direction field to cope with the low boundary quality. The proposed method develops a DF-Mask head to improve the mask quality of the primary instance segmentation network (Mask R-CNN) through boundary optimization. Within the DF-Mask head, first, a gated directional context-aware module (GDCAM) improves the mask features through the directional context and a designed gating mechanism. Then a direction field rectification module (DFRM) predicts the direction field and iteratively rectifies the mask. To the best of our knowledge, this is the first time that direction field rectification has been developed to the instance segmentation method and applied to building instance extraction. Experimental results on the Vaihingen and Massachusetts datasets suggest that our method outperforms the eight state-of-the-art methods. Compared with Mask R-CNN, our method improves APs by 4.7% and 2.2% on the two datasets, respectively.

31 August 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YCYungang Cao
Yungang Cao
SZShuang Zhang
Shuang Zhang
BSBaikai Sui
Baikai Sui
YXYakun Xie
Yakun Xie
JZJun Zhu
Jun Zhu
Building extraction is a significant topic in high-resolution remote sensing. Insufficient integrity, irregular boundaries, and inaccurate corners remain a problem for existing methods. However, individually optimizing one of these aspects may leave problems in others. Unfortunately, few methods consider integrity, boundary, and corner simultaneously. In this study, we propose a three-stage network (IBCO-Net) incorporating integrity-boundary-corner optimization for fine segmentation of buildings. First, long-range dependent and spatial-continuous blocks (LDSCs) are plugged into the decoder to enhance building integrity. Second, the direction field correction module (DFCM) controls the overall shape of the building by learning the direction field and executing an iterative correction algorithm. Finally, the multi-strategy point refinement module (MSPRM) selects boundary and corner points for re-classification to further refine the boundary and relocate corners. And a hybrid loss function supervises IBCO-Net to optimize each stage. Comparative experiments were conducted on three datasets: the Massachusetts building dataset, the ISPRS Potsdam dataset, and the dataset of building instances of typical cities in China. We evaluated common pixel-level metrics and object-level boundary and corner metrics, with experimental results showing that IBCO-Net outperforms 8 state-of-the-art CNN and Transformer-based methods. In addition, the generality of the proposed method is demonstrated via its performance by applying 9 existing backbone networks.

5 December 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
BSBaikai Sui
Baikai Sui
YCYungang Cao
Yungang Cao
HCHaibo Cheng
Haibo Cheng
SZShuang Zhang
Shuang Zhang
JZJun Zhu
Jun Zhu
YXYakun Xie
Yakun Xie
Low resolution is a major factor that negatively impacts the accuracy of remote sensing (RS) interpretation. High-quality super-resolution reconstruction (SRR) can help alleviate this problem. In this study, we present a multistage semantic segmentation training strategy called SRSSTS, which is based on detail-optimized SRR. SRSSTS addresses the challenges of poor reconstruction quality and low semantic segmentation (SS) accuracy of RS images. Our approach involves constructing a generative adversarial network (GAN)-based perceptual-loss-dominated SRR network, which generates texture-realistic, high-quality high-resolution images from low-resolution RS images. We then input the generated images into an SS network in steps and propose a three-stage joint loss to generate segmentation results at different resolutions. SRSSTS is straightforward and efficient, and it can be applied to any SS backbone networks. Additionally, this strategy does not increase computational resources compared to other SR-based segmentation methods, since the SRR network is trained separately. We evaluated the effectiveness of our designed SRR network and SRSSTS on five RS datasets (ISPRS Potsdam and Vaihingen, WHDLD, LoveDA Rural and Urban) with different resolutions, achieving excellent performance compared to an SS model for a single task and other SR-based segmentation methods. Moreover, we observed that the learned perceptual image patch similarity (LPIPS) of the super-resolution (SR) reconstructed images, i.e., the stronger the perception ability, the more helpful it is for the SS task.

2 March 2023 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
YCYungang Cao
Yungang Cao
BSBaikai Sui
Baikai Sui
SZShuang Zhang
Shuang Zhang
HQHui Qin
Hui Qin
The diversity and complexity of the subsurface, as well as the similarity of cloud features to those of highlighted surface objects (especially snowy areas), are the main reasons for the current limitations in cloud detection accuracy. This letter proposes a semantic segmentation network fusing geographic features with contextual information for cloud detection named GCI_CD. We design three modules: geographical-cloud information fusion module (to distinguish between clouds and snow), separable ResNet with CSAM encoder (to enhance channel and spatial association information extraction), contextual information integration module (to extract multi-scale features). To the best of our knowledge, this is the first time that geographic information has been fused in a cloud detection method. The validity of our proposed method is demonstrated using a high-resolution GF-1 dataset containing the near-infrared band and dividing the snow-covered and non-snow-covered areas. The experimental results show that GCI_CD has a better performance not only in snow-covered regions but also in the non-snow-covered regions. Especially for snow-covered images, the IOU of GCI_CD’s cloud detection results are improved by 5% on average compared to other cloud detection methods.

28 June 2023 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
SZShuang Zhang
Shuang Zhang
YCYungang Cao
Yungang Cao
BSBaikai Sui
Baikai Sui
Shadow extraction from remote sensing images is critical work. However, the inter-class similarity of shadows with dark water, trees, and roads and the dependence on other objects make accurate shadow extraction still challenging. This letter proposes a dual-stream network based on the transformer and high-resolution representation (DTHNet) for multi-scale shadow extraction. The DTHNet utilizes two streams: the high-resolution representation stream extracts deep features while maintaining detail information, and the clustering representation stream provides clustering feature constraints to enhance the ability to distinguish between foreground and background. Additionally, the designed multi-scale auxiliary predictor and hybrid loss aid in extracting multi-scale shadows. We evaluated our proposed method on the AISD dataset and compared it against six state-of-the-art generic semantic segmentation models and shadow extraction methods. The experimental results demonstrate that the DTHNet outperforms the existing methods.