Weikang Yu

Weikang Yu

Auto-generated profile, based on publicly available information

Weikang Yu

Helmholtz-Zentrum Dresden-Rossendorf, Freiberg, Germany

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 February 2023 in ISPRS Journal of Photogrammetry and Remote Sensing
Verified
Journal Article
Closed access
Xiaokang ZhangXiaokang Zhang
Xiaokang Zhang
WYWeikang Yu
Weikang Yu
Manon PunManon Pun
Manon Pun
Wenzhong ShiWenzhong Shi
Wenzhong Shi

1 June 2023 in IEEE Geoscience and Remote Sensing Magazine
Verified
Journal Article
Closed access
Yonghao XuYonghao Xu
Yonghao Xu
TBTao Bai
Tao Bai
WYWeikang Yu
Weikang Yu
Shizhen ChangShizhen Chang
Shizhen Chang
PAPeter Atkinson
Peter Atkinson
Pedram GhamisiPedram Ghamisi
Pedram Ghamisi
Recent advances in artificial intelligence (AI) have significantly intensified research in the geoscience and remote sensing (RS) field. AI algorithms, especially deep learning-based ones, have been developed and applied widely to RS data analysis. The successful application of AI covers almost all aspects of Earth-observation (EO) missions, from low-level vision tasks like superresolution, denoising, and inpainting, to high-level vision tasks like scene classification, object detection, and semantic segmentation. Although AI techniques enable researchers to observe and understand the earth more accurately, the vulnerability and uncertainty of AI models deserve further attention, considering that many geoscience and RS tasks are highly safety critical. This article reviews the current development of AI security in the geoscience and RS field, covering the following five important aspects: adversarial attack, backdoor attack, federated learning (FL), uncertainty, and explainability. Moreover, the potential opportunities and trends are discussed to provide insights for future research. To the best of the authors’ knowledge, this article is the first attempt to provide a systematic review of AI security-related research in the geoscience and RS community. Available code and datasets are also listed in the article to move this vibrant field of research forward.

17 October 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
Yonghao XuYonghao Xu
Yonghao Xu
WYWeikang Yu
Weikang Yu
Pedram GhamisiPedram Ghamisi
Pedram Ghamisi
MKMichael Kopp
Michael Kopp
SHSepp Hochreiter
Sepp Hochreiter
The synthesis of high-resolution remote sensing images based on text descriptions has great potential in many practical application scenarios. Although deep neural networks have achieved great success in many important remote sensing tasks, generating realistic remote sensing images from text descriptions is still very difficult. To address this challenge, we propose a novel text-to-image modern Hopfield network (Txt2Img-MHN). The main idea of Txt2Img-MHN is to conduct hierarchical prototype learning on both text and image embeddings with modern Hopfield layers. Instead of directly learning concrete but highly diverse text-image joint feature representations for different semantics, Txt2Img-MHN aims to learn the most representative prototypes from text-image embeddings, achieving a coarse-to-fine learning strategy. These learned prototypes can then be utilized to represent more complex semantics in the text-to-image generation task. To better evaluate the realism and semantic consistency of the generated images, we further conduct zero-shot classification on real remote sensing data using the classification model trained on synthesized images. Despite its simplicity, we find that the overall accuracy in the zero-shot classification may serve as a good metric to evaluate the ability to generate an image from text. Extensive experiments on the benchmark remote sensing text-image dataset demonstrate that the proposed Txt2Img-MHN can generate more realistic remote sensing images than existing methods. Code and pre-trained models are available online (https://github.com/YonghaoXu/Txt2Img-MHN).

19 January 2022 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
WYWeikang Yu
Weikang Yu
Xiaokang ZhangXiaokang Zhang
Xiaokang Zhang
Manon PunManon Pun
Manon Pun
Cloud layer contamination is a common problem in optical remote sensing (RS) images. Deep-learning-based cloud removal from RS imagery has attracted increasing attention in recent years. However, it remains challenging to exploit useful multiscale cloud-aware representations from cloud imagery due to the lack of effective modeling of cloud distortion effects and the weak feature representation capabilities of networks. To circumvent these challenges, we propose a multiscale distortion-aware cloud removal (MSDA-CR) network consisting of multiple cloud-distortion-aware representation learning (CDARL) modules combined in a multiscale grid architecture. Specifically, cloud distortion control functions (CDCFs) are defined and incorporated into the CDARL modules to adaptively model the distortion effects induced by cloud interference in the imaging process, with learnable parameters for the exploitation of distortion-restored representations. These representations are further distilled across different scales in the MSDA-CR network and integrated based on an attention mechanism to restore cloud-free images while retaining the spatial structures of ground objects. Extensive experiments on visible and multispectral RS datasets confirm the effectiveness of the proposed MSDA-CR network.

5 July 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
WYWeikang Yu
Weikang Yu
Xiaokang ZhangXiaokang Zhang
Xiaokang Zhang
SDSamiran Das
Samiran Das
XZXiao Zhu
Xiao Zhu
Pedram GhamisiPedram Ghamisi
Pedram Ghamisi
Change detection (CD) from remote sensing (RS) images using deep learning has been widely investigated in the literature. It is typically regarded as a pixel-wise labeling task that aims to classify each pixel as changed or unchanged. Although per-pixel classification networks in encoder-decoder structures have shown dominance, they still suffer from imprecise boundaries and incomplete object delineation at various scenes. For high-resolution RS images, partly or totally changed objects are more worthy of attention rather than a single pixel. Therefore, we revisit the CD task from the mask prediction and classification perspective and propose MaskCD to detect changed areas by adaptively generating categorized masks from input image pairs. Specifically, it utilizes a cross-level change representation perceiver (CLCRP) to learn multiscale change-aware representations and capture spatiotemporal relations from encoded features by exploiting deformable multihead self-attention (DeformMHSA). Subsequently, a masked cross-attention-based detection transformers (MCA-DETR) decoder is developed to accurately locate and identify changed objects based on masked cross-attention and self-attention mechanisms. It reconstructs the desired changed objects by decoding the pixel-wise representations into learnable mask proposals and making final predictions from these candidates. Experimental results on five benchmark datasets demonstrate the proposed approach outperforms other state-of-the-art models. Codes and pretrained models are available online (https://github.com/EricYu97/MaskCD).

8 March 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Xiaokang ZhangXiaokang Zhang
Xiaokang Zhang
WYWeikang Yu
Weikang Yu
Manon PunManon Pun
Manon Pun
Deep learning (DL) approaches based on convolutional encoder–decoder networks have shown promising results in bitemporal change detection. However, their performance is limited by insufficient contextual information aggregation because they cannot fully capture the implicit contextual dependency relationships among feature maps at different levels. Moreover, harvesting long-range contextual information typically incurs high computational complexity. To circumvent these challenges, we propose multilevel deformable attention-aggregated networks (MLDANets) to effectively learn long-range dependencies across multiple levels of bitemporal convolutional features for multiscale context aggregation. Specifically, a multilevel change-aware deformable attention (MCDA) module consisting of linear projections with learnable parameters is built based on multihead self-attention (SA) with a deformable sampling strategy. It is applied in the skip connections of an encoder–decoder network taking a bitemporal deep feature hypersequence (BDFH) as input. MCDA can progressively address a set of informative sampling locations in multilevel feature maps for each query element in the BDFH. Simultaneously, MCDA learns to characterize beneficial information from different spatial and feature subspaces of BDFH using multiple attention heads for change perception. As a result, contextual dependencies across multiple levels of bitemporal feature maps can be adaptively aggregated via attention weights to generate multilevel discriminative change-aware representations. Experiments on very-high-resolution (VHR) datasets verify that MLDANets outperform state-of-the-art change detection approaches with dramatically faster training convergence and high computational efficiency.