Tao Xu

Tao Xu

Auto-generated profile, based on publicly available information

Tao Xu

Chinese Academy of Sciences, Aerospace Information Research Institute, Beijing, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 June 2021 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
TXTao Xu
Tao Xu
XSXian Sun
Xian Sun
WDWenhui Diao
Wenhui Diao
ZLzhao liangjin
zhao liangjin
KFKun Fu
Kun Fu
HWHongqi Wang
Hongqi Wang
Object detection is a fundamental part of the interpretation of remote sensing imagery. The one-stage object detector has been adopted into this field because of its high computational efficiency. However, this detector suffers from the misalignment among predefined anchor, object, and feature extracted by standard convolution kernel both in spatial and scale. It limits the further improvement of performance, especially for the long-narrow and multiscale geospatial objects. In this article, the problem is defined as the feature misalignment problem. To deal with this issue, an efficient feature aligned single-shot detector (ASSD) is proposed, which consists of two modules: a novel pseudo anchor proposal module (PAPM) and a flexible context-based feature alignment module (CFAM). The PAPM replaces the regular anchor group with the proposed core anchor and refines it to get aligned locations. It can tackle the spatial misalignment between anchors and their corresponding objects and alleviate the negative/positive imbalance problem. Then, the CFAM adaptively adjusts the sampling points of the convolution kernel and collects the context information according to the aligned core anchor. This plug-and-play module can effectively rectify the misalignment between kernel and objects and extract aligned and robust features. A series of comprehensive experiments are conducted on two large-scale public remote sensing object detection datasets. Experiment results suggest that the proposed method is effective to alleviate the misalignment problem. Compared with the baseline model, the detection accuracy is improved by 8.5% mAP and 11.0% mAP on the challenging benchmark for object detection in optical remote sensing image (DIOR) and a large-scale dataset for object detection in aerial image (DOTA) dataset, respectively. Our best-resulting model achieves the state-of-the-art performance, surpassing other one-stage detectors both on the two datasets at a high detection speed of 21 FPS.

18 May 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
JHJianlong Hou
Jianlong Hou
ZGZhi Guo
Zhi Guo
Youming WuYouming Wu
Youming Wu
WDWenhui Diao
Wenhui Diao
TXTao Xu
Tao Xu
Boundary information is essential for the semantic segmentation of remote sensing images. However, most existing methods were designed to establish strong contextual information while losing detailed information, making it challenging to extract and recover boundaries accurately. In this paper, a boundary-sensitive network (BSNet) is proposed to address this problem via dynamic hybrid gradient convolution (DHGC) and coordinate sensitive attention (CSA). Specifically, in the feature extraction stage, we propose dynamic hybrid gradient convolution (DHGC) to replace vanilla convolution, which adaptively aggregates one vanilla convolution kernel and two gradient convolution kernels (GCKs) into a new operator to enhance boundary information extraction. The GCKs are proposed to explicitly encode boundary information, which are inspired by traditional Sobel operators. In the feature recovery stage, the coordinate sensitive attention (CSA) is introduced. This module is used to reconstruct the sharp and detailed segmentation results by adaptively modeling the boundary information and long-range dependencies in the low-level features as the assistance of high-level features. Note that DHGC and CSA are plug-and-play modules. We evaluate the proposed BSNet on three public data sets: the ISPRS 2-D semantic labeling Vaihingen, Potsdam benchmark and iSAID data set. The experimental results indicate that BSNet is a highly effective architecture that produces sharper predictions around object boundaries and significantly improves the segmentation accuracy. Our method demonstrates superior performance on the Vaihingen, Potsdam benchmark and iSAID data set, in terms of the mean F1, with improvements of 4.6%, 2.3% and 2.4% over strong baselines, respectively. The code and models will be made publicly available.

27 January 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
TXTao Xu
Tao Xu
XSXian Sun
Xian Sun
WDWenhui Diao
Wenhui Diao
ZLzhao liangjin
zhao liangjin
KFKun Fu
Kun Fu
HWHongqi Wang
Hongqi Wang
Deep learning-based object detectors have been widely adopted in the field of remote sensing imagery interpretation. These detectors heavily depend on the expensive large-scale labeled datasets, while the scarce remote sensing datasets limit the performance. The domain adaptive object detection can alleviate this problem. However, it struggles with the confusing feature’s alignment, damaging the domain generalization performance, especially for the remote sensing scene with sparse objects and diverse backgrounds. For that reason, a semisynthetic data generator (SDG) is proposed to automatically generate the remote sensing dataset with low cost and replace the real-world training dataset, a feature aligned domain adaptive object detector (FADA) is proposed to enhance the domain adaptation among the cross-domain remote sensing images. The FADA contains two proposed modules in addition to the base detector: an adversarial-based foreground alignment (AFA) and a prototype-based confusing feature alignment (PCFA). The AFA aligns the cross-domain foreground feature by adversarial training (AT), and it can filter the noisy background feature that is not suitable to transfer. Then, the PCFA adaptively aligns the confusing background and foreground feature, further promoting the domain adaptation performance. Comprehensive experiments validate the effectiveness of the proposed method. Compared with the baseline model trained on the semisynthetic source dataset, our FADA improves the generalized performance on the real-world target dataset a large-scale Dataset for Object deTection in Aerial images (DOTA) by 15.7% average precision (AP) and achieves state-of-the-art results.

1 November 2019
Verified
Conference Paper
Closed access
TXTao Xu
Tao Xu
TWTao Wu
Tao Wu
HXHaibing Xiang
Haibing Xiang
Bidimensional empirical mode decomposition (BEMD) method is considered advantageous for analyzing non-stationary and non-linear signals. Recently, it has been introduced in non-stationary high resolution Synthetic Aperture Radar (SAR) image processing. This letter proposes a new method for fusing high resolution Synthetic Aperture Radar (SAR) and Panchromatic images, based on BEMD method. Under this method, first, multi-resolution decomposition images are obtained, from the original images based on BEMD algorithm, the features of the original images are separated into multiple scales of spatial frequencies, called intrinsic mode functions (IMF), and then an area-based image fusion scheme is applied to fuse the images at each decomposition level. Experimental results from GaoFen-1 (GF-1) Panchromatic and COSMO-SkyMed SAR images show that the proposed method not only preserves the high spatial resolution of Panchromatic image, but also combines the target and surface information in SAR image, which are difficult to identify in the Panchromatic image. The new algorithm outperforms the wavelet transform and non-subsampled contourlet transform (NSCT), in terms of both visual effect and quantitative analysis.