Xinxin Liu

Dr. Xinxin Liu

Hunan University, Changsha, Guangdong, China
orcid

Research Focus & Metrics

Academic Career Length

30Years (1997-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 May 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Bin YangBin Yang
Bin Yang
LQLe Qin
Le Qin
JLJianqiang Liu
Jianqiang Liu
Xinxin LiuXinxin Liu
Xinxin Liu
Change detection in time series is among the most critical problems in Earth monitoring and attracts extensive attention in the remote sensing community. The task is, however, nontrivial because available images are irregularly collected due to interference by clouds and shadows. Traditional recurrent neural networks neglect such information and, thus, degrade the possibility of distinguishing pseudochanges (caused by intra-annual and interannual dynamics) and real changes. To this end, we proposed an unsupervised time-distance-guided convolutional recurrent network (UTRNet) for change detection in irregularly collected images. UTRNet is distinctive because the influence of pseudochanges can be suppressed by adopting a novel time-distance-guided long short-term memory (TLSTM) unit, in which input and forget gates are modified to adapt to irregular time distances. To the best of our knowledge, this is the first time that the influence of pseudochanges can be suppressed using irregular time distances. Moreover, to make UTRNet more applicable, a weighted prechange detection model is proposed to extract the most reliable training samples automatically. In the training process, unlike existing approaches that only care about changed and unchanged sample imbalance, our UTRNet also pays attention to imbalance between hard and easy samples, and proposes a new focal weighted cross-entropy loss, which helps to make the training process focus on hard changed samples. The proposed UTRNet is validated on Landsat 8 time-series data collected over nine typical scenes in the 2013–2021 period. Qualitative and quantitative comparisons with several state-of-the-art methods suggest the superior performance of UTRNet. Our dataset and codes are available at https://github.com/thebinyang/UTRNet .

29 March 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Bin YangBin Yang
Bin Yang
YMYin Mao
Yin Mao
Licheng LiuLicheng Liu
Licheng Liu
Xinxin LiuXinxin Liu
Xinxin Liu
YMYuzhong Ma
Yuzhong Ma
Jing LiJing Li
Jing Li
Deep learning approaches have been extensively applied to change detection in hyperspectral images (HSIs). However, the majority of them encounter scarcity of training samples or rely on complex structures and learning strategies. Although untrained change detection models have been proved to be effective in relief above problems, they were constructed using regular convolutions and treated spatial locations and channels equally, which are insufficient to extract discriminative features and lead to limited accuracy. Given this, a novel untrained framework using randomly initialized models with spatial-channel augmentation (RICD) is proposed for HSI change detection in this paper. It consists of two major modules: 1) an enhanced feature extraction network using successive dilation-deformable feature extraction blocks, which can extract multiscale spatial-spectral features over unfixed sampling locations. It enlarges the field of view of convolutions and takes arbitrary neighborhood into consideration, which helps to increase the discriminativeness of the extracted features; 2) a change sensitive feature augmentation and comparison module integrating feature selection and spatial-channel augmentation strategies, which can exploit spatial context and channel importance. It magnifies difference between changed pixels and unchanged ones and emphasizes contribution of significant channels of the selected change sensitive features. Despite that convolution operations are included in RICD, all the weights are untrained and fixed once they are randomly initialized, indicating that the RICD can work in an unsupervised manner. Its performance is tested over three widely used hyperspectral datasets. Quantitative and qualitative comparisons with several state-of-the-art unsupervised methods reveal the effectiveness of the RICD method.

9 September 2022 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
LFLeyuan Fang
Leyuan Fang
PZPeng Zhou
Peng Zhou
Xinxin LiuXinxin Liu
Xinxin Liu
Pedram GhamisiPedram Ghamisi
Pedram Ghamisi
Siwei ChenSiwei Chen
Siwei Chen
As the foundation of image interpretation, semantic segmentation is an active topic in the field of remote sensing. Facing the complex combination of multiscale objects existing in remote sensing images (RSIs), the exploration and modeling of contextual information have become the key to accurately identifying the objects at different scales. Although several methods have been proposed in the past decade, insufficient context modeling of global or local information, which easily results in the fragmentation of large-scale objects, the ignorance of small-scale objects, and blurred boundaries. To address the above issues, we propose a contextual representation enhancement network (CRENet) to strengthen the global context (GC) and local context (LC) modeling in high-level features. The core components of the CRENet are the local feature alignment enhancement module (LFAEM) and the superpixel affinity loss (SAL). The LFAEM aligns and enhances the LC in low-level features by constructing contextual contrast through multilayer cascaded deformable convolution and is then supplemented with high-level features to refine the segmentation map. The SAL assists the network to accurately capture the GC by supervising semantic information and relationship learned from superpixels. The proposed method is plug-and-play and can be embedded in any FCN-based network. Experiments on two popular RSI datasets demonstrate the effectiveness of our proposed network with competitive performance in qualitative and quantitative aspects.

13 September 2024 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
Bin YangBin Yang
Bin Yang
YMYin Mao
Yin Mao
Licheng LiuLicheng Liu
Licheng Liu
LFLeyuan Fang
Leyuan Fang
Xinxin LiuXinxin Liu
Xinxin Liu
Deep learning-based hyperspectral image (HSI) change detection (CD) approaches have a strong ability to leverage spectral-spatial-temporal information through automatic feature extraction, and currently dominate in the research field. However, their efficiency and universality are limited by the dependency on labeled data. Although the newly applied untrained networks can avoid the need for labeled data, their feature volatility from the simple difference space easily leads to inaccurate CD results. Inspired by the interesting finding that salient changes appear as bright “stripes” in a new feature space, we propose a novel unsupervised CD method that represents and models changes in stripes for HSIs (named as StripeCD), which integrates optimization modeling into an untrained network. The StripeCD method constructs a new feature space that represents change features in stripes and models them in a novel optimization manner. It consists of three main parts: 1) A dual-branch untrained convolutional network, which is utilized to extract deep difference features from bitemporal HSIs and combined with a two-stage channel selection strategy to emphasize the important channels that contribute to CD. 2) A multiscale forward-backward segmentation framework, which is proposed for salient change representation. It transforms deep difference features into a new feature space by exploiting the structure information of ground objects and associates salient changes with the stripe-shaped change component. 3) A stripe-shaped change extraction model, which characterizes the global sparsity and local discontinuity of salient changes. It explores the intrinsic properties of deep difference features and constructs model-based constraints to better identify changed regions in a controllable manner. The proposed StripeCD method outperformed the state-of-the-art unsupervised CD approaches on three widely used datasets. In addition, the proposed StripeCD method indicates the potential for further investigation of untrained networks in facilitating reliable CD.

1 November 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
CLCongyu Li
Congyu Li
Xinxin LiuXinxin Liu
Xinxin Liu
SLShutao Li
Shutao Li
Cloud-free image reconstruction is of great significance for improving the quality of optical satellite images that are vulnerable to bad weather. When cloud cover makes it impossible to obtain information under the cloud, auxiliary data is indispensable to guide the reconstruction of the cloud-contaminated area. Additionally, the areas that require continuous observation are mostly regions with complex features, which puts higher demands on the restoration of texture, color, and other details in data reconstruction. In this paper, we propose a Transformer-based generative adversarial network for cloud-free multispectral image reconstruction via multi-sensor data fusion in satellite images (TransGAN-CFR). Synthetic Aperture Radar (SAR) images that are not affected by clouds are used as auxiliary data and paired with cloudy optical images into the GAN generator. To take advantage of the deep-shallow features and global-local geographical proximity in remote sensing images, the proposed generator employs a hierarchical Encoder-Decoder structure, in which the Transformer blocks adopt a non-overlapping window multi-head self-attention (WMSA) mechanism and a modified feed-forward network though depth-wise convolutions and the gating mechanism. Besides, we introduce a Triplet loss function specifically designed for cloud removal tasks to provide the generated cloud-less image with greater proximity to the ground truth. Compared with seven state-of-the-art deep learning-based cloud removal models, our network can yield more natural cloud-free images with better visual performance and more accurate results in quantitative evaluation on the SEN12MS-CR dataset.

29 July 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YTYao Tang
Yao Tang
JLJie Li
Jie Li
LYLinwei Yue
Linwei Yue
Xinxin LiuXinxin Liu
Xinxin Liu
YLYajie Li
Yajie Li
Qiangqiang YuanQiangqiang Yuan
Qiangqiang Yuan
Hyperspectral images (HSIs) with rich spectral information have been widely used in surface classification, object detection and other real application problems. However, due to the hardware limitations, the low spatial resolution HSIs hinder the exploration of their application potential. Deep learning-based methods are currently the most common solutions for single hyperspectral image super-resolution (HSI SR) tasks. However, such methods often overlook the degradation principle from high resolution HSI to low resolution HSI. In this paper, we propose a CNN-Transformer embedded unfolding network (CTUNet), in which an unfolding framework with an effective spatial-spectral prior network is designed for HSI SR by incorporating the degradation principle of HSIs. Specifically, a maximum posterior-based energy model is employed, enabling alternate optimization to seek the optimal solution in an iterative mechanism. To effectively utilize the structure prior of HSI, multi-scale self-calibrated convolution and edge-guided Transformer module are combined to learn latent spatial-spectral priors. Additionally, hidden feature connections between adjacent iterations enhance the representation of the image features. Extensive experiments conducted on three available HSI datasets demonstrate that our method outperforms several state-of-the-art HSI SR methods. Code will be available at https://github.com/YoeTon/CTUNet.