Due to the significant nonlinear intensity changes of multispectral images, automatic image feature point matching is a challenging task. This letter addresses the problem and proposes a novel descriptor combining the structure and texture information to solve the nonlinear intensity variations of multispectral images. We first propose directional maps, i.e., the directional response maps (DMs) and the directional response binary maps (DBMs), which can capture the common structure and texture properties of multispectral images, respectively. We then use the spatial pooling pattern of the histogram of oriented gradients to separately describe the local region of each point of interest based on the DMs and DBMs. In order to speed up the calculation, we apply Gaussian filters to the DMs and average filters to the DBMs to construct the per-pixel histogram bins. Finally, we conjoin the normalized feature vectors corresponding to the structure description and texture description of each point of interest to obtain the histograms of directional maps (HoDMs). The proposed HoDM descriptor was evaluated using three data sets composed of images obtained in both visible light and infrared spectra. The experimental results confirm that the proposed HoDM descriptor is robust to the nonlinear intensity changes of multispectral images and has a superior matching performance as well as a much higher computational efficiency.

Local region description of multi-sensor images remains a challenging task in remote sensing image analysis and applications due to the non-linear radiation variations between images. This paper presents a novel descriptor based on the combination of the magnitude and phase congruency information of local regions to capture the common features of images with non-linear radiation changes. We first propose oriented phase congruency maps (PCMs) and oriented magnitude binary maps (MBMs) using the multi-oriented phase congruency and magnitude information of log-Gabor filters. The two feature vectors are then quickly constructed based on the convolved PCMs and MBMs. Finally, a dense descriptor named the histograms of oriented magnitude and phase congruency (HOMPC) is developed by combining the histograms of oriented phase congruency (HPC) and the histograms of oriented magnitude (HOM) to capture the structure and shape properties of local regions. HOMPC was evaluated with three datasets composed of multi-sensor remote sensing images obtained from unmanned ground vehicle, unmanned aerial vehicle, and satellite platforms. The descriptor performance was evaluated by recall, precision, F1-measure, and area under the precision-recall curve. The experimental results showed the advantages of the HOM and HPC combination and confirmed that HOMPC is far superior to the current state-of-the-art local feature descriptors.

The quantitative retrieval of the chlorophyll-a concentration is an important remote sensing method that is used to monitor the nutritional status of water bodies. The high spatial resolution of the Sentinel-2 MSI and its subdivision in the red-edge band highlight the characteristics of water chlorophyll-a, which is an important detection tool for assessing water quality parameters in plateau lakes. In this study, the Nine Plateau Lakes in the Yunnan-Kweichow Plateau of China were selected as the study area. Using Sentinel-2 MSI transit images and in situ measured chlorophyll-a concentration as the data source, the chlorophyll-a concentrations of plateau lakes (CCAPLs) were investigated, and the surface temperatures of plateau lakes (STPLs) were retrieved to verify the hypothesis that the lake surface temperature could increase the chlorophyll-a concentration. By comparing feature importance using a random forest (RF), the Sentinel-2 MSI surface reflectance and in situ data were linearly fitted using four retrieval spectral indices with high feature importance, and the accuracy of the estimated concentration of chlorophyll-a was evaluated by monitoring station data in the same period. Then, Landsat-8 TIRS Band 10 data were used to retrieve the STPL with a single-channel temperature retrieval algorithm and to verify the correlation between the STPL and the CCAPL. The results showed that the retrievals of the CCAPL and the STPL were consistent with the actual situation. The root-mean-square error (RMSE) of the fifteenth normalized difference chlorophyll-a index (NDCI15) was 0.0249. When the CCAPL was greater than 0.05 mg/L and the STPL was within 28–34 °C, there was a positive linear correlation between the CCAPL and the STPL. These results will provide support for the remote sensing monitoring of eutrophication in plateau lakes and will contribute to the scientific and effective management of plateau lakes.

The matching problem for heterologous remote sensing images can be simplified to the matching problem for pseudo homologous remote sensing images via image translation to improve the matching performance. Among such applications, the translation of synthetic aperture radar (SAR) and optical images is the current focus of research. However, the existing methods for SAR-to-optical translation have two main drawbacks. First, single generators usually sacrifice either structure or texture features to balance the model performance and complexity, which often results in textural or structural distortion; second, due to large nonlinear radiation distortions (NRDs) in SAR images, there are still visual differences between the pseudo-optical images generated by current generative adversarial networks (GANs) and real optical images. Therefore, we propose a dual-generator translation network for fusing structure and texture features. On the one hand, the proposed network has dual generators, a texture generator, and a structure generator, with good cross-coupling to obtain high-accuracy structure and texture features; on the other hand, frequency-domain and spatial-domain loss functions are introduced to reduce the differences between pseudo-optical images and real optical images. Extensive quantitative and qualitative experiments show that our method achieves state-of-the-art performance on publicly available optical and SAR datasets. Our method improves the peak signal-to-noise ratio (PSNR) by 21.0%, the chromatic feature similarity (FSIMc) by 6.9%, and the structural similarity (SSIM) by 161.7% in terms of the average metric values on all test images compared with the next best results. In addition, we present a before-and-after translation comparison experiment to show that our method improves the average keypoint repeatability by approximately 111.7% and the matching accuracy by approximately 5.25%.

Spatiotemporal fusion in remote sensing plays an important role in Earth science applications by using information complementarity between different remote sensing data to improve image performance. However, several problems still exist, such as edge contour blurring and uneven pixels between the predicted image and the real ground image, in the extraction of salient features by convolutional neural networks (CNNs). We propose a spatiotemporal fusion method with edge-guided feature attention based on remote sensing, called STF-EGFA. First, an edge extraction module is used to maintain edge details, which effectively solves the boundary blurring problem. Second, a feature fusion attention module is used to make adaptive adjustments to the extracted features. Among them, the spatial attention mechanism is used to solve the problem of weight variation in different channels of the network. Additionally, the problem of uneven pixel distribution is addressed with a pixel attention (PA) mechanism to highlight the salient features. We transmit the different features extracted by the edge module and the encoder to the feature attention (FA) module at the same time after the union. Furthermore, the weights of edges, pixels, channels and other features are adaptively learned. Finally, three remote sensing spatiotemporal fusion datasets, Ar Horqin Banner (AHB), Daxing and Tianjin, are used to verify the method. Experiments proved that the proposed method outperformed three typical comparison methods in terms of the overall visual effect and five objective evaluation indexes: spectral angle mapper (SAM), peak signal-to-noise ratio (PSNR), spatial correlation coefficient (SCC), structural similarity (SSIM) and root mean square error (RMSE). Thus, the proposed spatiotemporal fusion algorithm is feasible for remote sensing analysis.

Building change detection plays an imperative role in urban construction and development. Although the deep neural network has achieved tremendous success in remote sensing image building change detection, it is still fraught with the problem of generating broken detection boundaries and separation of dense buildings, which tends to produce saw-tooth boundaries. In this work, we propose a feature decomposition-optimization-reorganization network for building change detection. The main contribution of the proposed network is that it performs change detection by respectively modeling the main body and edge features of buildings, which is based on the characteristics that the similarity between the main body pixels is strong but weak between the edge pixels. Firstly, we employ a siamese ResNet structure to extract dual-temporal multi-scale difference features on the original remote sensing images. Subsequently, a flow field is built to separate the main body and edge features. Thereafter, a feature optimization module is designed to refine the main body and edge features using the main body and edge ground truth. Finally, we reorganize the optimized main body and edge features to obtain the output results. These constitute a complete end-to-end building change detection framework. The publicly available building dataset LEVIR-CD is employed to evaluate the change detection performance of our network. The experimental results show that the proposed method can accurately identify the boundaries of changed buildings, and obtain better results compared with the current state-of-the-art methods based on the U-Net structure or by combining spatial-temporal attention mechanisms.