Fourier transform imaging spectrometers (FTISs) are widely used in global hyperspectral remote sensing due to the advantages of high stability, high throughput, and high spectral resolution. Spectrum reconstruction (SpecR) is a classic problem of FTISs determining the acquired data quality and application potential. However, the state-of-the-art SpecR algorithms were restricted by the length of maximum optical path difference (MOPD) of FTISs and apodization processing, resulting in a decrease in spectral resolution; thus, the applications of FTISs were limited. In this study, a deep learning SpecR method, which directly learned an end-to-end mapping between the interference/spectrum information with limited MOPD and without apodization processing, was proposed. The mapping was represented as a fully connected U-Net (FCUN) that takes the interference fringes as the input and outputs the highly precise spectral curves. We trained the proposed FCUN model using the real spectra and simulated pulse spectra, as well as the corresponding simulated interference curves, and achieved good results. Additionally, the performance of the proposed FCUN on real interference and spectral datasets was explored. The FCUN could obtain similar spectral values compared with the state-of-the-art fast Fourier transform (FFT)-based method with only 150 and 200 points in the interferograms. The proposed method could be able to enhance the resolution of the reconstructed spectra in the case of insufficient MOPD. Moreover, the FCUN performed well in visual quality using noisy interferograms and gained nearly 70% to 80% relative improvement over FFT for the coefficient of mean relative error (MRE). All the results based on simulated and real satellite datasets showed that the reconstructed spectra of the FCUN were more consistent with the ideal spectrum compared with that of the traditional method, with higher PSNR and lower values of spectral angle (SA) and relative spectral quadratic error (RQE).

Hyperspectral anomaly detection (HAD) is an important technique used to identify objects with spectral irregularity that can contribute to object-based image analysis. Latterly, significant attention has been given to HAD methods based on Autoencoders (AE). Nevertheless, due to a lack of prior information, transferring of modeling capacity, and the “curse of dimensionality”, AE-based detectors still have limited performance. To address the drawbacks, we propose a Multi-Prior Graph Autoencoder (MPGAE) with ranking-based band selection for HAD. There are three main components: the ranking-based band selection component, the adaptive salient weight component, and the graph autoencoder. First, the ranking-based band selection component removes redundant spectral channels by ranking the bands by employing piecewise-smooth first. Then, the adaptive salient weight component adjusts the reconstruction ability of the AE based on the salient prior, by calculating spectral-spatial features of the local context and the multivariate normal distribution of backgrounds. Finally, to preserve the geometric structure in the latent space, the graph autoencoder detects anomalies by obtaining reconstruction errors with a superpixel segmentation-based graph regularization. In particular, the loss function utilizes ${\ell }_{2,1}-\mathrm{norm}$ and adaptive salient weight to enhance the capacity of modeling anomaly patterns. Experimental results demonstrate that the proposed MPGAE effectively outperforms other state-of-the-art HAD detectors.

In the field of remote sens., change detection is an important monitoring technology. However, effectively extracting the change feature is still a challenge, especially with an unsupervised method. To solve this problem, we proposed an unsupervised transformer boundary autoencoder network (UTBANet) in this paper. UTBANet consists of a transformer structure and spectral attention in the encoder part. In addition to reconstructing hyperspectral images, UTBANet also adds a decoder branch for reconstructing edge information. The designed encoder module is used to extract features. First, the transformer structure is used for extracting the global features. Then, spectral attention can find important feature maps and reduce feature redundancy. Furthermore, UTBANet reconstructs the hyperspectral image and boundary information simultaneously through two decoders, which can improve the ability of the encoder to extract edge features. Our experiments demonstrate that the proposed structure significantly improves the performance of change detection. Moreover, comparative experiments show that our method is superior to most existing unsupervised methods.

The unmanned aerial vehicle (UAV)-borne hyperspectral imaging system has the advantages of high spatial resolution, flexible operation, under-cloud flying, and easy cooperation with ground synchronous tests. Because this platform often flies under clouds, variations in solar illumination lead to irradiance inconsistency between different rows of hyperspectral images (HSIs). This inconsistency causes errors in radiation correction. In addition, due to the accuracy limitations of the GPS/inertial measurement unit (IMU) and irregular changes in flight platform speed and attitude, HSIs have deformation and drift, which is harmful to the geometric correction and stitching accuracy between flight strips. Consequently, radiation and geometric error limit further applications of large-scale hyperspectral data. To address the above problems, we proposed an integrated solution to acquire and correct UAV-borne hyperspectral images that consist of illumination data acquisition, radiance and geometric correction, HSI, multispectral image (MSI) registration, and multi-strip stitching. We presented an improved three-parameter empirical model based on the illumination correction factor, and it showed that the accuracy of radiation correction considering illumination variation improved, especially in some low signal-to-noise ratio (SNR) bands. In addition, the error of large-scale HSI stitching was controlled within one pixel.

The Bidirectional Reflectance Distribution Function (BRDF) is a critical spatial distribution parameter in the quantitative research of remote sensing and has a wide range of applications in radiometric correction, elemental inversion, and surface feature estimation. As a new means of BRDF modeling, UAV push-broom hyperspectral imaging is limited by the push-broom imaging method, and the multi-angle information is often difficult to obtain. In addition, the random variation of solar illumination during UAV low-altitude flight makes the irradiance between different push-broom hyperspectral rows and different airstrips inconsistent, which significantly affects the radiometric consistency of BRDF modeling and results in the difficulty of accurately portraying the three-dimensional spatial reflectance distribution in the UAV model. These problems largely impede the application of outdoor BRDF. Based on this, this paper proposes a fast multi-angle information acquisition scheme with a high-accuracy BRDF modeling method considering illumination variations, which mainly involves a lightweight system for BRDF acquisition and three improved BRDF models considering illumination corrections. We adopt multi-rectangular nested flight paths for multi-gray level targets, use multi-mode equipment to acquire spatial illumination changes and multi-angle reflectivity information in real-time, and introduce the illumination correction factor K through data coupling to improve the kernel, Hapke, and RPV models, and, overall, the accuracy of the improved model is increased by 20.83%, 11.11%, and 31.48%, respectively. The results show that our proposed method can acquire multi-angle information quickly and accurately using push-broom hyperspectral imaging, and the improved model eliminates the negative effect of illumination on BRDF modeling. This work is vital for expanding the multi-angle information acquisition pathway and high-efficiency and high-precision outdoor BRDF modeling.

Multimodal fusion widely uses convolutional layers to capture local correlations and adjust feature dimensions. However, the progressive expansion of the receptive field in convolutional layers often compromises spatial context retention, leading to the loss of fine details. Furthermore, the fixed-size kernels typically used in standard convolution restrict the network’s ability to capture multiscale contextual details. To address this limitation, this paper develops a dilated transformation-guided unsupervised multimodal learning (DTUML) method to fuse a high-resolution multispectral image (HR-MSI) and a low-resolution hyperspectral image (LR-HSI), thereby generating a high-resolution hyperspectral image (HR-HSI). Our DTUML adopts a dual-stream encoder architecture to conduct multimodal data, where one stream focuses on preserving spectral information from LR-HSIs, while the other emphasizes the acquisition of spatial details from HR-MSIs. These complementary features are subsequently integrated to ensure spectral fidelity and retain spatial detail. Then, a convolutional layer restores dimensional consistency and outputs an HR-HSI. Extensive experiments demonstrate the effectiveness of DTUML, showing superior performance and strong competitiveness compared to state-of-the-art methods. Code: https://github.com/yuanchaosu/TGRS-DTUML.