18 December 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Hyperspectral (HS) pansharpening refers to fusing low spatial resolution HS (LRHS) images with the corresponding panchromatic (PAN) images to create high spatial resolution HS (HRHS) images. Most of existing HS pansharpening methods overlook the spatial and spectral imbalance of the ground objects of different types in the observed scenes. To address the dilemma, in this paper we develop a novel tree-structured neural network (Tree-SNet) to form an adaptive spatial-spectral processing for HS pansharpening. The Tree-SNet method maps a CNN onto a hierarchical tree structure, where routing nodes automatically tune the data distributed to tree paths, which is adaptive to the local characteristic of data, while spatial enhancement (SpatE) and spectral enhancement (SpecE) modules are dynamically performed in the tree paths to further strengthen the adaptive processing. The proposed Tree-SNet is evaluated on several datasets, and the experimental results verify its superiority.
14 July 2025 in IEEE Transactions on Geoscience and Remote Sensing
Arbitrary-resolution hyperspectral (ARHS) pansharpening seeks to enhance hyperspectral (HS) images to any desired spatial resolutions by integrating HS images with their connected panchromatic (PAN) images, which is obviously different from standard HS pansharpening where HS data are merely pansharpened to the spatial resolutions of PANs. Therefore, ARHS pansharpening has a great potential to broaden the applications of traditional pansharpening technique. However, ARHS pansharpening is faced with some inherent obstacles, including how to produce HS images with arbitrary resolutions beyond the training scales and how to maintain high spatial-spectral fidelities at any pansharpening scales. Implicit neural representations (INRs) is able to parametrically tune neural networks to accommodate unanalytical continuous characteristics of real-world scenes, and thus offer natural representations for ARHS pansharpening. The core of pansharpening INR design is to construct suitable implicit spectral-spatial functions (ISSFs). In this work, we propose two innovatively novel transformer-ensemble based ISSFs, i.e. pre-integrated ISSF (preISSF) and post-integrated ISSF (postISSF), which use suitable coordinate operation, novel ensemble feature extraction and coordinate query mapping to build strong spectral-spatial reconstruction capabilities, where some new tactics such as mode-1 transformer decomposition and explicit-implicit positional encoding system are involved. We test our preISSF and postISSF on three datasets. The experimental results verify the excellent performance of our methods.