Benchmarking deep learning algorithms before deploying them in hardware-constrained execution environments, such as imaging satellites, is pivotal in real-life applications. Although a thorough and consistent benchmarking procedure can allow us to estimate the expected operational abilities of the underlying deep model, this topic remains under-researched. This paper tackles this issue and presents an end-to-end benchmarking approach for quantifying the abilities of deep learning algorithms in virtually any kind of on-board space applications. The experimental validation, performed over several state-of-the-art deep models and benchmark datasets, showed that different deep learning techniques may be effectively benchmarked using the standardized approach, which delivers quantifiable performance measures and is highly configurable. We believe that such benchmarking is crucial in delivering ready-to-use on-board artificial intelligence in emerging space applications and should become a standard tool in the deployment chain.
21 January 2024 in Engineering Applications of Artificial Intelligence
Hyperspectral imagery provides rich spectral information, but commonly suffers from low spatial resolution. This problem can be addressed with hyperspectral pansharpening which benefits from a high-resolution panchromatic image to enhance the resolution of spectral bands. Another possibility of improving spatial resolution, commonly exploited for remotely-sensed images, benefits from multitemporal fusion of images acquired at different revisits of a satellite. However, such a process, termed multi-image super-resolution, has not been applied to hyperspectral imagery due to the excessive size of hyperspectral cubes. In this paper, we propose a new processing pipeline that combines these two approaches. A multitemporal series of panchromatic images is super-resolved to reconstruct a high-resolution panchromatic image which is subsequently used during pansharpening. We demonstrate the benefits of the proposed pipeline for PRISMA imagery, whose hyperspectral cubes (30 m ground sampling distance) are associated with panchromatic images (5 m ground sampling distance). The latter are upsampled by a factor of 3× relying on multi-image super-resolution, which allows our pansharpening to achieve the upsampling ratio of 18${\times }$ for PRISMA images. We report and discuss the results of our extensive experiments which indicate that the proposed approach offers substantial quantitative and qualitative improvement, confirmed by a mean opinion score survey.
15 October 2025 in Annals of Computer Science and Information Systems
Assessing the quality of super-resolved images is important for comparing reconstruction algorithms, but pixel fidelity, perceptual appearance, and structural preservation do not always agree. We investigate whether keypoint detector response maps and detected keypoints can act as trainable structural indicators for aligned full-reference super-resolution image quality assessment (SR-IQA). A contrastive Multi-Scale Index Proposal (MSIP) objective specializes Key.Net toward SR-like resolution loss, candidate checkpoints are screened without subjective labels, and six response- and keypoint-based measures are evaluated on four subjective benchmarks. The results show a redistribution rather than a uniform improvement: MSIP correlations increase on three of the four benchmarks, both repeatability variants decrease for every trained family on SISAR and RealSRQ, and general keypoint performance on HPatches decreases for trained checkpoints. At the benchmark level, established comparators such as TOPIQ-FR, RQI, and DISQ remain stronger, and on three of the four datasets the best keypoint-based result is still obtained with the pretrained detector. The measures nevertheless retain quality-related variation after conditioning on ten IQA controls in 88 of 120 tested hypotheses, with markedly weaker evidence on RealSRQ. Their practical value is therefore diagnostic: the response maps localize the structures behind an HR–SR discrepancy, complementing rather than replacing established SR-IQA metrics.