Matteo Ciotola

Dr. Matteo Ciotola

University of Naples Federico II, Naples, Campania, Italy
orcid
Assistant Professor at University Federico II

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 March 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
MCMatteo Ciotola
Matteo Ciotola
SVSergio Vitale
Sergio Vitale
AMAntonio Mazza
Antonio Mazza
Giovanni PoggiGiovanni Poggi
Giovanni Poggi
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
In recent years, there has been a growing interest in deep learning-based pansharpening. Thus far, research has mainly focused on architectures. Nonetheless, model training is an equally important issue. A first problem is the absence of ground truths, unavoidable in pansharpening. This is often addressed by training networks in a reduced resolution domain and using the original data as ground truth, relying on an implicit scale invariance assumption. However, on full resolution images results are often disappointing, suggesting such invariance not to hold. A further problem is the scarcity of training data, which causes a limited generalization ability and a poor performance on off-training test images. In this paper, we propose a full-resolution training framework for deep learning-based pansharpening. The framework is fully general and can be used for any deep learning-based pansharpening model. Training takes place in the high-resolution domain, relying only on the original data, thus avoiding any loss of information. To ensure spectral and spatial fidelity, a suitable two-component loss is defined. The spectral component enforces consistency between the pansharpened output and the low-resolution multispectral input. The spatial component, computed at high-resolution, maximizes the local correlation between each pansharpened band and the panchromatic input. At testing time, the target-adaptive operating modality is adopted, achieving good generalization with a limited computational overhead. Experiments carried out on WorldView-3, WorldView-2, and GeoEye-1 images show that methods trained with the proposed framework guarantee a pretty good performance in terms of both full-resolution numerical indexes and visual quality.

17 December 2024 in IEEE Geoscience and Remote Sensing Magazine
Verified
Journal Article
Closed access
MCMatteo Ciotola
Matteo Ciotola
GGGiuseppe Guarino
Giuseppe Guarino
Gemine VivoneGemine Vivone
Gemine Vivone
Giovanni PoggiGiovanni Poggi
Giovanni Poggi
Jocelyn  ChanussotJocelyn Chanussot
Jocelyn Chanussot
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
Hyperspectral (HS) pansharpening consists of fusing a high-resolution panchromatic (PAN) band and a low-resolution HS image to obtain a new image with high resolution in both the spatial and spectral domains. These remote sensing products are valuable for a wide range of applications, driving ever-growing research efforts. Nonetheless, results still do not meet application demands. In part, this comes from the technical complexity of the task: compared to multispectral (MS) pansharpening, many more bands are involved, in a spectral range only partially covered by the PAN component and with overwhelming noise. However, another major limiting factor is the absence of a comprehensive framework for the rapid development and accurate evaluation of new methods. This article attempts to address this issue. We started by designing a dataset large and diverse enough to allow reliable training (for data-driven methods) and testing of new methods. Then, we selected a set of state-of-the-art (SoTA) methods, following different approaches characterized by promising performance, and reimplemented them in a single PyTorch framework. Finally, we carried out a critical comparative analysis of all methods, using the most accredited quality indicators. The analysis highlights the main limitations of current solutions in terms of spectral/spatial quality and computational efficiency, and it suggests promising research directions. To ensure full reproducibility of the results and support future research, the framework (comprising methods and assessment codes and dataset setup procedures) is shared on https://github.com/matciotola/hyperspectral_pansharpening_toolbox , as a single Python-based reference benchmark toolbox.

8 April 2022 in Remote Sensing
Verified
Journal Article
Open access
PDF file
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
MCMatteo Ciotola
Matteo Ciotola
A reliable quality assessment procedure for pansharpening methods is of critical importance for the development of the related solutions. Unfortunately, the lack of ground truths to be used as guidance for an objective evaluation has pushed the community to resort to two approaches, which can also be jointly applied. Hence, two kinds of indexes can be found in the literature: (i) reference-based reduced-resolution indexes aimed to assess the synthesis ability; (ii) no-reference subjective quality indexes for full-resolution datasets aimed to assess spectral and spatial consistency. Both reference-based and no-reference indexes present critical shortcomings, which motivate the community to explore new solutions. In this work, we propose an alternative no-reference full-resolution assessment framework. On one side, we introduce a protocol, namely the reprojection protocol, to take care of the spectral consistency issue. On the other side, a new index of the spatial consistency between the pansharpened image and the panchromatic band at full resolution is also proposed. Experimental results carried out on different datasets/sensors demonstrate the effectiveness of the proposed approach.

1 August 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Open access
MCMatteo Ciotola
Matteo Ciotola
Giovanni PoggiGiovanni Poggi
Giovanni Poggi
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
In latest years, deep learning has gained a leading role in the pansharpening of multiresolution images. Given the lack of ground truth data, most deep learning-based methods carry out supervised training in a reduced-resolution domain. However, models trained on downsized images tend to perform poorly on high-resolution target images. For this reason, several research groups are now turning to unsupervised training in the full-resolution domain, through the definition of appropriate loss functions and training paradigms. In this context, we have recently proposed a full-resolution training framework which can be applied to many existing architectures. Here, we propose a new deep learning-based pansharpening model that fully exploits the potential of this approach and provides cutting-edge performance. Besides architectural improvements with respect to previous work, such as the use of residual attention modules, the proposed model features a novel loss function that jointly promotes the spectral and spatial quality of the pansharpened data. In addition, thanks to a new fine-tuning strategy, it improves inference-time adaptation to target images. Experiments on a large variety of test images, performed in challenging scenarios, demonstrate that the proposed method compares favorably with the state of the art both in terms of numerical results and visual output. Code is available online at https://github.com/matciotola/Lambda-PNN.

4 December 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Open access
GGGiuseppe Guarino
Giuseppe Guarino
MCMatteo Ciotola
Matteo Ciotola
Gemine VivoneGemine Vivone
Gemine Vivone
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
Hyperspectral (HS) pansharpening has received a growing interest in the last few years as testified by a large number of research papers and challenges. It consists in a pixel-level fusion between a lower resolution HS datacube and a higher resolution single-band image, the panchromatic (PAN) image, with the goal of providing an HS datacube at PAN resolution. Due to their powerful representational capabilities, deep learning models have succeeded to provide unprecedented results on many general-purpose image processing tasks. However, when moving to domain-specific problems, as in this case, the advantages with respect to traditional model-based approaches are much lesser clear-cut due to several contextual reasons. Scarcity of training data, lack of ground truth (GT), and data shape variability are some such factors that limit the generalization capacity of the state-of-the-art deep learning networks for HS pansharpening. To cope with these limitations, in this work, we propose a new deep learning method, which inherits a simple single-band unsupervised pansharpening model nested in a sequential band-wise adaptive scheme, where each band is pansharpened refining the model tuned on the preceding one. By doing so, a simple model is propagated along the wavelength dimension, adaptively and flexibly, with no need to have a fixed number of spectral bands, and, with no need to dispose of large, expensive, and labeled training datasets. The proposed method achieves very good results on our datasets, outperforming both traditional and deep learning reference methods. The implementation of the proposed method can be found at https://github.com/giu-guarino/R-PNN .

20 October 2023 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
GGGiuseppe Guarino
Giuseppe Guarino
MCMatteo Ciotola
Matteo Ciotola
Gemine VivoneGemine Vivone
Gemine Vivone
Giovanni PoggiGiovanni Poggi
Giovanni Poggi
Giuseppe ScarpaGiuseppe Scarpa
Giuseppe Scarpa
This work proposes a simple yet effective method to adapt unsupervised convolutional neural networks from multispectral to hyperspectral pansharpening. Thus, it focuses on the fusion of a single high-resolution panchromatic band with a low-resolution hyperspectral data cube. This is achieved by means of a decorrelation transform, following the principal component analysis approach, which enables the compression of a significant portion of the hyperspectral image energy into a few bands. Afterwards, a suitably adapted pansharpening network designed for four spectral bands is used to super-resolve only the principal components. Experiments demonstrate high performance in both quantitative and qualitative evaluations, favorably comparing against state-of-the-art methods.