Leonardo Galteri

Dr. Leonardo Galteri

Media Integration and Communication Center, University of Florence, 50134 Florence, Italy

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 January 2019 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
LSLorenzo Seidenari
Lorenzo Seidenari
Marco BertiniMarco Bertini
Marco Bertini
ABAlberto Del Bimbo
Alberto Del Bimbo
Image compression is a need that arises in many circumstances. Unfortunately, whenever a lossy compression algorithm is used, artifacts will manifest. Image artifacts, caused by compression tend to eliminate higher frequency details and in certain cases may add noise or small image structures. There are two main drawbacks of this phenomenon. First, images appear much less pleasant to the human eye. Second, computer vision algorithms such as object detectors may be hindered and their performance reduced. Removing such artifacts means recovering the original image from a perturbed version of it. This means that one ideally should invert the compression process through a complicated non-linear image transformation. We propose an image transformation approach based on a feed-forward fully convolutional residual network model. We show that this model can be optimized either traditionally, directly optimizing an image similarity loss (SSIM), or using a generative adversarial approach (GAN). Our GAN is able to produce images with more photorealistic details than SSIM based networks. We describe a novel training procedure based on sub-patches and devise a novel testing protocol to evaluate restored images quantitatively. We show that our approach can be used as a pre-processing step for different computer vision tasks in case images are degraded by compression to a point that state-of-the art algorithms fail. In this case, our GAN-based approach obtains better performance than MSE or SSIM trained networks. Differently from previously proposed approaches we are able to remove artifacts generated at any QF by inferring the image quality directly from data.

10 January 2017 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
LSLorenzo Seidenari
Lorenzo Seidenari
Marco BertiniMarco Bertini
Marco Bertini
ABAlberto Del Bimbo
Alberto Del Bimbo
Object detection is one of the most important tasks of computer vision. It is usually performed by evaluating a subset of the possible locations of an image, that are more likely to contain the object of interest. Exhaustive approaches have now been superseded by object proposal methods. The interplay of detectors and proposal algorithms has not been fully analyzed and exploited up to now, although this is a very relevant problem for object detection in video sequences. We propose to connect, in a closed-loop, detectors and object proposal generator functions exploiting the ordered and continuous nature of video sequences. Different from tracking we only require a previous frame to improve both proposal and detection: no prediction based on local motion is performed, thus avoiding tracking errors. We obtain three to four points of improvement in mAP and a detection time that is lower than Faster Regions with CNN features (R-CNN), which is the fastest Convolutional Neural Network (CNN) based generic object detector known at the moment.

5 April 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Open access
LALorenzo Agnolucci
Lorenzo Agnolucci
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
Marco BertiniMarco Bertini
Marco Bertini
ABAlberto Del Bimbo
Alberto Del Bimbo
In the latest years, videoconferencing has taken a fundamental role in interpersonal relations, both for personal and business purposes. Lossy video compression algorithms are the enabling technology for videoconferencing, as they reduce the bandwidth required for real-time video streaming. However, lossy video compression decreases the perceived visual quality. Thus, many techniques for reducing compression artifacts and improving video visual quality have been proposed in recent years. In this work, we propose a novel GAN-based method for compression artifacts reduction in videoconferencing. Given that, in this context, the speaker is typically in front of the camera and remains the same for the entire duration of the transmission, we can maintain a set of reference keyframes of the person from the higher-quality I-frames that are transmitted within the video stream and exploit them to guide the visual quality improvement; a novel aspect of this approach is the update policy that maintains and updates a compact and effective set of reference keyframes. First, we extract multi-scale features from the compressed and reference frames. Then, our architecture combines these features in a progressive manner according to facial landmarks. This allows the restoration of the high-frequency details lost after the video compression. Experiments show that the proposed approach improves visual quality and generates photo-realistic results even with high compression rates. Code and pre-trained networks are publicly available at https://github.com/LorenzoAgnolucci/Keyframes-GAN.

21 October 2023 in Pattern Recognition Letters
Verified
Journal Article
Open access
TFTomaso Fontanini
Tomaso Fontanini
Ferrari ClaudioFerrari Claudio
Ferrari Claudio
GLGiuseppe Lisanti
Giuseppe Lisanti
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
Stefano BerrettiStefano Berretti
Stefano Berretti
Andrea PratiAndrea Prati
Andrea Prati
In this paper, we propose FrankenMask, a novel framework that allows swapping and rearranging face parts in semantic masks for automatic editing of shape-related facial attributes. This is a novel yet challenging task as substituting face parts in a semantic mask requires to account for possible spatial misalignment and the adaptation of surrounding regions. We obtain such a feature by combining a Transformer encoder to learn the spatial relationships of facial parts, with an encoder–decoder architecture, which reconstructs a complete mask from the composition of local parts. Reconstruction and attribute classification results demonstrate the effective synthesis of facial images, while showing the generation of accurate and plausible facial attributes. Code is available at https://github.com/TFonta/FrankenMask_semantic.

15 October 2019
Verified
Conference Paper
Open access
FTFrancesco Turchini
Francesco Turchini
LSLorenzo Seidenari
Lorenzo Seidenari
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
AFAndrea Ferracani
Andrea Ferracani
GBGiuseppe Becchi
Giuseppe Becchi
ABAlberto Del Bimbo
Alberto Del Bimbo

30 June 2022 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
Leonardo GalteriLeonardo Galteri
Leonardo Galteri
LSLorenzo Seidenari
Lorenzo Seidenari
PBPietro Bongini
Pietro Bongini
Marco BertiniMarco Bertini
Marco Bertini
ABAlberto Del Bimbo
Alberto Del Bimbo
Image quality assessment is often performed with deep networks that are fine-tuned to regress a human provided quality score of a given image. Usually, this approach may lack generalization capabilities and, while being highly precise on similar image distribution, it may yield lower correlation on unseen distortions. In particular, they show poor performances, whereas images corrupted by noise, blur, or compression have been restored by generative models. As a matter of fact, evaluation of these generative models is often performed providing anecdotal results to the reader. In the case of image enhancement and restoration, reference images are usually available. Nevertheless, using signal based metrics often leads to counterintuitive results: Highly natural crisp images may obtain worse scores than blurry ones. However, blind reference image assessment may rank images reconstructed with GANs higher than the original undistorted images. To avoid time-consuming human-based image assessment, semantic computer vision tasks may be exploited instead. In this article, we advocate the use of language generation tasks to evaluate the quality of restored images. We refer to our assessment approach as LANguage-based Blind Image QUality Evaluation (LANBIQUE). We show experimentally that image captioning, used as a downstream task, may serve as a method to score image quality, independently of the distortion process that affects the data. Captioning scores are better aligned with human rankings with respect to classic signal based or No-reference image quality metrics. We show insights on how the corruption, by artefacts, of local image structure may steer image captions in the wrong direction.