Herve Le Borgne

Dr. Herve Le Borgne


Research Focus & Metrics

Academic Career Length

17Years (2010-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 April 2020
Verified
Book Chapter
Closed access
PDF file
OAOmar Adjali
Omar Adjali
RBRomaric Besançon
Romaric Besançon
OFOlivier Ferret
Olivier Ferret
HBHerve Le Borgne
Herve Le Borgne
BGBrigitte Grau
Brigitte Grau

30 April 2019 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YTYoussef Tamaazousti
Youssef Tamaazousti
HBHerve Le Borgne
Herve Le Borgne
CHCeline Hudelot
Celine Hudelot
MSMohamed-El-Amine Seddik
Mohamed-El-Amine Seddik
MTMohamed Tamaazousti
Mohamed Tamaazousti
A representation is supposed universal if it encodes any element of the visual world (e.g., objects, scenes) in any configuration (e.g., scale, context). While not expecting pure universal representations, the goal in the literature is to improve the universality level, starting from a representation with a certain level. To improve that universality level, one can diversify the source-task, but it requires many additive annotated data that is costly in terms of manual work and possible expertise. We formalize such a diversification process then propose two methods to improve the universality of CNN representations that limit the need for additive annotated data. The first relies on human categorization knowledge and the second on re-training using fine-tuning. We propose a new aggregating metric to evaluate the universality in a transfer-learning scheme, that addresses more aspects than previous works. Based on it, we show the interest of our methods on 10 target-problems, relating to classification on a variety of visual domains.

12 June 2023
Verified
Conference Paper
Open access
OAOmar Adjali
Omar Adjali
PGPaul Grimal
Paul Grimal
OFOlivier Ferret
Olivier Ferret
SGSahar Ghannay
Sahar Ghannay
HBHerve Le Borgne
Herve Le Borgne
Recent years have shown unprecedented growth of interest in Vision-Language related tasks, with the need to address the inherent challenges of integrating linguistic and visual information to solve real-world applications. Such a typical task is Visual Question Answering (VQA), which aims to answer questions about visual content. The limitations of the VQA task in terms of question redundancy and poor linguistic variability encouraged researchers to propose Knowledge-aware Visual Question Answering tasks as a natural extension of VQA. In this paper, we tackle the KVQAE (Knowledge-based Visual Question Answering about named Entities) task, which proposes to answer questions about named entities defined in a knowledge base and grounded in visual content. In particular, besides the textual and visual information, we propose to leverage the structural information extracted from syntactic dependency trees and external knowledge graphs to help answer questions about a large spectrum of entities of various types. Thus, by combining contextual and graph-based representations using Graph Convolutional Networks (GCNs), we are able to learn meaningful embeddings for Information Retrieval tasks. Experiments on the ViQuAE public dataset show how our approach improves the state-of-the-art baselines while demonstrating the interest of injecting external knowledge to enhance multimodal information retrieval.

3 January 2024
Verified
Conference Paper
Open access
PDPerla Doubinsky
Perla Doubinsky
NANicolas Audebert
Nicolas Audebert
MCMichel Crucianu
Michel Crucianu
HBHerve Le Borgne
Herve Le Borgne
With the availability of powerful text-to-image diffusion models, recent works have explored the use of synthetic data to improve image classification performances. These works show that it can effectively augment or even replace real data. In this work, we investigate how synthetic data can benefit few-shot class-agnostic counting. This requires to generate images that correspond to a given input number of objects. However, text-to-image models struggle to grasp the notion of count. We propose to rely on a double conditioning of Stable Diffusion with both a prompt and a density map in order to augment a training dataset for few-shot counting. Due to the small dataset size, the fine-tuned model tends to generate images close to the training images. We propose to enhance the diversity of synthesized images by exchanging captions between images thus creating unseen configurations of object types and spatial layout. Our experiments show that our diversified generation strategy significantly improves the counting accuracy of two recent and performing few-shot counting models on FSC147 and CARPK.

4 September 2014 in Journal of Real-Time Image Processing
Verified
Journal Article
Closed access
PDF file
EGEtienne Gadeski
Etienne Gadeski
HFHamidreza Odabai Fard
Hamidreza Odabai Fard
HBHerve Le Borgne
Herve Le Borgne

24 February 2012
Verified
Book Chapter
Closed access
PDF file
YCYannick Le Cacheux
Yannick Le Cacheux
HBHerve Le Borgne
Herve Le Borgne
MCMichel Crucianu
Michel Crucianu