Valentin Gabeff

Valentin Gabeff


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2021 in Artificial Intelligence in Medicine
Verified
Journal Article
Open access
VGValentin Gabeff
Valentin Gabeff
TTTomás Teijeiro
Tomás Teijeiro
MZMarina Zapater
Marina Zapater
LCLeila Cammoun
Leila Cammoun
SRSylvain Rheims
Sylvain Rheims
David AtienzaDavid Atienza
David Atienza
While Deep Learning (DL) is often considered the state-of-the art for Artificial Intel-ligence-based medical decision support, it remains sparsely implemented in clinical practice and poorly trusted by clinicians due to insufficient interpretability of neural network models. We have approached this issue in the context of online detection of epileptic seizures by developing a DL model from EEG signals, and associating certain properties of the model behavior with the expert medical knowledge. This has conditioned the preparation of the input signals, the network architecture, and the post-processing of the output in line with the domain knowledge. Specifically, we focused the discussion on three main aspects: (1) how to aggregate the classification results on signal segments provided by the DL model into a larger time scale, at the seizure-level; (2) what are the relevant frequency patterns learned in the first convolutional layer of different models, and their relation with the delta, theta, alpha, beta and gamma frequency bands on which the visual interpretation of EEG is based; and (3) the identification of the signal waveforms with larger contribution towards the ictal class, according to the activation differences highlighted using the DeepLIFT method. Results show that the kernel size in the first layer determines the interpretability of the extracted features and the sensitivity of the trained models, even though the final performance is very similar after post-processing. Also, we found that amplitude is the main feature leading to an ictal prediction, suggesting that a larger patient population would be required to learn more complex frequency patterns. Still, our methodology was successfully able to generalize patient inter-variability for the majority of the studied population with a classification F1-score of 0.873 and detecting 90% of the seizures.

24 April 2024 in International Journal of Computer Vision
Verified
Journal Article
Open access
PDF file
VGValentin Gabeff
Valentin Gabeff
MRMarc Rußwurm
Marc Rußwurm
DTDevis Tuia
Devis Tuia
AMAlexander Mathis
Alexander Mathis
Wildlife observation with camera traps has great potential for ethology and ecology, as it gathers data non-invasively in an automated way. However, camera traps produce large amounts of uncurated data, which is time-consuming to annotate. Existing methods to label these data automatically commonly use a fixed pre-defined set of distinctive classes and require many labeled examples per class to be trained. Moreover, the attributes of interest are sometimes rare and difficult to find in large data collections. Large pretrained vision-language models, such as contrastive language image pretraining (CLIP), offer great promises to facilitate the annotation process of camera-trap data. Images can be described with greater detail, the set of classes is not fixed and can be extensible on demand and pretrained models can help to retrieve rare samples. In this work, we explore the potential of CLIP to retrieve images according to environmental and ecological attributes. We create WildCLIP by fine-tuning CLIP on wildlife camera-trap images and to further increase its flexibility, we add an adapter module to better expand to novel attributes in a few-shot manner. We quantify WildCLIP’s performance and show that it can retrieve novel attributes in the Snapshot Serengeti dataset. Our findings outline new opportunities to facilitate annotation processes with complex and multi-attribute captions. The code is available at https://github.com/amathislab/wildclip.

18 March 2022 in Epidemiologia
Verified
Journal Article
Open access
PDF file
ABAlicia Blair
Alicia Blair
MPMattia de Pasquale
Mattia de Pasquale
VGValentin Gabeff
Valentin Gabeff
MRMélanie Rufi
Mélanie Rufi
Antoine FlahaultAntoine Flahault
Antoine Flahault
New Zealand has long been praised for the effectiveness of its COVID-19 elimination strategy. It resulted in fewer COVID-19-related deaths, better economic recovery, and less stringent policy measures within its borders compared with other OECD countries, which opted for mitigation or suppression. However, since September 2021, the rising number of infections has not been contained anymore by the contact tracing and self-isolation system in place and the government has shifted towards a policy strategy similar to suppression to manage the crisis. In this case study, we analyse the factors that led the government to switch policy and discuss why elimination became unsustainable to manage the COVID-19 epidemic in New Zealand. Results showed that the socioeconomic and political factors, along with the appearance of new variants and a delayed vaccination program, were accountable for the switch in strategy. This switch allows the country to better adapt to the evolving nature of the disease and to address the social and economic repercussions of the first year of measures. Our conclusion does not disregard elimination as an appropriate initial strategy to contain this pandemic in the absence of a vaccine or treatment, but rather suggests that borders cannot remain closed for long periods of time without creating social, economical, and political issues.

23 December 2023 in bioRxiv
Verified
Preprint
Open access
PDF file
VGValentin Gabeff
Valentin Gabeff
MRMarc Rußwurm
Marc Rußwurm
DTDevis Tuia
Devis Tuia
AMAlexander Mathis
Alexander Mathis
Wildlife observation with camera traps has great potential for ethology and ecology, as it gathers data non-invasively in an automated way. However, camera traps produce large amounts of uncurated data, which is time-consuming to annotate. Existing methods to label these data automatically commonly use a fixed pre-defined set of distinctive classes and require many labeled examples per class to be trained. Moreover, the attributes of interest are sometimes rare and difficult to find in large data collections. Large pretrained vision-language models, such as Contrastive Language Image Pretraining (CLIP), offer great promises to facilitate the annotation process of camera-trap data. Images can be described with greater detail, the set of classes is not fixed and can be extensible on demand and pretrained models can help to retrieve rare samples. In this work, we explore the potential of CLIP to retrieve images according to environmental and ecological attributes. We create WildCLIP by fine-tuning CLIP on wildlife camera-trap images and to further increase its flexibility, we add an adapter module to better expand to novel attributes in a few-shot manner. We quantify WildCLIP’s performance and show that it can retrieve novel attributes in the Snapshot Serengeti dataset. Our findings outline new opportunities to facilitate annotation processes with complex and multi-attribute captions. The code will be made available at https://github.com/amathislab/wildclip .