Vivien Sainte Fare Garnot

Vivien Sainte Fare Garnot

Auto-generated profile, based on publicly available information

Vivien Sainte Fare Garnot

EcoVision Lab, DM3L, University of Zurich, Zürich, Switzerland

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 June 2020
Verified
Conference Paper
Closed access
VGVivien Sainte Fare Garnot
Vivien Sainte Fare Garnot
LLLoic Landrieu
Loic Landrieu
SGSebastien Giordano
Sebastien Giordano
NCNesrine Chehata
Nesrine Chehata
Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of agricultural parcels is an issue of major political and economic importance. In this regard, hybrid convolutional-recurrent neural architectures have shown promising results for the automated classification of satellite image time series. We propose an alternative approach in which the convolutional layers are advantageously replaced with encoders operating on unordered sets of pixels to exploit the typically coarse resolution of publicly available satellite images. We also propose to extract temporal features using a bespoke neural architecture based on self-attention instead of recurrent networks. We demonstrate experimentally that our method not only outperforms previous state-of-the-art approaches in terms of precision, but also significantly decreases processing time and memory requirements. Lastly, we release a large open-access annotated dataset as a benchmark for future work on satellite image time series.

1 July 2019
Verified
Conference Paper
Closed access
VGV. Sainte Fare Garnot
V. Sainte Fare Garnot
LLLoic Landrieu
Loic Landrieu
SGS. Giordano
S. Giordano
NCN. Chehata
N. Chehata
In this article, we investigate several structured deep learning models for crop type classification on multi-spectral time series. In particular, our aim is to assess the respective importance of spatial and temporal structures in such data. With this objective, we consider several designs of convolutional, recurrent, and hybrid neural networks, and assess their performance on a large dataset of freely available Sentinel-2 imagery. We find that the best-performing approaches are hybrid configurations for which most of the parameters (up to 90%) are allocated to modeling the temporal structure of the data. Our results thus constitute a set of guidelines for the design of bespoke deep learning models for crop type classification.

16 November 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Open access
CSCorinne Stucker
Corinne Stucker
VGVivien Sainte Fare Garnot
Vivien Sainte Fare Garnot
KSKonrad Schindler
Konrad Schindler
Satellite image time series in the optical and infrared spectrum suffer from frequent data gaps due to cloud cover, cloud shadows, and temporary sensor outages. It has been a long-standing problem of remote sensing research how to best reconstruct the missing pixel values and obtain complete, cloud-free image sequences. We approach that problem from the perspective of representation learning and develop U-TILISE, an efficient neural model that is able to implicitly capture spatio-temporal patterns of the spectral intensities, and that can therefore be trained to map a cloud-masked input sequence to a cloud-free output sequence. The model consists of a convolutional spatial encoder that maps each individual frame of the input sequence to a latent encoding; an attention-based temporal encoder that captures dependencies between those per-frame encodings and lets them exchange information along the time dimension; and a convolutional spatial decoder that decodes the latent embeddings back into multi-spectral images. We experimentally evaluate the proposed model on EarthNet2021, a dataset of Sentinel-2 time series acquired all over Europe, and demonstrate its superior ability to reconstruct the missing pixels. Compared to a standard interpolation baseline, it increases the PSNR by 1.8 dB at previously seen locations and by 1.3 dB at unseen locations.

14 February 2024 in BioMedInformatics
Verified
Journal Article
Open access
PDF file
AHAlae Eddine El hmimdi
Alae Eddine El hmimdi
ZKzoi kapoula
zoi kapoula
VGVivien Sainte Fare Garnot
Vivien Sainte Fare Garnot
Early detection of dyslexia and learning disorders is vital for avoiding a learning disability, as well as supporting dyslexic students by tailoring academic programs to their needs. Several studies have investigated using supervised algorithms to screen dyslexia vs. control subjects; however, the data size and the conditions of data acquisition were their most significant limitation. In the current study, we leverage a large dataset, containing 4243 time series of eye movement records from children across Europe. These datasets were derived from various tests such as saccade, vergence, and reading tasks. Furthermore, our methods were evaluated with realistic test data, including real-life biases such as noise, eye tracking misalignment, and similar pathologies among non-scholar difficulty classes. In addition, we present a novel convolutional neural network architecture, adapted to our time series classification problem, that is intended to generalize on a small annotated dataset and to handle a high-resolution signal (1024 point). Our architecture achieved a precision of 80.20% and a recall of 75.1%, when trained on the vergence dataset, and a precision of 77.2% and a recall of 77.5% when trained on the saccade dataset. Finally, we performed a comparison using our ML approach, a second architecture developed for a similar problem, and two other methods that we investigated that use deep learning algorithms to predict dyslexia.

3 August 2022 in Brain Sciences
Verified
Journal Article
Open access
PDF file
AHAlae Eddine El hmimdi
Alae Eddine El hmimdi
LWLindsey Ward
Lindsey Ward
TPThemis Palpanas
Themis Palpanas
VGVivien Sainte Fare Garnot
Vivien Sainte Fare Garnot
ZKzoi kapoula
zoi kapoula
It is known that dyslexics present eye movement abnormalities. Previously, we have shown that eye movement abnormalities during reading or during saccade and vergence testing can predict dyslexia successfully. The current study further examines this issue focusing on eye movements during free exploration of paintings; the dataset was provided by a study in our laboratory carried by Ward and Kapoula. Machine learning (ML) classifiers were applied to eye movement features extracted by the software AIDEAL: a velocity threshold analysis reporting amplitude speed and disconjugacy of horizontal saccades. In addition, a new feature was introduced that concerns only the very short periods during which the eyes were moving, one to the left the other to the right; such periods occurred mostly during fixations between saccades; we calculated a global index of the frequency of such disconjugacy segments, of their duration and their amplitude. Such continuous evaluation of disconjugacy throughout the time series of eye movements differs from the disconjugacy feature that describes inequality of the saccade amplitude between the two eyes. The results show that both AIDEAL features, and the Disconjugacy Global Index (DGI) enable successful categorization of dyslexics from non-dyslexics, at least when applying this analysis to the specific paintings used in the present study. We suggest that this high power of predictability arises from both the content of the paintings selected and the physiologic relevance of eye movement features extracted by the AIDEAL and the DGI.

5 December 2023 in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Verified
Journal Article
Open access
PDF file
KKK. Karaman
K. Karaman
VGV. Sainte Fare Garnot
V. Sainte Fare Garnot
JWJan Dirk Wegner
Jan Dirk Wegner
Deforestation has a significant impact on the environment, accelerating global warming and causing irreversible damage to ecosystems. Large-scale deforestation monitoring techniques still mostly rely on statistical approaches and traditional machine learning models applied to multi-spectral, optical satellite imagery and meta-data like land cover maps. However, clouds often obstruct observations of land in optical satellite imagery, especially in the tropics, which limits their effectiveness. Moreover, statistical approaches and traditional machine learning methods may not capture the wide range of underlying distributions in deforestation data due to limited model capacity. To overcome these drawbacks, we apply an attention-based neural network architecture that learns to detect deforestation end-to-end from time series of synthetic aperture radar (SAR) images. Sentinel-1 C-Band SAR data are mostly independent of the weather conditions and our trained neural network model generalizes across a wide range of deforestation patterns of Amazon forests. We curate a new dataset, called BraDD-S1TS, comprising approximately 25,000 image sequences for deforested and unchanged land throughout the Brazilian Amazon. We experimentally evaluate our method on this dataset and compare it to state-of-the-art approaches. We find it outperforms still-in-use methods by 13.7 percentage points in intersection over union (IoU). We make BraDD-S1TS publicly available along with this publication to serve as a novel testbed for comparing different deforestation detection methods in future studies.