Thomas Pierrot

Thomas Pierrot

Auto-generated profile, based on publicly available information

Thomas Pierrot

InstaDeep

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 November 2024 in Nature Methods
Verified
Journal Article
Open access
PDF file
HDHugo Dalla-Torre
Hugo Dalla-Torre
LGLiam Gonzalez
Liam Gonzalez
JMJavier Mendoza-Revilla
Javier Mendoza-Revilla
NCNicolas Lopez Carranza
Nicolas Lopez Carranza
AGAdam Henryk Grzywaczewski
Adam Henryk Grzywaczewski
TPThomas Pierrot
Thomas Pierrot
The prediction of molecular phenotypes from DNA sequences remains a longstanding challenge in genomics, often driven by limited annotated data and the inability to transfer learnings between tasks. Here, we present an extensive study of foundation models pre-trained on DNA sequences, named Nucleotide Transformer, ranging from 50 million up to 2.5 billion parameters and integrating information from 3,202 human genomes and 850 genomes from diverse species. These transformer models yield context-specific representations of nucleotide sequences, which allow for accurate predictions even in low-data settings. We show that the developed models can be fine-tuned at low cost to solve a variety of genomics applications. Despite no supervision, the models learned to focus attention on key genomic elements and can be used to improve the prioritization of genetic variants. The training and application of foundational models in genomics provides a widely applicable approach for accurate molecular phenotype prediction from DNA sequence.

15 January 2023 in bioRxiv
Verified
Preprint
Open access
PDF file
HDHugo Dalla-Torre
Hugo Dalla-Torre
LGLiam Gonzalez
Liam Gonzalez
JRJavier Mendoza Revilla
Javier Mendoza Revilla
NCNicolas Lopez Carranza
Nicolas Lopez Carranza
AGAdam Henryk Grywaczewski
Adam Henryk Grywaczewski
TPThomas Pierrot
Thomas Pierrot
Closing the gap between measurable genetic information and observable traits is a longstanding challenge in genomics. Yet, the prediction of molecular phenotypes from DNA sequences alone remains limited and inaccurate, often driven by the scarcity of annotated data and the inability to transfer learnings between prediction tasks. Here, we present an extensive study of foundation models pre-trained on DNA sequences, named the Nucleotide Transformer, ranging from 50M up to 2.5B parameters and integrating information from 3,202 diverse human genomes, as well as 850 genomes selected across diverse phyla, including both model and non-model organisms. These transformer models yield transferable, context-specific representations of nucleotide sequences, which allow for accurate molecular phenotype prediction even in low-data settings. We show that the developed models can be fine-tuned at low cost and despite low available data regime to solve a variety of genomics applications. Despite no supervision, the transformer models learned to focus attention on key genomic elements, including those that regulate gene expression, such as enhancers. Lastly, we demonstrate that utilizing model representations can improve the prioritization of functional genetic variants. The training and application of foundational models in genomics explored in this study provide a widely applicable stepping stone to bridge the gap of accurate molecular phenotype prediction from DNA sequence. Code and weights available at: https://github.com/instadeepai/nucleotide-transformer in Jax and https://huggingface.co/InstaDeepAI in Pytorch. Example notebooks to apply these models to any downstream task are available on https://huggingface.co/docs/transformers/notebooks#pytorch-bio.

9 July 2024 in Communications Biology
Verified
Journal Article
Open access
PDF file
JMJavier Mendoza-Revilla
Javier Mendoza-Revilla
ETEvan Trop
Evan Trop
LGLiam Gonzalez
Liam Gonzalez
MRMaša Roller
Maša Roller
HDHugo Dalla-Torre
Hugo Dalla-Torre
MLMarie Lopez
Marie Lopez
Significant progress has been made in the field of plant genomics, as demonstrated by the increased use of high-throughput methodologies that enable the characterization of multiple genome-wide molecular phenotypes. These findings have provided valuable insights into plant traits and their underlying genetic mechanisms, particularly in model plant species. Nonetheless, effectively leveraging them to make accurate predictions represents a critical step in crop genomic improvement. We present AgroNT, a foundational large language model trained on genomes from 48 plant species with a predominant focus on crop species. We show that AgroNT can obtain state-of-the-art predictions for regulatory annotations, promoter/terminator strength, tissue-specific gene expression, and prioritize functional variants. We conduct a large-scale in silico saturation mutagenesis analysis on cassava to evaluate the regulatory impact of over 10 million mutations and provide their predicted effects as a resource for variant characterization. Finally, we propose the use of the diverse datasets compiled here as the Plants Genomic Benchmark (PGB), providing a comprehensive benchmark for deep learning-based methods in plant genomic research. The pre-trained AgroNT model is publicly available on HuggingFace at https://huggingface.co/InstaDeepAI/agro-nucleotide-transformer-1b for future research purposes.

6 June 2025 in Nature Machine Intelligence
Verified
Journal Article
Open access
PDF file
BABernardo P. de Almeida
Bernardo P. de Almeida
GRGuillaume Richard
Guillaume Richard
HDHugo Dalla-Torre
Hugo Dalla-Torre
CBChristopher Blum
Christopher Blum
LHLorenz Hexemer
Lorenz Hexemer
TPThomas Pierrot
Thomas Pierrot
Language models are thriving, powering conversational agents that assist and empower humans to solve a number of tasks. Recently, these models were extended to support additional modalities including vision, audio and video, demonstrating impressive capabilities across multiple domains, including healthcare. Still, conversational agents remain limited in biology as they cannot yet fully comprehend biological sequences. Meanwhile, high-performance foundation models for biological sequences have been built through self-supervision over sequencing data, but these need to be fine-tuned for each specific application, preventing generalization between tasks. In addition, these models are not conversational, which limits their utility to users with coding capabilities. Here we propose to bridge the gap between biology foundation models and conversational agents by introducing ChatNT, a multimodal conversational agent with an advanced understanding of biological sequences. ChatNT achieves new state-of-the-art results on the Nucleotide Transformer benchmark while being able to solve all tasks at once, in English, and to generalize to unseen questions. In addition, we have curated a set of more biologically relevant instruction tasks from DNA, RNA and proteins, spanning multiple species, tissues and biological processes. ChatNT reaches performance on par with state-of-the-art specialized methods on those tasks. We also present a perplexity-based technique to help calibrate the confidence of our model predictions. By applying attribution methods through the English decoder and DNA encoder, we demonstrate that ChatNT’s answers are based on biologically coherent features such as detecting the promoter TATA motif or splice site dinucleotides. Our framework for genomics instruction tuning can be extended to more tasks and data modalities (for example, structure and imaging), making it a widely applicable tool for biology. ChatNT provides a potential direction for building generally capable agents that understand biology from first principles while being accessible to users with no coding background.

25 December 2025 in bioRxiv
Verified
Preprint
Open access
SBSam Boshar
Sam Boshar
BEBenjamin Evans
Benjamin Evans
ZTZiqi Tang
Ziqi Tang
YAYanis Adel
Yanis Adel
YBYohan Bornachot
Yohan Bornachot
TPThomas Pierrot
Thomas Pierrot
Comparative genomics and synthetic biology require models that can interpret, annotate, and design DNA sequences across species, yet genomic models have not combined these capabilities beyond a few well-characterized organisms. Here we introduce Nucleotide Transformer v3 (NTv3), a long-context cross-kingdom foundation model that provides a common backbone for functional prediction, gene annotation and controllable sequence generation across phylogenetically diverse species. NTv3 is pretrained on more than 128,000 genomes using sequences up to 1 Mb and post-trained on 16,262 functional tracks across 15 animal and plant genomes. NTv3 performs comparably to AlphaGenome on matched human assays and matches or exceeds evaluated published models for functional-track prediction across 19 species spanning mammals, birds, fish, plants, fungi and protists. Ablation experiments show that both genome pre-training and expanding functional supervision from human and mouse to 15 species improve track prediction. Leveraging these learned functional representations, NTv3 outperforms leading ab initio gene predictors across mammals, plants and insects, with fewer spurious gene models and improved recovery and reduced fragmentation of long genes. Finally, the same representations can be used with discrete diffusion to design regulatory DNA sequences with specific activity levels. We demonstrate this in plant and fly promoters and enhancers, and experimentally validate the activity and promoter selectivity of the generated fly enhancers. Together, NTv3 unifies genome interpretation, gene annotation and regulatory sequence design across the animal and plant kingdoms, with direct relevance to agriculture, biodiversity research and biotechnology.

29 October 2025 in Nature Methods
Verified
Journal Article
Open access
PDF file
BABernardo P. de Almeida
Bernardo P. de Almeida
HDHugo Dalla-Torre
Hugo Dalla-Torre
GRGuillaume Richard
Guillaume Richard
CBChristopher Blum
Christopher Blum
LHLorenz Hexemer
Lorenz Hexemer
TPThomas Pierrot
Thomas Pierrot
Genome annotation models that directly analyze DNA sequences are indispensable for modern biological research, enabling rapid and accurate identification of genes and other functional elements. Current annotation tools are typically developed for specific element classes and trained from scratch using supervised learning on datasets that are often limited in size. Here we frame the genome annotation problem as multilabel semantic segmentation and introduce a methodology for fine-tuning pretrained DNA foundation models to segment 14 different genic and regulatory elements at single-nucleotide resolution. We leverage the self-supervised pretrained model Nucleotide Transformer to develop a general segmentation model, SegmentNT, capable of processing DNA sequences up to 50-kb long and that achieves state-of-the-art performance on gene annotation, splice site and regulatory elements detection. We also integrated in our framework the foundation models Enformer and Borzoi, extending the sequence context up to 500 kb and enhancing performance on regulatory elements. Finally, we show that a SegmentNT model trained on human genomic elements generalizes to different species, and a multispecies SegmentNT model achieves strong generalization across unseen species. Our approach is readily extensible to additional models, genomic elements and species.