Thibaut Dejean

Thibaut Dejean

Auto-generated profile, based on publicly available information

Thibaut Dejean

Department of Information and Computer Sciences, University of Hawai`i , Honolulu, HI 96822

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 April 2025 in bioRxiv
Verified
Preprint
Open access
PDF file
RSRajan Sawhney
Rajan Sawhney
BFBarbra Ferrell
Barbra Ferrell
TDThibaut Dejean
Thibaut Dejean
ZSZachary Schreiber
Zachary Schreiber
WHWilliam Harrigan
William Harrigan
MBMahdi Belcaid
Mahdi Belcaid
Protein language models (pLMs) have revolutionized computational biology by generating rich protein vector representations—or embeddings—enabling major advancements in de novo protein design, structure prediction, variant effect analysis, and evolutionary studies. Despite these breakthroughs, current pLMs often exhibit biases against proteins from underrepresented species, with viral proteins being particularly affected—frequently referred to as the “dark matter” of the biological world due to their vast diversity and ubiquity, yet sparse representation in training datasets. Here, we show that fine-tuning pre-trained pLMs on viral protein sequences, using diverse learning frameworks and parameter-efficient strategies, significantly enhances representation quality and improves performance on downstream tasks. To support further research, we provide source code for fine-tuning pLMs and benchmarking embedding quality. By enabling more accurate modeling of viral proteins, our approach advances tools for understanding viral biology, combating emerging infectious diseases, and driving biotechnological innovation.

21 January 2026 in GigaScience
Verified
Journal Article
Open access
TDThibaut Dejean
Thibaut Dejean
BFBarbra Ferrell
Barbra Ferrell
WHWilliam Harrigan
William Harrigan
ZSZachary D Schreiber
Zachary D Schreiber
RSRajan Sawhney
Rajan Sawhney
MBMahdi Belcaid
Mahdi Belcaid
Aa Background: The transformer architecture in deep learning has revolutionized protein sequence analysis. Recent advancements in protein language models have paved the way for significant progress across various domains, including protein function and structure prediction, multiple sequence alignments, and mutation effect prediction. A protein language model is commonly trained on individual proteins, ignoring the interdependencies between sequences within a genome. However, biological understanding reveals that protein–protein interactions span entire genomic regions, underscoring the limitations of focusing solely on individual proteins. Ab Findings: To address these limitations, we propose a novel approach that extends the context size of transformer models across the entire viral genome. By training on large genomic fragments, our method captures putative long-range dependencies consistent with inter-protein relationships and encodes protein sequences with integrated information from distant proteins within the same genome, offering benefits across downstream tasks. Viruses, with their densely packed genomes, minimal intergenic regions, and protein annotation challenges, are ideal candidates for genome-wide learning. We introduce a long-context protein language model, trained on entire viral genomes, leveraging a biologically informed sparse attention mechanism in which inter-protein links are inferred computationally and used as sparsity priors. Our semi-supervised approach supports long sequences of up to 61,000 amino acids (aa). Ac Conclusion: Our evaluations show improved prediction of masked aa and improved downstream discrimination relative to single-protein models and long-context baselines, with additional validation that our inferred links correlate with independently curated interaction resources.

1 June 2025 in bioRxiv
Verified
Preprint
Open access
PDF file
TDThibaut Louis Dejean
Thibaut Louis Dejean
BFBarbra D. Ferrell
Barbra D. Ferrell
WHWilliam Harrigan
William Harrigan
ZSZachary D. Schreiber
Zachary D. Schreiber
RSRajan Sawhney
Rajan Sawhney
MBMahdi Belcaid
Mahdi Belcaid
The transformer architecture in deep learning has revolutionized protein sequence analysis. Recent advancements in protein language models have paved the way for significant progress across various domains, including protein function and structure prediction, multiple sequence alignments and mutation effect prediction. A protein language model is commonly trained on individual proteins, ignoring the interdependencies between sequences within a genome. However, biological understanding reveals that protein–protein interactions span entire genomic regions, underscoring the limitations of focusing solely on individual proteins. To address these limitations, we propose a novel approach that extends the context size of transformer models across the entire viral genome. By training on large genomic fragments, our method captures long-range interprotein interactions and encodes protein sequences with integrated information from distant proteins within the same genome, offering substantial benefits in various tasks. Viruses, with their densely packed genomes, minimal intergenic regions, and protein annotation challenges, are ideal candidates for genome-wide learning. We introduce a long-context protein language model, trained on entire viral genomes, leveraging a sparse attention mechanism based on protein–protein interactions. Our semi-supervised approach supports long sequences of up to 61,000 amino acids (aa). Our evaluations demonstrate that the resulting embeddings significantly surpass those generated by single-protein models and outperform alternative large-context architectures that rely on static masking or non-transformer frameworks.