Machine learning (ML) and deep learning (DL) models for peptide property prediction such as Prosit have enabled the creation of high quality in silico reference libraries. These libraries are used in various applications, ranging from data‐independent acquisition (DIA) data analysis to data‐driven rescoring of search engine results. Here, we present Oktoberfest, an open source Python package of our spectral library generation and rescoring pipeline originally only available online via ProteomicsDB. Oktoberfest is largely search engine agnostic and provides access to online peptide property predictions, promoting the adoption of state‐of‐the‐art ML/DL models in proteomics analysis pipelines. We demonstrate its ability to reproduce and even improve our results from previously published rescoring analyses on two distinct use cases. Oktoberfest is freely available on GitHub (https://github.com/wilhelm‐lab/oktoberfest) and can easily be installed locally through the cross‐platform PyPI Python package.
Immunopeptidomics is crucial for immunotherapy and vaccine development. Because the generation of immunopeptides from their parent proteins does not adhere to clear-cut rules, rather than being able to use known digestion patterns, every possible protein subsequence within human leukocyte antigen (HLA) class-specific length restrictions needs to be considered during sequence database searching. This leads to an inflation of the search space and results in lower spectrum annotation rates. Peptide-spectrum match (PSM) rescoring is a powerful enhancement of standard searching that boosts the spectrum annotation performance. We analyze 302,105 unique synthesized non-tryptic peptides from the ProteomeTools project on a timsTOF-Pro to generate a ground-truth dataset containing 93,227 MS/MS spectra of 74,847 unique peptides, that is used to fine-tune the deep learning-based fragment ion intensity prediction model Prosit. We demonstrate up to 3-fold improvement in the identification of immunopeptides, as well as increased detection of immunopeptides from low input samples.
Most heritable diseases are polygenic. To comprehend the underlying genetic architecture, it is crucial to discover the clinically relevant epistatic interactions (EIs) between genomic single nucleotide polymorphisms (SNPs) ( 1–3). Existing statistical computational methods for EI detection are mostly limited to pairs of SNPs due to the combinatorial explosion of higher-order EIs. With NeEDL (network-based epistasis detection via local search), we leverage network medicine to inform the selection of EIs that are an order of magnitude more statistically significant compared to existing tools and consist, on average, of five SNPs. We further show that this computationally demanding task can be substantially accelerated once quantum computing hardware becomes available. We apply NeEDL to eight different diseases and discover genes (affected by EIs of SNPs) that are partly known to affect the disease, additionally, these results are reproducible across independent cohorts. EIs for these eight diseases can be interactively explored in the Epistasis Disease Atlas (https://epistasis-disease-atlas.com). In summary, NeEDL demonstrates the potential of seamlessly integrated quantum computing techniques to accelerate biomedical research. Our network medicine approach detects higher-order EIs with unprecedented statistical and biological evidence, yielding unique insights into polygenic diseases and providing a basis for the development of improved risk scores and combination therapies.
Large-scale drug sensitivity screens have enabled training drug response prediction models based on cancer cell line omics profiles to advance personalized medicine. While model performances reported in the literature appear promising, successful translation to the clinic remains limited. In this work, we discuss key obstacles that lead to overly optimistic performance estimates of state-of-the-art models, making it challenging to track progress in the field. To address them, we present DrEval, a pipeline for unbiased, biologically meaningful evaluation of cancer drug response models. DrEval is designed as a living open-source benchmark that integrates baseline and literature models with standardized hyperparameter tuning, statistically rigorous evaluation, cross-study benchmarks, and supports ablation studies and publication-ready visualizations. Using DrEval, we show that deep learning models barely outperform a naive model that predicts only the mean drug and cell line effects, while no complex model outperforms properly tuned tree-based ensemble baselines in relevant settings.
It has been shown that integrating peptide property predictions such as fragment intensity into the scoring process of peptide spectrum match can greatly increase the number of confidently identified peptides compared to using traditional scoring methods. Here, we introduce Prosit-XL, a robust and accurate fragment intensity predictor covering the cleavable (DSSO/DSBU) and non-cleavable cross-linkers (DSS/BS3), achieving high accuracy on various holdout sets with consistent performance on external datasets without fine-tuning. Due to the complex nature of false positives in XL-MS, an approach to data-driven rescoring was developed that benefits from Prosit-XL’s predictions while limiting the overestimation of the false discovery rate (FDR). After validating this approach using two ground truth datasets consisting of synthetic peptides and proteins, we applied Prosit-XL on a proteome-scale dataset, demonstrating an up to ~3.4-fold improvement in PPI discovery compared to classic approaches. Finally, Prosit-XL was used to increase the coverage and depth of a spatially resolved interactome map of intact human cytomegalovirus virions, leading to the discovery of previously unobserved interactions between human and cytomegalovirus proteins.
Motivation: Large-scale drug sensitivity screens have enabled training drug response prediction models based on cancer cell line omics profiles to facilitate personalized medicine. While model performances reported in the literature appear promising, no successful translation to the clinic has been reported. Results: We identify six primary obstacles to this: non-reproducible models, data leakage leading to poor generalization, pseudoreplication, biased evaluation metrics, missing ablation studies, and inconsistent viability data reducing comparability across models. Together, these issues lead to overly optimistic performance estimates of state-of-the-art models and make it challenging to track progress in the field. To address this, we present DrEval, a pipeline for unbiased and biologically meaningful evaluation of cancer drug response models. It includes baseline and literature models with consistent hyperparameter tuning, statistically sound evaluations, and cross-study benchmarks. DrEval enables ablation studies and publication-ready visualizations. It allows researchers to focus on model development without implementing their own evaluation protocol. We find that deep learning models barely outperform a naive model predicting the mean drug and cell line effects, while no complex model significantly outperforms properly tuned tree-based ensemble baselines in relevant settings. We advocate making our pipeline a standard benchmark for cancer drug response prediction, ensuring a clinically relevant and robust assessment. Availability and implementation: DrEval consists of a Python package, available on PyPI (drevalpy) and GitHub ( github.com/daisybio/drevalpy ), and an accompanying nf-core pipeline ( github.com/nf-core/drugresponseeval ). All data is available on Zenodo (DOI: 10.5281/zenodo.12633909), preprocessing scripts on github.com/daisybio/preprocess_drp_data .