1 July 2025 in Nature Communications
While RNA has recently been recognized as an interesting small-molecule drug target, many challenges remain to be addressed before we take full advantage of it. This emphasizes the necessity to improve our understanding of its structures and functions. Over the years, sequencing technologies have produced an enormous amount of unlabeled RNA data, which hides a huge potential. Motivated by the successes of protein language models, we introduce RiboNucleic Acid Language Model (RiNALMo) to unveil the hidden code of RNA. RiNALMo is the largest RNA language model to date, with 650M parameters pre-trained on 36M non-coding RNA sequences from several databases. It can extract hidden knowledge and capture the underlying structure information implicitly embedded within the RNA sequences. RiNALMo achieves state-of-the-art results on several downstream tasks. Notably, we show that its generalization capabilities overcome the inability of other deep learning methods for secondary structure prediction to generalize on unseen RNA families.
6 January 2022 in IEEE Transactions on Signal Processing
This paper introduces a novel framework and corresponding methods for sampling and reconstruction of sparse signals in shift-invariant (SI) spaces. We reinterpret the random demodulator, a system that acquires sparse bandlimited signals, as a system for the acquisition of linear combinations of the samples in the SI setting with the box function as the sampling kernel. The sparsity assumption is exploited by the compressive sensing (CS) paradigm for a recovery of the SI samples from a reduced set of measurements. The SI samples are subsequently filtered by a discrete-time correction filter to reconstruct expansion coefficients of the observed signal. Furthermore, we offer a generalization of the proposed framework to other compactly supported sampling kernels that span a wider class of SI spaces. The generalized method embeds the correction filter in the CS optimization problem which directly reconstructs expansion coefficients of the signal. Both approaches recast an inherently continuous-domain inverse problem in a set of finite-dimensional CS problems in an exact way. Finally, we conduct numerical experiments on signals in polynomial B-spline spaces whose expansion coefficients are assumed to be sparse in a certain transform domain. The coefficients can be regarded as parametric models of an underlying continuous-time signal, obtained from a reduced set of measurements. Such continuous signal representations are particularly suitable for signal processing without converting them into samples.
3 December 2024 in bioRxiv
Several deep learning-based tools for RNA 3D structure prediction have recently emerged, including DRfold, DeepFoldRNA, RhoFold, RoseTTAFoldNA, trRosettaRNA, and AlphaFold 3. In this study, we systematically evaluate these six models on three datasets: RNA Puzzles, CASP15 RNA targets, and a newly generated dataset of sequentially distinct RNAs, which serves as a benchmark for generalization capabilities. To ensure a robust evaluation, we also introduce a fourth, more stringent dataset that contains both sequentially and structurally distinct RNAs. We observed that each model predicts the best structure for certain RNAs, and evaluated whether commonly used scoring functions, Rosetta score and ARES, can reliably identify the most accurate structure from the predictions. Finally, since many RNA chains in the Protein Data Bank are part of complexes, we compare the performance of RoseTTAFoldNA and AlphaFold 3 in predicting RNA structures within complexes versus isolated RNA chains extracted from these complexes. This comprehensive evaluation highlights the strengths and limitations of current deep learning-based tools and provides valuable insights for advancing RNA 3D structure prediction.
4 April 2022 in Signal Processing: Image Communication