Ziyao Wang

Ziyao Wang

Auto-generated profile, based on publicly available information

Ziyao Wang

Department of Electrical and Computer Engineering, University of Maryland College Park, College Park, MD, USA

Research Focus & Metrics

Representative Publications

View All Publications
23 June 2025
Verified
Conference Paper
Open access
ZSZheyu Shen
Zheyu Shen
YHYexiao He
Yexiao He
ZWZiyao Wang
Ziyao Wang
YZYuning Zhang
Yuning Zhang
GSGuoheng Sun
Guoheng Sun
ALANG Li
ANG Li

1 November 2026 in bioRxiv
Verified
Preprint
Open access
PDF file
ZWZiyao Wang
Ziyao Wang
YQYunrui Qiu
Yunrui Qiu
YHYexiao He
Yexiao He
ITIsabel Thompson
Isabel Thompson
HWHongli Wang
Hongli Wang
ALANG Li
ANG Li
RNA foundation models offer a promising route to decoding the relationships between RNA sequence, structure and function, yet how model architecture shapes the acquisition and organization of biological information remains poorly understood. Here we introduce Layer-Interleaved Mamba-Bidirectional Encoder for RNA (LIMBER), a hybrid foundation model integrating bidirectional self-attention with selective state-space modeling, pre-trained on 40.5 million non-coding RNA sequences. With task-specific fine-tuning, LIMBER achieves leading performance on secondary-structure prediction and non-coding RNA classification benchmarks, while demonstrating strong transferability to translation-related tasks and RNA–small-molecule interaction prediction. Beyond model development, we establish a unified, task-agnostic framework to systematically evaluate and interpret the biological knowledge intrinsically acquired by RNA foundation models. This framework validates LIMBER’s strong capabilities in recovering RNA structures and predicting mutational effects, while uncovering a hierarchical, task-dependent organization of biological information across model layers. In addition, we demonstrate distinct scaling behaviors across structural, evolutionary, and functional capabilities by training and evaluating a broad panel of model variants spanning model capacity, training duration, and dataset size. Taken together, these findings establish LIMBER as a versatile RNA foundation model and provide insight into how architectural design, internal representations and scaling shape the learning of RNA sequence-structure-function relationships.