Yue Zhou

Yue Zhou

Auto-generated profile, based on publicly available information

Yue Zhou

Department of Advanced Computing, Pengcheng Laboratory , Shenzhen 518055

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 March 2024 in Briefings in Bioinformatics
Verified
Journal Article
Open access
PDF file
KCKen Chen
Ken Chen
YZYue Zhou
Yue Zhou
MDMaolin Ding
Maolin Ding
YWYu Wang
Yu Wang
ZRZhixiang Ren
Zhixiang Ren
YYYuedong Yang
Yuedong Yang
Language models pretrained by self-supervised learning (SSL) have been widely utilized to study protein sequences, while few models were developed for genomic sequences and were limited to single species. Due to the lack of genomes from different species, these models cannot effectively leverage evolutionary information. In this study, we have developed SpliceBERT, a language model pretrained on primary ribonucleic acids (RNA) sequences from 72 vertebrates by masked language modeling, and applied it to sequence-based modeling of RNA splicing. Pretraining SpliceBERT on diverse species enables effective identification of evolutionarily conserved elements. Meanwhile, the learned hidden states and attention weights can characterize the biological properties of splice sites. As a result, SpliceBERT was shown effective on several downstream tasks: zero-shot prediction of variant effects on splicing, prediction of branchpoints in humans, and cross-species prediction of splice sites. Our study highlighted the importance of pretraining genomic language models on a diverse range of species and suggested that SSL is a promising approach to enhance our understanding of the regulatory logic underlying genomic sequences.

1 March 2024 in Machine Learning: Science and Technology
Verified
Journal Article
Open access
HWHe Wang
He Wang
YZYue Zhou
Yue Zhou
ZCZhoujian Cao
Zhoujian Cao
ZGZongkuan Guo
Zongkuan Guo
ZRZhixiang Ren
Zhixiang Ren
With the advent of gravitational-wave astronomy and the discovery of more compact binary coalescences, data quality improvement techniques are desired to handle the complex and overwhelming noise in gravitational wave (GW) observational data. Though recent machine learning-based studies have shown promising results for data denoising, they are unable to precisely recover both the GW signal amplitude and phase. To address such an issue, we develop a deep neural network centered workflow, WaveFormer, for significant noise suppression and signal recovery on observational data from the Laser Interferometer Gravitational-Wave Observatory (LIGO). The WaveFormer has a science-driven architecture design with hierarchical feature extraction across a broad frequency spectrum. As a result, the overall noise and glitch are decreased by more than one order of magnitude and the signal recovery error is roughly 1% and 7% for the phase and amplitude, respectively. Moreover, on 75 reported binary black hole events of LIGO we obtain a significant improvement of inverse false alarm rate. Our work highlights the potential of large neural networks in GW data analysis and, while primarily demonstrated on LIGO data, its adaptable design indicates promise for broader application within the International Gravitational-Wave Observatories Network in future observational runs.

23 April 2024 in Physical Review D
Verified
Journal Article
Closed access
PDF file
TZTianyu Zhao
Tianyu Zhao
YZYue Zhou
Yue Zhou
RSRuijun Shi
Ruijun Shi
Zhoujian CaoZhoujian Cao
Zhoujian Cao
ZRZhixiang Ren
Zhixiang Ren
The detection of extreme-mass-ratio inspirals (EMRIs) is intricate due to their complex waveforms, extended duration, and low signal-to-noise ratio (SNR), making them more challenging to be identified compared to compact binary coalescences. While matched filtering-based techniques are known for their computational demands, existing deep learning-based methods primarily handle time-domain data and are often constrained by data duration and SNR. In addition, most existing work ignores time delay interferometry (TDI) and applies the long-wavelength approximation in detector response calculations, thus limiting their ability to handle laser frequency noise. In this study, we introduce dilated convolutional neural network for detecting extreme-mass-ratio inspirals (DECODE), an end-to-end model focusing on EMRI signal detection by sequence modeling in the frequency domain. Centered around a dilated causal convolutional neural network, trained on synthetic data considering TDI-1.5 detector response, DECODE can efficiently process a year’s worth of multichannel TDI data with an SNR of around 50. We evaluate our model on one-year data with accumulated SNR ranging from 50 to 120 and achieve a true positive rate of 96.3% at a false positive rate of 1%, keeping an inference time of less than 0.01 seconds. With the visualization of three showcased EMRI signals for interpretability and generalization, DECODE exhibits strong potential for future space-based gravitational wave data analyses.

7 February 2025 in Physical Review D
Verified
Journal Article
Closed access
RSRuijun Shi
Ruijun Shi
YZYue Zhou
Yue Zhou
TZTianyu Zhao
Tianyu Zhao
ZWZun Wang
Zun Wang
ZRZhixiang Ren
Zhixiang Ren
Zhoujian CaoZhoujian Cao
Zhoujian Cao

10 April 2024 in Physical Review D
Verified
Journal Article
Closed access
PDF file
RSRuijun Shi
Ruijun Shi
YZYue Zhou
Yue Zhou
TZTianyu Zhao
Tianyu Zhao
Zhoujian CaoZhoujian Cao
Zhoujian Cao
ZRZhixiang Ren
Zhixiang Ren
Space-based gravitational wave (GW) detection is one of the most anticipated GW detection projects in the next decade, which promises to detect abundant compact binary systems. At present, deep learning methods have not been widely explored for GW waveform generation and extrapolation. To solve the data processing difficulty and the increasing waveform complexity caused by the detector’s response and second-generation time-delay interferometry (TDI 2.0), an interpretable pretrained large model named Compact Binary Systems Waveform Generation with Generative Pretrained Transformer (CBS-GPT) is proposed. For compact binary system waveforms, three models were trained to predict the waveforms of massive black hole binaries, extreme mass-ratio inspirals, and galactic binaries, achieving prediction accuracies of at most 99%, 91%, and 99%, respectively. The CBS-GPT model exhibits notable generalization and interpretability, with its hidden parameters effectively capturing the intricate information of waveforms, even with the complex instrument response and a wide parameter range. Our research demonstrates the potential of large models in the GW realm, opening up new opportunities and guidance for future researches such as complex waveforms generation, gap completion, and deep learning model design for GW science.

12 May 2025 in Physical Review D
Verified
Journal Article
Closed access
TZTianyu Zhao
Tianyu Zhao
YZYue Zhou
Yue Zhou
RSRuijun Shi
Ruijun Shi
Peng XuPeng Xu
Peng Xu
Zhoujian CaoZhoujian Cao
Zhoujian Cao
ZRZhixiang Ren
Zhixiang Ren