Yu Liu

Ms. Yu Liu


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 February 2024 in Magnetic Resonance Imaging
Verified
Journal Article
Closed access
YLYan Li
Yan Li
YSYongjia Shao
Yongjia Shao
JWJunlang Wang
Junlang Wang
YLYu Liu
Yu Liu
YYYuhan Yang
Yuhan Yang
QXQian Xi
Qian Xi

18 February 2025 in Applied Sciences
Verified
Journal Article
Open access
PDF file
ZWZijian Wang
Zijian Wang
LJLi Jiayong
Li Jiayong
YLYu Liu
Yu Liu
XLXuhang Li
Xuhang Li
CYCairong Yan
Cairong Yan
YZYanting Zhang
Yanting Zhang
Model fusion is a technique of growing interest in the field of machine learning, which constructs a generalized model by merging the parameters of multiple independent models with different capabilities without the need to access the original training data or perform costly computations. However, during model fusion, when the number of parameters in a large language model is high, the dimension of the parameter space increases, which makes it more challenging to find the optimal combination of weights. Meanwhile, there is considerable potential for further development in sustainable optimization schemes for task-specific performance enhancement through model fusion in this area. In this paper, we propose a large-scale language model fusion approach based on task-enhanced reinforcement learning (RL–Fusion) to efficiently explore and optimize model fusion configurations. The key innovation of RL–Fusion lies in its use of reinforcement learning to guide parameter selection during model fusion, enabling a more intelligent and adaptive exploration of the parameter space. Additionally, RL–Fusion introduces a dynamic evaluation mechanism that adjusts the evaluation dataset in real-time based on feedback from SOTA models, ensuring continuous enhancement of domain-specific capabilities. RL–Fusion outperforms the baseline model by improving 1.75% in the MMLU benchmark test, 1.8% in the C-eval test, and 1.8% in the Chinese Named Entity Recognition (NER) test on the Yayi NER dataset by 16%. The results show that RL–Fusion is an effective and scalable model fusion solution that improves performance without increasing the computational cost of traditional optimization methods and has a wide range of applications in AI research and practice.