Lei Ren

Lei Ren

Auto-generated profile, based on publicly available information

Lei Ren

Li Auto Inc., Beijing, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 October 2024
Verified
Conference Paper
Open access
HWHanzi Wang
Hanzi Wang
JRJiamin Ren
Jiamin Ren
YDYifeng Ding
Yifeng Ding
LRLei Ren
Lei Ren
HJHuixing Jiang
Huixing Jiang
XWXiaojie Wang
Xiaojie Wang
Multimodal Large Language Models (MLLMs) have showcased remarkable advances in handling various vision-language tasks. These models typically consist of a Large Language Model (LLM), a vision encoder and a connector structure, which is used to bridge the modality gap between vision and language. It is challenging for the connector to filter the right visual information for LLM according to the task in hand. Most of previous connectors, such as light-weight projection and Q-former, treat visual information for diverse tasks uniformly, therefore lacking task-specific visual information extraction capabilities. To address the issue, this paper proposes Q-MoE, a query-based connector with Mixture-of-Experts (MoE) to extract task-specific information with text-driven routing. Furthermore, an optimal path based training strategy is proposed to find an optimal expert combination. Extensive experiments on two popular open-source LLMs and several different visual-language tasks demonstrate the effectiveness of the Q-MoE connecter.

27 October 2025
Verified
Conference Paper
Open access
MWMingjie Wei
Mingjie Wei
WZWei-Nan Zhang
Wei-Nan Zhang
CZChen Zhang
Chen Zhang
YDYifeng Ding
Yifeng Ding
DDDonglin Di
Donglin Di
TLTing Liu
Ting Liu

27 October 2025
Verified
Conference Paper
Open access
JMJing Ma
Jing Ma
HSHaochen Sun
Haochen Sun
ZZZeyuan Zang
Zeyuan Zang
FFFangxiang Feng
Fangxiang Feng
CYCaixia Yuan
Caixia Yuan
XWXiaojie Wang
Xiaojie Wang