Yaowei Li

Yaowei Li

Auto-generated profile, based on publicly available information

Yaowei Li

School of Electronic and Computer Engineering, Peking University, Shenzhen, China and Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Shenzhen Graduate School, Peking University, Shenzhen, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 July 2024
Verified
Conference Paper
Open access
ZWZhouxia Wang
Zhouxia Wang
ZYZiyang Yuan
Ziyang Yuan
XWXintao Wang
Xintao Wang
YLYaowei Li
Yaowei Li
TCTianshui Chen
Tianshui Chen
YSYing Shan
Ying Shan
Motions in a video primarily consist of camera motion, induced by camera movement, and object motion, resulting from object movement. Accurate control of both camera and object motion is essential for video generation. However, existing works either mainly focus on one type of motion or do not clearly distinguish between the two, limiting their control capabilities and diversity. Therefore, this paper presents MotionCtrl, a unified and flexible motion controller for video generation designed to effectively and independently control camera and object motion. The architecture and training strategy of MotionCtrl are carefully devised, taking into account the inherent properties of camera motion, object motion, and imperfect training data. Compared to previous methods, MotionCtrl offers three main advantages: 1) It effectively and independently controls camera motion and object motion, enabling more fine-grained motion control and facilitating flexible and diverse combinations of both types of motion. 2) Its motion conditions are determined by camera poses and trajectories, which are appearance-free and minimally impact the appearance or shape of objects in generated videos. 3) It is a relatively generalizable model that can adapt to a wide array of camera poses and trajectories once trained. Extensive qualitative and quantitative experiments have been conducted to demonstrate the superiority of MotionCtrl over existing methods. Project page: https://wzhouxiff.github.io/projects/MotionCtrl/ .

4 March 2024
Verified
Conference Paper
Open access
ZZZhihong Zhu
Zhihong Zhu
XCXuxin Cheng
Xuxin Cheng
HLHongxiang Li
Hongxiang Li
YLYaowei Li
Yaowei Li
YZYuexian Zou
Yuexian Zou
Multi-intent spoken language understanding (SLU) has garnered increasing attention since it can handle complex utterances expressing multiple intents in real-world scenarios. However, existing joint models are disturbed by label statistical frequencies, or adopt homogeneous graphs to capture interactions between the different types (e.g., intent and slot) of label nodes, thereby limiting the performance. To overcome these limitations, we propose Dual Heterogeneous Graph Label Interaction for multi-intent SLU, named DHLG. Concretely, we propose a global static heterogeneous label graph interaction layer to model both intra- and inter-label statistical dependencies across the entire training corpus. Based on this, we introduce a local dynamic heterogeneous label graph layer to further facilitate adaptive interactions between intents and slots for each utterance. Extensive experiments and analyses on two widely-used benchmark datasets demonstrate the superiority of our proposed DHLG over state-of-the-art methods.

14 December 2025
Verified
Conference Paper
Open access
YLYaowei Li
Yaowei Li
LLLingen Li
Lingen Li
ZZZhaoyang Zhang
Zhaoyang Zhang
XLXiaoyu Li
Xiaoyu Li
WGWang Guangzhi
Wang Guangzhi
YZYue-Xian Zou
Yue-Xian Zou

19 May 2026 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YLYaowei Li
Yaowei Li
YBYuxuan Bian
Yuxuan Bian
XJXuan Ju
Xuan Ju
ZZZhaoyang Zhang
Zhaoyang Zhang
JZJunhao Zhuang
Junhao Zhuang
QXQiang Xu
Qiang Xu
Image editing has advanced significantly with the development of diffusion models using both inversion-based and instruction-based methods. However, current inversion-based approaches struggle with big modifications (e.g., adding or removing objects) due to the structured nature of inversion noise, which hinders substantial changes. Meanwhile, instruction-based methods often constrain users to black-box operations, limiting direct interaction for specifying editing regions and intensity. To address these limitations, we propose BrushEdit, a novel inpainting-based instruction-guided image editing paradigm, which leverages multimodal large language models (MLLMs) and image inpainting models to enable autonomous, user-friendly, and interactive free-form instruction editing. Specifically, we devise a system enabling free-form instruction editing by integrating MLLMs and a dual-branch image inpainting model in an agentcooperative framework to perform editing category classification, main object identification, mask acquisition, and editing area inpainting. Extensive experiments show that our framework effectively combines MLLMs and inpainting models, achieving superior performance across seven metrics including mask region preservation and editing effect coherence.

21 October 2023
Verified
Conference Paper
Open access
XCXuxin Cheng
Xuxin Cheng
ZZZhihong Zhu
Zhihong Zhu
YLYaowei Li
Yaowei Li
HLHongxiang Li
Hongxiang Li
YZYuexian Zou
Yuexian Zou
Multimodal machine translation (MMT) aims to exploit visual information to improve neural machine translation (NMT). It has been demonstrated that image captioning and object detection can further improve MMT. In this paper, to leverage image captioning and object detection more effectively, we propose a Dual-level ASymmetric Contrastive Learning (DAS-CL) framework. Specifically, we leverage image captioning and object detection to generate more pairs of visual inputs and textual inputs. At the utterance level, we introduce an image captioning model to generate more coarse-grained pairs. At the word level, we introduce an object detection model to generate more fine-grained pairs. To mitigate the negative impact of noise in generated pairs, we apply asymmetric contrastive learning at these two levels. Experiments on the Multi30K dataset of three translation directions demonstrate that DAS-CL significantly outperforms existing MMT frameworks and achieves new state-of-the-art performance. More encouragingly, further analysis displays that DAS-CL is more robust to irrelevant visual information.

19 July 2026
Verified
Conference Paper
Open access
YLYaowei Li
Yaowei Li
XLXiaoyu Li
Xiaoyu Li
ZZZhaoyang Zhang
Zhaoyang Zhang
HLHongxiang Li
Hongxiang Li
LCLong Chen
Long Chen
YZYue-Xian Zou
Yue-Xian Zou