Shaocong Xu

Shaocong Xu

Auto-generated profile, based on publicly available information

Shaocong Xu

BAAI, Beijing, China

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 July 2026 in ACM Transactions on Graphics
Verified
Journal Article
Open access
HCHouyuan Chen
Houyuan Chen
HLHong Li
Hong Li
XKXianghao Kong
Xianghao Kong
TZTianrui Zhu
Tianrui Zhu
SXShaocong Xu
Shaocong Xu
ARAnyi Rao
Anyi Rao
Recent progress has shown that video diffusion models (VDMs) can be repurposed to solve various multimodal graphics tasks. However, existing approaches predominantly train separate models for each specific problem setting. This practice locks models into fixed input-output mappings, and typically ignores the joint correlations across modalities. In this paper, we present UniVidX , a unified multimodal framework designed to leverage VDM priors to enable versatile video generation. Our goal is to (i) master diverse pixel-aligned tasks by formulating them as conditional generation problems within multimodal space, (ii) adapt to modality-specific distributions without compromising the backbone's native priors, and (iii) ensure cross-modal consistency during synthesis. Concretely, we propose three key designs: 1) Stochastic Condition Masking (SCM): by randomly partitioning modalities into clean conditions and noisy targets during training, we enable the model to learn omni-directional conditional generation rather than fixed mappings. 2) Decoupled Gated LoRA (DGL): we attach per-modality LoRAs and activate them when a modality serves as a generation target, thereby preserving the VDM's strong priors. 3) Cross-Modal Self-Attention (CMSA): we explicitly share keys/values across modalities while maintaining modality-specific queries, facilitating information exchange and inter-modal alignment. We validate our framework by instantiating it in two domains: 1) UniVid-Intrinsic for RGB videos and their intrinsic maps (albedo, irradiance, normal), and 2) UniVid-Alpha for blended RGB videos and their constituent RGBA layers. Experimental results demonstrate that both models achieve performance competitive with state-of-the-art methods across distinct tasks. Notably, they exhibit robust generalization capabilities in in-the-wild scenarios, even when trained on limited datasets of fewer than 1k videos.

19 July 2026
Verified
Conference Paper
Open access
WXWeiqing Xiao
Weiqing Xiao
HLHong Li
Hong Li
XYXiuyu Yang
Xiuyu Yang
HCHouyuan Chen
Houyuan Chen
WLWenyi Li
Wenyi Li
BWBeibei Wang
Beibei Wang

9 November 2026
Verified
Conference Paper
Open access
QWQizhe Wei
Qizhe Wei
XGXianda Guo
Xianda Guo
SXShaocong Xu
Shaocong Xu
HLHong Li
Hong Li
RYRunyi Yang
Runyi Yang
HZHao Zhao
Hao Zhao