Chongjie Ye

Chongjie Ye

Auto-generated profile, based on publicly available information

Chongjie Ye

The Chinese University of Hongkong, Shenzhen, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
CYChongjie Ye
Chongjie Ye
LQLingteng Qiu
Lingteng Qiu
XGXiaodong Gu
Xiaodong Gu
QZQi Zuo
Qi Zuo
YWYushuang Wu
Yushuang Wu
XHXiaoguang Han
Xiaoguang Han
This work addresses the challenge of high-quality surface normal estimation from monocular colored inputs (i.e., images and videos), a field which has recently been revolutionized by repurposing diffusion priors. However, previous attempts still struggle with stochastic inference, conflicting with the deterministic nature of the Image2Normal task, and costly ensembling step, which slows down the estimation process. Our method, StableNormal, mitigates the stochasticity of the diffusion process by reducing inference variance, thus producing "Stable-and-Sharp" normal estimates without any additional ensembling process. StableNormal works robustly under challenging imaging conditions, such as extreme lighting, blurring, and low quality. It is also robust against transparent and reflective surfaces, as well as cluttered scenes with numerous objects. Specifically, StableNormal employs a coarse-to-fine strategy, which starts with a one-step normal estimator (YOSO) to derive an initial normal guess, that is relatively coarse but reliable, then followed by a semantic-guided refinement process (SG-DRN) that refines the normals to recover geometric details. The effectiveness of StableNormal is demonstrated through competitive performance in standard datasets such as DIODE-indoor, iBims, ScannetV2 and NYUv2, and also in various downstream tasks, such as surface reconstruction and normal enhancement. These results evidence that StableNormal retains both the "stability" and "sharpness" for accurate normal estimation. StableNormal represents a baby attempt to repurpose diffusion priors for deterministic estimation. To democratize this, code and models have been publicly available in hf.co/Stable-X.

19 July 2026
Verified
Conference Paper
Open access
WXWeiqing Xiao
Weiqing Xiao
HLHong Li
Hong Li
XYXiuyu Yang
Xiuyu Yang
HCHouyuan Chen
Houyuan Chen
WLWenyi Li
Wenyi Li
BWBeibei Wang
Beibei Wang

3 July 2026 in ACM Transactions on Graphics
Verified
Journal Article
Open access
HCHouyuan Chen
Houyuan Chen
HLHong Li
Hong Li
XKXianghao Kong
Xianghao Kong
TZTianrui Zhu
Tianrui Zhu
SXShaocong Xu
Shaocong Xu
ARAnyi Rao
Anyi Rao
Recent progress has shown that video diffusion models (VDMs) can be repurposed to solve various multimodal graphics tasks. However, existing approaches predominantly train separate models for each specific problem setting. This practice locks models into fixed input-output mappings, and typically ignores the joint correlations across modalities. In this paper, we present UniVidX , a unified multimodal framework designed to leverage VDM priors to enable versatile video generation. Our goal is to (i) master diverse pixel-aligned tasks by formulating them as conditional generation problems within multimodal space, (ii) adapt to modality-specific distributions without compromising the backbone's native priors, and (iii) ensure cross-modal consistency during synthesis. Concretely, we propose three key designs: 1) Stochastic Condition Masking (SCM): by randomly partitioning modalities into clean conditions and noisy targets during training, we enable the model to learn omni-directional conditional generation rather than fixed mappings. 2) Decoupled Gated LoRA (DGL): we attach per-modality LoRAs and activate them when a modality serves as a generation target, thereby preserving the VDM's strong priors. 3) Cross-Modal Self-Attention (CMSA): we explicitly share keys/values across modalities while maintaining modality-specific queries, facilitating information exchange and inter-modal alignment. We validate our framework by instantiating it in two domains: 1) UniVid-Intrinsic for RGB videos and their intrinsic maps (albedo, irradiance, normal), and 2) UniVid-Alpha for blended RGB videos and their constituent RGBA layers. Experimental results demonstrate that both models achieve performance competitive with state-of-the-art methods across distinct tasks. Notably, they exhibit robust generalization capabilities in in-the-wild scenarios, even when trained on limited datasets of fewer than 1k videos.

10 September 2026
Verified
Book Chapter
Closed access
PDF file
PQPengyun Qiu
Pengyun Qiu
SWShuo Wang
Shuo Wang
ZCZeyuan Chen
Zeyuan Chen
YZYihao Zhi
Yihao Zhi
CYChongjie Ye
Chongjie Ye
XHXiaoguang Han
Xiaoguang Han