Jingyu Zhuang

Jingyu Zhuang

Auto-generated profile, based on publicly available information

Jingyu Zhuang

Vivo BlueImage Lab

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 December 2023
Verified
Conference Paper
Open access
JZJingyu Zhuang
Jingyu Zhuang
CWChen Wang
Chen Wang
LLLiang Lin
Liang Lin
LLLingjie Liu
Lingjie Liu
GLGuanbin Li
Guanbin Li
Neural fields have achieved impressive advancements in view synthesis and scene reconstruction. However, editing these neural fields remains challenging due to the implicit encoding of geometry and texture information. In this paper, we propose DreamEditor, a novel framework that enables users to perform controlled editing of neural fields using text prompts. By representing scenes as mesh-based neural fields, DreamEditor allows localized editing within specific regions. DreamEditor utilizes the text encoder of a pretrained text-to-Image diffusion model to automatically identify the regions to be edited based on the semantics of the text prompts. Subsequently, DreamEditor optimizes the editing region and aligns its geometry and texture with the text prompts through score distillation sampling [Poole et al. 2022]. Extensive experiments have demonstrated that DreamEditor can accurately edit neural fields of real-world scenes according to the given text prompts while ensuring consistency in irrelevant areas. DreamEditor generates highly realistic textures and geometry, significantly surpassing previous works in both quantitative and qualitative evaluations.

19 July 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
JZJingyu Zhuang
Jingyu Zhuang
DKDi Kang
Di Kang
YCYan-Pei Cao
Yan-Pei Cao
GLGuanbin Li
Guanbin Li
LLLiang Lin
Liang Lin
YSYing Shan
Ying Shan
Text-driven 3D scene editing has gained significant attention owing to its convenience and user-friendliness. However, existing methods still lack accurate control of the specified appearance and location of the editing result due to the inherent limitations of the text description. To this end, we propose a 3D scene editing framework, TIP-Editor, that accepts both text and image prompts and a 3D bounding box to specify the editing region. With the image prompt, users can conveniently specify the detailed appearance/style of the target content in complement to the text description, enabling accurate control of the appearance. Specifically, TIP-Editor employs a stepwise 2D personalization strategy to better learn the representation of the existing scene and the reference image, in which a localization loss is proposed to encourage correct object placement as specified by the bounding box. Additionally, TIP-Editor utilizes explicit and flexible 3D Gaussian splatting (GS) as the 3D representation to facilitate local editing while keeping the background unchanged. Extensive experiments have demonstrated that TIP-Editor conducts accurate editing following the text and image prompts in the specified bounding box region, consistently outperforming the baselines in editing quality, and the alignment to the prompts, qualitatively and quantitatively.

20 May 2021 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
ZCZiliang Chen
Ziliang Chen
PWPengxu Wei
Pengxu Wei
JZJingyu Zhuang
Jingyu Zhuang
GLGuanbin Li
Guanbin Li
LLLiang Lin
Liang Lin

16 September 2026
Verified
Book Chapter
Closed access
PDF file
XZXiyu Zhang
Xiyu Zhang
JZJingyu Zhuang
Jingyu Zhuang
HZHongjia Zhai
Hongjia Zhai
ZYZizheng Yan
Zizheng Yan
JCJinwei Chen
Jinwei Chen
QFQingnan Fan
Qingnan Fan