Yu Hong

Yu Hong

Auto-generated profile, based on publicly available information

Yu Hong

ShanghaiTech University, Shanghai, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
YJYuheng Jiang
Yuheng Jiang
ZSZhehao Shen
Zhehao Shen
YHYu Hong
Yu Hong
CGChengcheng Guo
Chengcheng Guo
YWYize Wu
Yize Wu
LXLan Xu
Lan Xu
Volumetric video represents a transformative advancement in visual media, enabling users to freely navigate immersive virtual experiences and narrowing the gap between digital and real worlds. However, the need for extensive manual intervention to stabilize mesh sequences and the generation of excessively large assets in existing workflows impedes broader adoption. In this paper, we present a novel Gaussian-based approach, dubbed DualGS , for real-time and high-fidelity playback of complex human performance with excellent compression ratios. Our key idea in DualGS is to separately represent motion and appearance using the corresponding skin and joint Gaussians. Such an explicit disentanglement can significantly reduce motion redundancy and enhance temporal coherence. We begin by initializing the DualGS and anchoring skin Gaussians to joint Gaussians at the first frame. Subsequently, we employ a coarse-to-fine training strategy for frame-by-frame human performance modeling. It includes a coarse alignment phase for overall motion prediction as well as a fine-grained optimization for robust tracking and high-fidelity rendering. To integrate volumetric video seamlessly into VR environments, we efficiently compress motion using entropy encoding and appearance using codec compression coupled with a persistent codebook. Our approach achieves a compression ratio of up to 120 times, only requiring approximately 350KB of storage per frame. We demonstrate the efficacy of our representation through photo-realistic, free-view experiences on VR headsets, enabling users to immersively watch musicians in performance and feel the rhythm of the notes at the performers' fingertips. Project page: https://nowheretrix.github.io/DualGS/.

27 October 2025
Verified
Conference Paper
Open access
YHYu Hong
Yu Hong
YWYize Wu
Yize Wu
ZSZhehao Shen
Zhehao Shen
CGChengcheng Guo
Chengcheng Guo
YJYuheng Jiang
Yuheng Jiang
LXLan Xu
Lan Xu

14 December 2025
Verified
Conference Paper
Open access
YJYuheng Jiang
Yuheng Jiang
CGChengcheng Guo
Chengcheng Guo
YWYize Wu
Yize Wu
YHYu Hong
Yu Hong
SZShengkun Zhu
Shengkun Zhu
CTChristian Theobalt
Christian Theobalt

17 March 2026 in Visual Intelligence
Verified
Journal Article
Open access
SZShengkun Zhu
Shengkun Zhu
CGChengcheng Guo
Chengcheng Guo
YLYuanji Lu
Yuanji Lu
ZSZhehao Shen
Zhehao Shen
YWYize Wu
Yize Wu
JYJingyi Yu
Jingyi Yu
Volumetric video is revolutionizing immersive media, with 3D Gaussian Splatting emerging as a key technology due to its unprecedented real-time rendering quality. However, extending this technology to dynamic scenes presents two major challenges: the massive storage and transmission overhead associated with temporal sequences, and a fragmented toolchain ecosystem that hinders efficient research and development. Existing solutions typically focus on isolated stages such as reconstruction or compression, lacking a unified, end-to-end workflow from data acquisition to final viewing. To address these challenges, we propose a comprehensive dynamic Gaussian processing framework that provides a complete, end-to-end pipeline. This framework systematically integrates the entire process, from data acquisition and standardized preprocessing to a suite of diverse dynamic Gaussian reconstruction algorithms. One of its core contributions is a general-purpose compression framework, compatible with the outputs of various reconstruction methods, which significantly reduces the storage footprint of dynamic sequences while maintaining high visual fidelity. To ensure broad accessibility, we have also developed a cross-platform rendering solution that supports high-quality, interactive free-viewpoint experiences on desktop, mobile, and XR devices. Furthermore, to advance the field, we contribute a large-scale, high-quality dynamic human performance capture dataset. Captured with a dense 81-camera array, the dataset comprises over 130 sequences of diverse human motions, including complex interactions with topological changes. Our integrated framework and dataset aim to bridge the entire pipeline from data creation to end-user application, providing a solid foundation for the large-scale adoption and future research of Gaussian Splatting technology.