Tien-Tsin Wong

Tien-Tsin Wong

Auto-generated profile, based on publicly available information

Tien-Tsin Wong

Department of Data Science & AI, Faculty of Information Technology, Monash University, Melbourne, Australia

Research Focus & Metrics

Representative Publications

View All Publications
23 September 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
WYWangbo Yu
Wangbo Yu
JXJinbo Xing
Jinbo Xing
YLYuan Li
Yuan Li
WHWenbo Hu
Wenbo Hu
XLXiaoyu Li
Xiaoyu Li
YTYonghong Tian
Yonghong Tian
Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. In this work, we propose ViewCrafter, a novel method for synthesizing high-fidelity novel views from single or sparse images with the prior of video diffusion model. Our method takes advantage of the powerful generation capabilities of video diffusion model and the coarse 3D clues offered by point-based representation to generate high-quality video frames with significantly improved camera pose control accuracy. To further enlarge the generation range of novel views, we tailored a progressive view synthesis strategy to expand the point cloud and the areas covered by the novel views, which can be further integrated with a camera trajectory planning algorithm to automatically reveal and address occlusions in different scenes. With ViewCrafter, we can facilitate various applications, such as immersive experiences with real-time rendering by efficiently optimizing a 3D-GS representation using the reconstructed 3D points and the generated novel views, and scene-level text-to-3D generation for more imaginative content creation. Extensive experiments on diverse datasets demonstrate the strong generalization capability and superior performance of our method in synthesizing high-fidelity novel views. Our project webpage and code are available at https://drexubery.github.io/ViewCrafter/.

1 October 2024
Verified
Book Chapter
Closed access
PDF file
JXJinbo Xing
Jinbo Xing
MXMenghan Xia
Menghan Xia
YZYong Zhang
Yong Zhang
HCHaoxin Chen
Haoxin Chen
WYWangbo Yu
Wangbo Yu
TWTien-Tsin Wong
Tien-Tsin Wong

1 January 1997 in Journal of Graphics Tools
Verified
Journal Article
Closed access
TWTien-Tsin Wong
Tien-Tsin Wong
WLWai-Shing Luk
Wai-Shing Luk
PHPheng-Ann Heng
Pheng-Ann Heng
The Hammersley and Halton point sets, two well-known, low discrepancy sequences, have been used for quasi-Monte Carlo integration in previous research. A deterministic formula generates a uniformly distributed and stochasticlooking sampling pattern at low computational cost. The Halton point set is also useful for incremental sampling. In this paper, we discuss detailed implementation issues and our experience of choosing suitable bases for the point sets, not just on the two-dimensional plane but also on a spherical surface. The sampling scheme is also applied to ray tracing, with a significant improvement in error over standard sampling techniques.

14 February 2024 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Open access
JXJinbo Xing
Jinbo Xing
MXMenghan Xia
Menghan Xia
YLYuxin Liu
Yuxin Liu
YZYuechen Zhang
Yuechen Zhang
YZYong Zhang
Yong Zhang
TWTien-Tsin Wong
Tien-Tsin Wong
Creating a vivid video from the event or scenario in our imagination is a truly fascinating experience. Recent advancements in text-to-video synthesis have unveiled the potential to achieve this with prompts only. While text is convenient in conveying the overall scene context, it may be insufficient to control precisely. In this paper, we explore customized video generation by utilizing text as context description and motion structure (e.g., frame-wise depth) as concrete guidance. Our method, dubbed Make-Your-Video, involves joint-conditional video generation using a Latent Diffusion Model that is pre-trained for still image synthesis and then promoted for video generation with the introduction of temporal modules. This two-stage learning scheme not only reduces the computing resources required, but also improves the performance by transferring the rich concepts available in image datasets solely into video generation. Moreover, we use a simple yet effective causal attention mask strategy to enable longer video synthesis, which mitigates the potential quality degradation effectively. Experimental results show the superiority of our method over existing baselines, particularly in terms of temporal coherence and fidelity to users’ guidance. In addition, our model enables several intriguing applications that demonstrate potential for practical usage.

19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
JXJinbo Xing
Jinbo Xing
HLHanyuan Liu
Hanyuan Liu
MXMenghan Xia
Menghan Xia
YZYong Zhang
Yong Zhang
XWXintao Wang
Xintao Wang
TWTien-Tsin Wong
Tien-Tsin Wong
We introduce ToonCrafter, a novel approach that transcends traditional correspondence-based cartoon video interpolation, paving the way for generative interpolation. Traditional methods, that implicitly assume linear motion and the absence of complicated phenomena like dis-occlusion, often struggle with the exaggerated non-linear and large motions with occlusion commonly found in cartoons, resulting in implausible or even failed interpolation results. To overcome these limitations, we explore the potential of adapting live-action video priors to better suit cartoon interpolation within a generative framework. ToonCrafter effectively addresses the challenges faced when applying live-action video motion priors to generative cartoon interpolation. First, we design a toon rectification learning strategy that seamlessly adapts live-action video priors to the cartoon domain, resolving the domain gap and content leakage issues. Next, we introduce a dual-reference-based 3D decoder to compensate for lost details due to the highly compressed latent prior spaces, ensuring the preservation of fine details in interpolation results. Finally, we design a flexible sketch encoder that empowers users with interactive control over the interpolation results. Experimental results demonstrate that our proposed method not only produces visually convincing and more natural dynamics, but also effectively handles dis-occlusion. The comparative evaluation demonstrates the notable superiority of our approach over existing competitors. Code and model weights are available at https://doubiiu.github.io/projects/ToonCrafter

3 December 2024
Verified
Conference Paper
Open access
YLYuxin Liu
Yuxin Liu
MXMinshan Xie
Minshan Xie
HLHanyuan Liu
Hanyuan Liu
TWTien-Tsin Wong
Tien-Tsin Wong