Tony Tung

Tony Tung

Auto-generated profile, based on publicly available information

Tony Tung

Facebook Reality Labs Research USA

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 October 2018
Verified
Book Chapter
Closed access
PDF file
ZLZorah Lähner
Zorah Lähner
DCDaniel Cremers
Daniel Cremers
TTTony Tung
Tony Tung

3 November 2022
Verified
Book Chapter
Closed access
PDF file
GTGarvita Tiwari
Garvita Tiwari
DADimitrije Antić
Dimitrije Antić
JLJan Eric Lenssen
Jan Eric Lenssen
NSNikolaos Sarafianos
Nikolaos Sarafianos
TTTony Tung
Tony Tung
GPGerard Pons-Moll
Gerard Pons-Moll

20 October 2024
Verified
Book Chapter
Closed access
PDF file
MMMarko Mihajlovic
Marko Mihajlovic
SPSergey Prokudin
Sergey Prokudin
Siyu TangSiyu Tang
Siyu Tang
RMRobert Maier
Robert Maier
FBFederica Bogo
Federica Bogo
EBEdmond Boyer
Edmond Boyer

1 June 2013
Verified
Conference Paper
Open access
TTTony Tung
Tony Tung
TMTakashi Matsuyama
Takashi Matsuyama
This paper presents a novel approach to characterize deformable surface using intrinsic property dynamics. 3D dynamic surfaces representing humans in motion can be obtained using multiple view stereo reconstruction methods or depth cameras. Nowadays these technologies have become capable to capture surface variations in real-time, and give details such as clothing wrinkles and deformations. Assuming repetitive patterns in the deformations, we propose to model complex surface variations using sets of linear dynamical systems (LDS) where observations across time are given by surface intrinsic properties such as local curvatures. We introduce an approach based on bags of dynamical systems, where each surface feature to be represented in the codebook is modeled by a set of LDS equipped with timing structure. Experiments are performed on datasets of real-world dynamical surfaces and show compelling results for description, classification and segmentation.

10 March 2025 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
SZShihao Zou
Shihao Zou
YXYuanlu Xu
Yuanlu Xu
NSNikolaos Sarafianos
Nikolaos Sarafianos
FBFederica Bogo
Federica Bogo
TTTony Tung
Tony Tung
LCLi Cheng
Li Cheng
Clothed human modeling plays a crucial role in multimedia research, with applications spanning virtual reality, gaming, and fashion design. The goal is to learn clothed human dynamics from observations and then generate humans with high-fidelity clothing details for motion animation. Despite tremendous advancements in clothing shape analysis by existing approaches, the community still faces challenges in generating convincing visual effects of cloth dynamics, maintaining temporally smooth clothing details, and handling diverse clothing patterns. To address these challenges, we introduce ClothDiffuse, a temporal diffusion model that seamlessly integrates three key components into this task—temporal dynamics modeling, iterative refinement, and diversified generation. Our approach begins by using an encoder to extract high-level temporal features from input human body motions. These features are combined with a learnable pixel-aligned garment feature, serving as prior conditions for the shape decoder. The decoder then iteratively denoise Gaussian noise to produce clothing deformations over time on the input unclothed human bodies. To ensure that the results align with observations and adhere to physical plausibility for clothing shape inference, we propose two physics-inspired loss functions that preserve the intra-frame distances and inter-frame forces of clothing points. Additionally, the stochastic nature of the denoising process allows for the generation of diverse and plausible clothing shapes. Experiments show that our approach outperforms state-of-the-art methods in chamfer distance and visual effects, particularly for loose clothing such as dresses and skirts. Furthermore, our approach effectively adapts to out-of-domain clothing types and generates realistic clothes dynamics.

9 October 2019 in arXiv
Verified
Preprint
Open access
PDF file
YXYuanlu Xu
Yuanlu Xu
SZSong-Chun Zhu
Song-Chun Zhu
TTTony Tung
Tony Tung
We present DenseRaC, a novel end-to-end framework for jointly estimating 3D human pose and body shape from a monocular RGB image. Our two-step framework takes the body pixel-to-surface correspondence map (i.e., IUV map) as proxy representation and then performs estimation of parameterized human pose and shape. Specifically, given an estimated IUV map, we develop a deep neural network optimizing 3D body reconstruction losses and further integrating a render-and-compare scheme to minimize differences between the input and the rendered output, i.e., dense body landmarks, body part masks, and adversarial priors. To boost learning, we further construct a large-scale synthetic dataset (MOCA) utilizing web-crawled Mocap sequences, 3D scans and animations. The generated data covers diversified camera views, human actions and body shapes, and is paired with full ground truth. Our model jointly learns to represent the 3D human body from hybrid datasets, mitigating the problem of unpaired training data. Our experiments show that DenseRaC obtains superior performance against state of the art on public benchmarks of various humanrelated tasks.