Shunsuke Saito

Shunsuke Saito

Auto-generated profile, based on publicly available information

Shunsuke Saito

Codec Avatars Lab, Meta

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 May 2022 in Computer Graphics Forum
Verified
Journal Article
Closed access
YXYiheng Xie
Yiheng Xie
TTTowaki Takikawa
Towaki Takikawa
SSShunsuke Saito
Shunsuke Saito
OLOr Litany
Or Litany
SYShiqin Yan
Shiqin Yan
SSSrinath Sridhar
Srinath Sridhar


17 November 2024
Verified
Book Chapter
Closed access
PDF file
GMGyeongsik Moon
Gyeongsik Moon
TSTakaaki Shiratori
Takaaki Shiratori
SSShunsuke Saito
Shunsuke Saito

26 July 2023 in ACM Transactions on Graphics
Verified
Journal Article
Open access
YSYuefan Shen
Yuefan Shen
SSShunsuke Saito
Shunsuke Saito
ZWZiyan Wang
Ziyan Wang
OMOlivier Maury
Olivier Maury
CWChenglei Wu
Chenglei Wu
GNGiljoo Nam
Giljoo Nam
We introduce CT2Hair, a fully automatic framework for creating high-fidelity 3D hair models that are suitable for use in downstream graphics applications. Our approach utilizes real-world hair wigs as input, and is able to reconstruct hair strands for a wide range of hair styles. Our method leverages computed tomography (CT) to create density volumes of the hair regions, allowing us to see through the hair unlike image-based approaches which are limited to reconstructing the visible surface. To address the noise and limited resolution of the input density volumes, we employ a coarse-to-fine approach. This process first recovers guide strands with estimated 3D orientation fields, and then populates dense strands through a novel neural interpolation of the guide strands. The generated strands are then refined to conform to the input density volumes. We demonstrate the robustness of our approach by presenting results on a wide variety of hair styles and conducting thorough evaluations on both real-world and synthetic datasets. Code and data for this paper are at github.com/facebookresearch/CT2Hair.

3 December 2024
Verified
Conference Paper
Open access
JLJunxuan Li
Junxuan Li
CCChen Cao
Chen Cao
GSGabriel Schwartz
Gabriel Schwartz
RKRawal Khirodkar
Rawal Khirodkar
CRChristian Richardt
Christian Richardt
SSShunsuke Saito
Shunsuke Saito

10 December 2023
Verified
Conference Paper
Open access
BABadour Albahar
Badour Albahar
SSShunsuke Saito
Shunsuke Saito
HTHung-Yu Tseng
Hung-Yu Tseng
CKChangil Kim
Changil Kim
JKJohannes Kopf
Johannes Kopf
JHJia-Bin Huang
Jia-Bin Huang
We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing approaches taking monocular input either rely on ground-truth 3D scans for supervision or lack 3D consistency. While recent 3D generative models show promise of 3D consistent human digitization, these approaches do not generalize well to diverse clothing appearances, and the results lack photorealism. Unlike existing work, we utilize high-capacity 2D diffusion models pretrained for general image synthesis tasks as an appearance prior of clothed humans. To achieve better 3D consistency while retaining the input identity, we progressively synthesize multiple views of the human in the input image by inpainting missing regions with shape-guided diffusion conditioned on silhouette and surface normal. We then fuse these synthesized multi-view images via inverse rendering to obtain a fully textured high-resolution 3D mesh of the given person. Experiments show that our approach outperforms prior methods and achieves photorealistic 360-degree synthesis of a wide range of clothed humans with complex textures from a single image.