Daoye Wang

Daoye Wang

Auto-generated profile, based on publicly available information

Daoye Wang

Google, Zurich, Switzerland

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
YZYuxiao Zhou
Yuxiao Zhou
MCMenglei Chai
Menglei Chai
DWDaoye Wang
Daoye Wang
SWSebastian Winberg
Sebastian Winberg
EWErroll Wood
Erroll Wood
TBThabo Beeler
Thabo Beeler
Despite recent advances in multi-view hair reconstruction, achieving strand-level precision remains a significant challenge due to inherent limitations in existing capture pipelines. We introduce GroomCap , a novel multi-view hair capture method that reconstructs faithful and high-fidelity hair geometry without relying on external data priors. To address the limitations of conventional reconstruction algorithms, we propose a neural implicit representation for hair volume that encodes high-resolution 3D orientation and occupancy from input views. This implicit hair volume is trained with a new volumetric 3D orientation rendering algorithm, coupled with 2D orientation distribution supervision, to effectively prevent the loss of structural information caused by undesired orientation blending. We further propose a Gaussian-based hair optimization strategy to refine the traced hair strands with a novel chained Gaussian representation, utilizing direct photometric supervision from images. Our results demonstrate that GroomCap is able to capture high-quality hair geometries that are not only more precise and detailed than existing methods but also versatile enough for a range of applications.

10 December 2023
Verified
Conference Paper
Open access
KSKripasindhu Sarkar
Kripasindhu Sarkar
MBMarcel C. Bühler
Marcel C. Bühler
GLGengyan Li
Gengyan Li
DWDaoye Wang
Daoye Wang
DVDelio Vicini
Delio Vicini
AMAbhimitra Meka
Abhimitra Meka
High-fidelity, photorealistic 3D capture of a human face is a long-standing problem in computer graphics – the complex material of skin, intricate geometry of hair, and fine scale textural details make it challenging. Traditional techniques rely on very large and expensive capture rigs to reconstruct explicit mesh geometry and appearance maps, and are limited by the accuracy of hand-crafted reflectance models. More recent volumetric methods (e.g., NeRFs) have enabled view-synthesis and sometimes relighting by learning an implicit representation of the density and reflectance basis, but suffer from artifacts and blurriness due to the inherent ambiguities in volumetric modeling. These problems are further exacerbated when capturing with few cameras and light sources. We present a novel technique for high-quality capture of a human face for 3D view synthesis and relighting using a sparse, compact capture rig consisting of 15 cameras and 15 lights. Our method combines a neural volumetric representation with traditional mesh reconstruction from multiview stereo. The proxy geometry allows us to anchor the 3D density field to prevent artifacts and guide the disentanglement of intrinsic radiance components of the face appearance such as diffuse and specular reflectance, and incident radiance (shadowing) fields. Our hybrid representation significantly improves the state-of-the-art quality for arbitrarily dense renders of a face from desired camera viewpoint as well as environmental, directional, and near-field lighting.

3 December 2024
Verified
Conference Paper
Open access
MBMarcel C. Buehler
Marcel C. Buehler
GLGengyan Li
Gengyan Li
EWErroll Wood
Erroll Wood
LHLeonhard Helminger
Leonhard Helminger
XCXu Chen
Xu Chen
KSKripasindhu Sarkar
Kripasindhu Sarkar

28 May 2021 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
AAA A
A A
JPJinshan Pan
Jinshan Pan
DWDaoye Wang
Daoye Wang
SZShangchen Zhou
Shangchen Zhou
XWXing Wei
Xing Wei
JRJimmy Ren
Jimmy Ren
Deblurring can not only provide visually more pleasant pictures and make photography more convenient, but also can improve the performance of objection detection as well as tracking. However, removing dynamic scene blur from images is a non-trivial task as it is difficult to model the non-uniform blur mathematically. Several methods first use single or multiple images to estimate optical flow (which is treated as an approximation of blur kernels) and then adopt non-blind deblurring algorithms to reconstruct the sharp images. However, these methods cannot be trained in an end-to-end manner and are usually computationally expensive. In this paper, we explore optical flow to remove dynamic scene blur by using the multi-scale spatially variant recurrent neural network (RNN). We utilize FlowNets to estimate optical flow from two consecutive images in different scales. The estimated optical flow provides the RNN weights in different scales so that the weights can better help RNNs to remove blur in the feature spaces. Finally, we develop a convolutional neural network (CNN) to restore the sharp images from the deblurred features. Both quantitatively and qualitatively evaluations on the benchmark datasets demonstrate that the proposed method performs favorably against state-of-the-art algorithms in terms of accuracy, speed, and model size.

24 April 2024 in Computer Graphics Forum
Verified
Journal Article
Closed access
JBJ. Bednarik
J. Bednarik
EWE. Wood
E. Wood
VCV. Choutas
V. Choutas
TBT. Bolkart
T. Bolkart
DWD. Wang
D. Wang
TBT. Beeler
T. Beeler

19 July 2026
Verified
Conference Paper
Open access
TBTimo Bolkart
Timo Bolkart
DWDaoye Wang
Daoye Wang
PCPrashanth Chandran
Prashanth Chandran
We present SHELLS (Semantic Head Estimation via Layered Local Sampling), an efficient feed-forward framework for 3D head reconstruction in dense semantic correspondence from multi-view images. Existing methods typically refine vertices independently via localized feature volumes. This approach couples memory-intensive feature sampling to mesh resolution, which limits scalability for dense topologies (≥ 10k vertices) and introduces surface noise. In contrast, SHELLS decouples feature extraction from mesh resolution via a hierarchical sampling strategy. We extract multi-view features using a DinoV2 backbone with LoRA adaptation, projectively sample a sparse global feature cloud, and predict an intermediate coarse mesh. This coarse prior guides the construction of layered, surface-aware sampling shells that serve as a discrete search space for the final reconstruction. SHELLS maintains surface consistency while using 88% less inference GPU memory (∼ 2.4GB vs. ∼ 20GB) than volumetric baselines. It reduces median registration error by 21% to 29% with a 3.5 × inference speedup (0.08s vs. 0.29s) for 18k-vertex meshes. Notably, our model is trained exclusively on synthetic data yet generalizes effectively to real-world captures, eliminating the need for the costly, pre-registered multi-view datasets common in prior work.