Jean-Yves Guillemaut

Dr. Jean-Yves Guillemaut

orcid

Research Focus & Metrics

Academic Career Length

23Years (2004-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 December 2010 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
JGJean-Yves Guillemaut
Jean-Yves Guillemaut
AHAdrian Hilton
Adrian Hilton

1 June 2012 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
HKHansung Kim
Hansung Kim
JGJean-Yves Guillemaut
Jean-Yves Guillemaut
TTTakeshi Takai
Takeshi Takai
MSMuhammad Sarim
Muhammad Sarim
AHAdrian Hilton
Adrian Hilton
Existing systems for 3-D reconstruction from multiple view video use controlled indoor environments with uniform illumination and backgrounds to allow accurate segmentation of dynamic foreground objects. In this paper, we present a portable system for 3-D reconstruction of dynamic outdoor scenes that require relatively large capture volumes with complex backgrounds and nonuniform illumination. This is motivated by the demand for 3-D reconstruction of natural outdoor scenes to support film and broadcast production. Limitations of existing multiple view 3-D reconstruction techniques for use in outdoor scenes are identified. Outdoor 3-D scene reconstruction is performed in three stages: 1) 3-D background scene modeling using spherical stereo image capture; 2) multiple view segmentation of dynamic foreground objects by simultaneous video matting across multiple views; and 3) robust 3-D foreground reconstruction and multiple view segmentation refinement in the presence of segmentation and calibration errors. Evaluation is performed on several outdoor productions with complex dynamic scenes including people and animals. Results demonstrate that the proposed approach overcomes limitations of previous indoor multiple view reconstruction approaches enabling high-quality free-viewpoint rendering and 3-D reference models for production.

9 June 2021 in Computer Graphics Forum
Verified
Journal Article
Open access
PDF file
FEFarshad Einabadi
Farshad Einabadi
JGJean-Yves Guillemaut
Jean-Yves Guillemaut
AHAdrian Hilton
Adrian Hilton
Scene relighting and estimating illumination of a real scene for insertion of virtual objects in a mixed‐reality scenario are well‐studied challenges in the computer vision and graphics fields. Classical inverse rendering approaches aim to decompose a scene into its orthogonal constituting elements, namely scene geometry, illumination and surface materials, which can later be used for augmented reality or to render new images under novel lighting or viewpoints. Recently, the application of deep neural computing to illumination estimation, relighting and inverse rendering has shown promising results. This contribution aims to bring together in a coherent manner current advances in this conjunction. We examine in detail the attributes of the proposed approaches, presented in three categories: scene illumination estimation, relighting with reflectance‐aware scene‐specific representations and finally relighting as image‐to‐image transformations. Each category is concluded with a discussion on the main characteristics of the current methods and possible future trends. We also provide an overview of current publicly available datasets for neural lighting applications.

1 September 2019 in Pattern Recognition
Verified
Journal Article
Open access
MBMark Brown
Mark Brown
David WindridgeDavid Windridge
David Windridge
JGJean-Yves Guillemaut
Jean-Yves Guillemaut

1 September 2009
Verified
Conference Paper
Closed access
JGJean-Yves Guillemaut
Jean-Yves Guillemaut
JKJoe Kilner
Joe Kilner
AHAdrian Hilton
Adrian Hilton
Current state-of-the-art image-based scene reconstruction techniques are capable of generating high-fidelity 3D models when used under controlled capture conditions. However, they are often inadequate when used in more challenging outdoor environments with moving cameras. In this case, algorithms must be able to cope with relatively large calibration and segmentation errors as well as input images separated by a wide-baseline and possibly captured at different resolutions. In this paper, we propose a technique which, under these challenging conditions, is able to efficiently compute a high-quality scene representation via graph-cut optimisation of an energy function combining multiple image cues with strong priors. Robustness is achieved by jointly optimising scene segmentation and multiple view reconstruction in a view-dependent manner with respect to each input camera. Joint optimisation prevents propagation of errors from segmentation to reconstruction as is often the case with sequential approaches. View-dependent processing increases tolerance to errors in on-the-fly calibration compared to global approaches. We evaluate our technique in the case of challenging outdoor sports scenes captured with manually operated broadcast cameras and demonstrate its suitability for high-quality free-viewpoint video.

9 March 2012
Verified
Conference Paper
Open access
PDF file
DCDan Casas
Dan Casas
MTMargara Tejera
Margara Tejera
JGJean-Yves Guillemaut
Jean-Yves Guillemaut
AHAdrian Hilton
Adrian Hilton
A 4D parametric motion graph representation is presented for interactive animation from actor performance capture in a multiple camera studio. The representation is based on a 4D model database of temporally aligned mesh sequence reconstructions for multiple motions. High-level movement controls such as speed and direction are achieved by blending multiple mesh sequences of related motions. A real-time mesh sequence blending approach is introduced which combines the realistic deformation of previous non-linear solutions with efficient online computation. Transitions between different parametric motion spaces are evaluated in real-time based on surface shape and motion similarity. 4D parametric motion graphs allow real-time interactive character animation while preserving the natural dynamics of the captured performance. © 2012 ACM