hide
Free keywords:
-
Abstract:
Free-Viewpoint Video of Human Actors allows photo-
realistic rendering of real-world people under novel viewing
conditions. Dynamic Reflectometry extends the concept of free-view point
video
and allows rendering in addition under novel lighting
conditions. In this work, we present an enhanced method for capturing
human shape and motion as well as dynamic surface reflectance
properties from a sparse set of input video streams.
We augment our initial method for model-based relightable
free-viewpoint video in several ways. Firstly, a single-skin
mesh is introduced for the continuous appearance of the model.
Moreover an algorithm to detect and
compensate lateral shifting of textiles in order to improve
temporal texture registration is presented. Finally, a
structured resampling approach is introduced which enables
reliable estimation of spatially varying surface reflectance
despite a static recording setup.
The new algorithm ingredients along with the Relightable 3D
Video framework enables us to realistically reproduce the
appearance of animated virtual actors under different
lighting conditions, as well as to interchange surface
attributes among different people, e.g. for virtual
dressing. Our contribution can be used to create 3D
renditions of real-world people under arbitrary novel
lighting conditions on standard graphics hardware.