hide
Free keywords:
-
Abstract:
Captured reflectance fields tend to provide a relatively coarse sampling of the
incident light directions. As a result, sharp illumination features, such as
highlights or shadow boundaries, are poorly reconstructed during relighting;
highlights are disconnected, and shadows show banding artefacts. In this paper,
we propose a novel
interpolation technique for 4D reflectance fields that reconstructs plausible
images even for non-observed light directions. Given a sparsely sampled
reflectance field, we can effectively synthesize images as they would have been
obtained from denser sampling. The processing pipeline consists of three steps:
(1) segmentation of regions where intermediate lighting cannot be obtained by
blending, (2) appropriate flow algorithms for highlights and shadows, plus (3)
a final reconstruction technique that uses image-based priors to faithfully
correct errors that
might be introduced by the segmentation or flow step. The algorithm reliably
reproduces scenes that contain specular highlights, interreflections, shadows
or caustics.