Capturing Relightable Human Performances under General Uncontrolled Illumination

Simple item page
dc.contributor.authorLi, Guannanen_US
dc.contributor.authorWu, Chengleien_US
dc.contributor.authorStoll, Carstenen_US
dc.contributor.authorLiu, Yebinen_US
dc.contributor.authorVaranasi, Kiranen_US
dc.contributor.authorDai, Qionghaien_US
dc.contributor.authorTheobalt, Christianen_US
dc.contributor.editorI. Navazo, P. Poulinen_US
dc.date.accessioned2015-02-28T15:22:41Z
dc.date.available2015-02-28T15:22:41Z
dc.date.issued2013en_US
dc.description.abstractWe present a novel approach to create relightable free-viewpoint human performances from multi-view video recorded under general uncontrolled and uncalibated illumination.We first capture a multi-view sequence of an actor wearing arbitrary apparel and reconstruct a spatio-temporal coherent coarse 3D model of the performance using a marker-less tracking approach. Using these coarse reconstructions, we estimate the low-frequency component of the illumination in a spherical harmonics (SH) basis as well as the diffuse reflectance, and then utilize them to estimate the dynamic geometry detail of human actors based on shading cues. Given the high-quality time-varying geometry, the estimated illumination is extended to the all-frequency domain by re-estimating it in the wavelet basis. Finally, the high-quality all-frequency illumination is utilized to reconstruct the spatially-varying BRDF of the surface. The recovered time-varying surface geometry and spatially-varying non-Lambertian reflectance allow us to generate high-quality model-based free view-point videos of the actor under novel illumination conditions. Our method enables plausible reconstruction of relightable dynamic scene models without a complex controlled lighting apparatus, and opens up a path towards relightable performance capture in less constrained environments and using less complex acquisition setups.en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.identifier.issn1467-8659en_US
dc.identifier.urihttps://doi.org/10.1111/cgf.12047en_US
dc.publisherThe Eurographics Association and Blackwell Publishing Ltd.en_US
dc.subjectI.3.7 [Computer Graphics]en_US
dc.subjectThree Dimensional Graphics and Realismen_US
dc.subjectColoren_US
dc.subjectshadingen_US
dc.subjectshadowingen_US
dc.subjectand textureen_US
dc.titleCapturing Relightable Human Performances under General Uncontrolled Illuminationen_US
Files
Collections
32-Issue 2
Full Papers 2013 - CGF 32-Issue 2