Comprehensive Facial Performance Capture

Simple item page
dc.contributor.authorFyffe, Grahamen_US
dc.contributor.authorHawkins, Timen_US
dc.contributor.authorWatts, Chrisen_US
dc.contributor.authorMa, Wan-Chunen_US
dc.contributor.authorDebevec, Paulen_US
dc.contributor.editorM. Chen and O. Deussenen_US
dc.date.accessioned2015-02-27T10:21:45Z
dc.date.available2015-02-27T10:21:45Z
dc.date.issued2011en_US
dc.description.abstractWe present a system for recording a live dynamic facial performance, capturing highly detailed geometry and spatially varying diffuse and specular reflectance information for each frame of the performance. The result is a reproduction of the performance that can be rendered from novel viewpoints and novel lighting conditions, achieving photorealistic integration into any virtual environment. Dynamic performances are captured directly, without the need for any template geometry or static geometry scans, and processing is completely automatic, requiring no human input or guidance. Our key contributions are a heuristic for estimating facial reflectance information from gradient illumination photographs, and a geometry optimization framework that maximizes a principled likelihood function combining multi-view stereo correspondence and photometric stereo, using multiresolution belief propagation. The output of our system is a sequence of geometries and reflectance maps, suitable for rendering in off-the-shelf software. We show results from our system rendered under novel viewpoints and lighting conditions, and validate our results by demonstrating a close match to ground truth photographsen_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.identifier.issn1467-8659en_US
dc.identifier.urihttps://doi.org/10.1111/j.1467-8659.2011.01888.xen_US
dc.publisherThe Eurographics Association and Blackwell Publishing Ltd.en_US
dc.titleComprehensive Facial Performance Captureen_US
Files
Collections
30-Issue 2
Full Papers 2011 - CGF 30-Issue 2