Face/Off: Live Facial Puppetry
Loading...
Date
2009
Journal Title
Journal ISSN
Volume Title
Publisher
ACM SIGGRAPH / Eurographics Association
Abstract
We present a complete integrated system for live facial puppetry that enables high-resolution real-time facial expression tracking with transfer to another person's face. The system utilizes a real-time structured light scanner that provides dense 3D data and texture. A generic template mesh, fitted to a rigid reconstruction of the actor's face, is tracked offline in a training stage through a set of expression sequences. These sequences are used to build a person-specific linear face model that is subsequently used for online face tracking and expression transfer. Even with just a single rigid pose of the target face, convincing real-time facial animations are achievable. The actor becomes a puppeteer with complete and accurate control over a digital face.
Description
@inproceedings{10.1145:1599470.1599472,
booktitle = {Eurographics/ ACM SIGGRAPH Symposium on Computer Animation},
editor = {Eitan Grinspun and Jessica Hodgins},
title = {{Face/Off: Live Facial Puppetry}},
author = {Weise, Thibaut and Li, Hao and Gool, Luc Van and Pauly, Mark},
year = {2009},
publisher = {ACM SIGGRAPH / Eurographics Association},
ISSN = {1727-5288},
ISBN = {978-1-60558-610-6},
DOI = {10.1145/1599470.1599472}
}