Vision-based Control of 3D Facial Animation

Simple item page
dc.contributor.authorChai, Jin-xiangen_US
dc.contributor.authorXiao, Jingen_US
dc.contributor.authorHodgins, Jessicaen_US
dc.contributor.editorD. Breen and M. Linen_US
dc.date.accessioned2014-01-29T06:32:25Z
dc.date.available2014-01-29T06:32:25Z
dc.date.issued2003en_US
dc.description.abstractControlling and animating the facial expression of a computer-generated 3D character is a difficult problem because the face has many degrees of freedom while most available input devices have few. In this paper, we show that a rich set of lifelike facial actions can be created from a preprocessed motion capture database and that a user can control these actions by acting out the desired motions in front of a video camera. We develop a real-time facial tracking system to extract a small set of animation control parameters from video. Because of the nature of video data, these parameters may be noisy, low-resolution, and contain errors. The system uses the knowledge embedded in motion capture data to translate these low-quality 2D animation control signals into high-quality 3D facial expressions. To adapt the synthesized motion to a new character model, we introduce an efficient expression retargeting technique whose run-time computation is constant independent of the complexity of the character model. We demonstrate the power of this approach through two users who control and animate a wide range of 3D facial expressions of different avatars.en_US
dc.description.seriesinformationSymposium on Computer Animationen_US
dc.identifier.isbn1-58113-659-5en_US
dc.identifier.issn1727-5288en_US
dc.identifier.urihttps://doi.org/10.2312/SCA03/193-206en_US
dc.publisherThe Eurographics Associationen_US
dc.titleVision-based Control of 3D Facial Animationen_US
Files
Collections
SCA 03: Eurographics/SIGGRAPH Symposium on Computer Animation