Data Driven 3D Face Tracking Based on a Facial Deformation Model

dc.contributor.authorSibbing, Dominiken_US
dc.contributor.authorKobbelt, Leifen_US
dc.contributor.editorDavid Bommes and Tobias Ritschel and Thomas Schultzen_US
dc.date.accessioned2015-10-07T05:13:32Z
dc.date.available2015-10-07T05:13:32Z
dc.date.issued2015en_US
dc.description.abstractWe introduce a new markerless 3D face tracking approach for 2D video streams captured by a single consumer grade camera. Our approach is based on tracking 2D features in the video and matching them with the projection of the corresponding feature points of a deformable 3D model. By this we estimate the initial shape and pose of the face. To make the tracking and reconstruction more robust we add a smoothness prior for pose changes as well as for deformations of the faces. Our major contribution lies in the formulation of the smooth deformation prior which we derive from a large database of previously captured facial animations showing different (dynamic) facial expressions of a fairly large number of subjects. We split these animation sequences into snippets of fixed length which we use to predict the facial motion based on previous frames. In order to keep the deformation model compact and independent from the individual physiognomy, we represent it by deformation gradients (instead of vertex positions) and apply a principal component analysis in deformation gradient space to extract the major modes of facial deformation. Since the facial deformation is optimized during tracking, it is particularly easy to apply them to other physiognomies and thereby re-target the facial expressions. We demonstrate the effectiveness of our technique on a number of examples.en_US
dc.description.sectionheadersGeometryen_US
dc.description.seriesinformationVision, Modeling & Visualizationen_US
dc.identifier.doi10.2312/vmv.20151252en_US
dc.identifier.isbn978-3-905674-95-8en_US
dc.identifier.pages9-16en_US
dc.identifier.urihttps://doi.org/10.2312/vmv.20151252en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectI.3.7 [COMPUTER GRAPHICS]en_US
dc.subjectThreeen_US
dc.subjectDimensional Graphics and Realismen_US
dc.subjectAnimationen_US
dc.subjectI.4.8 [IMAGE PROCESSING AND COMPUTER VISION]en_US
dc.subjectScene Analysisen_US
dc.subjectTrackingen_US
dc.titleData Driven 3D Face Tracking Based on a Facial Deformation Modelen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
009-016.pdf
Size:
13.81 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
ID1020_result_tracking_and_deformation_transfer.mp4
Size:
33.36 MB
Format:
Unknown data format
Collections