• Login
    View Item 
    •   Eurographics DL Home
    • Eurographics Partner Events
    • VMV: Vision, Modeling, and Visualization
    • VMV15
    • View Item
    •   Eurographics DL Home
    • Eurographics Partner Events
    • VMV: Vision, Modeling, and Visualization
    • VMV15
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Data Driven 3D Face Tracking Based on a Facial Deformation Model

    Thumbnail
    View/Open
    009-016.pdf (13.80Mb)
    ID1020_result_tracking_and_deformation_transfer.mp4 (33.35Mb)
    Date
    2015
    Author
    Sibbing, Dominik
    Kobbelt, Leif
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    We introduce a new markerless 3D face tracking approach for 2D video streams captured by a single consumer grade camera. Our approach is based on tracking 2D features in the video and matching them with the projection of the corresponding feature points of a deformable 3D model. By this we estimate the initial shape and pose of the face. To make the tracking and reconstruction more robust we add a smoothness prior for pose changes as well as for deformations of the faces. Our major contribution lies in the formulation of the smooth deformation prior which we derive from a large database of previously captured facial animations showing different (dynamic) facial expressions of a fairly large number of subjects. We split these animation sequences into snippets of fixed length which we use to predict the facial motion based on previous frames. In order to keep the deformation model compact and independent from the individual physiognomy, we represent it by deformation gradients (instead of vertex positions) and apply a principal component analysis in deformation gradient space to extract the major modes of facial deformation. Since the facial deformation is optimized during tracking, it is particularly easy to apply them to other physiognomies and thereby re-target the facial expressions. We demonstrate the effectiveness of our technique on a number of examples.
    BibTeX
    @inproceedings {10.2312:vmv.20151252,
    booktitle = {Vision, Modeling & Visualization},
    editor = {David Bommes and Tobias Ritschel and Thomas Schultz},
    title = {{Data Driven 3D Face Tracking Based on a Facial Deformation Model}},
    author = {Sibbing, Dominik and Kobbelt, Leif},
    year = {2015},
    publisher = {The Eurographics Association},
    ISBN = {978-3-905674-95-8},
    DOI = {10.2312/vmv.20151252}
    }
    URI
    http://dx.doi.org/10.2312/vmv.20151252
    Collections
    • VMV15

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA