• Login
    View Item 
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 36 (2017)
    • 36-Issue 2
    • View Item
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 36 (2017)
    • 36-Issue 2
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Real-Time Multi-View Facial Capture with Synthetic Training

    Thumbnail
    View/Open
    v36i2pp325-336.pdf (62.62Mb)
    Date
    2017
    Author
    Klaudiny, Martin
    McDonagh, Steven
    Bradley, Derek
    Beeler, Thabo
    Mitchell, Kenny
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    We present a real-time multi-view facial capture system facilitated by synthetic training imagery. Our method is able to achieve high-quality markerless facial performance capture in real-time from multi-view helmet camera data, employing an actor specific regressor. The regressor training is tailored to specified actor appearance and we further condition it for the expected illumination conditions and the physical capture rig by generating the training data synthetically. In order to leverage the information present in live imagery, which is typically provided by multiple cameras, we propose a novel multi-view regression algorithm that uses multi-dimensional random ferns. We show that higher quality can be achieved by regressing on multiple video streams than previous approaches that were designed to operate on only a single view. Furthermore, we evaluate possible camera placements and propose a novel camera configuration that allows to mount cameras outside the field of view of the actor, which is very beneficial as the cameras are then less of a distraction for the actor and allow for an unobstructed line of sight to the director and other actors. Our new real-time facial capture approach has immediate application in on-set virtual production, in particular with the ever-growing demand for motion-captured facial animation in visual effects and video games.
    BibTeX
    @article {10.1111:cgf.13129,
    journal = {Computer Graphics Forum},
    title = {{Real-Time Multi-View Facial Capture with Synthetic Training}},
    author = {Klaudiny, Martin and McDonagh, Steven and Bradley, Derek and Beeler, Thabo and Mitchell, Kenny},
    year = {2017},
    publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13129}
    }
    URI
    http://dx.doi.org/10.1111/cgf.13129
    https://diglib.eg.org:443/handle/10.1111/cgf13129
    Collections
    • 36-Issue 2

    Eurographics Association copyright © 2013 - 2022 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2022 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA