• Login
    View Item 
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 36 (2017)
    • 36-Issue 2
    • View Item
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 36 (2017)
    • 36-Issue 2
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Multi-View Stereo on Consistent Face Topology

    Thumbnail
    View/Open
    v36i2pp295-309.pdf (41.25Mb)
    multiviewstereo_24fps_1920x1080_v09-1.m4v (99.26Mb)
    Date
    2017
    Author
    Fyffe, Graham
    Nagano, Koki
    Huynh, Loc
    Saito, Shunsuke
    Busch, Jay
    Jones, Andrew
    Li, Hao
    Debevec, Paul
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    We present a multi-view stereo reconstruction technique that directly produces a complete high-fidelity head model with consistent facial mesh topology. While existing techniques decouple shape estimation and facial tracking, our framework jointly optimizes for stereo constraints and consistent mesh parameterization. Our method is therefore free from drift and fully parallelizable for dynamic facial performance capture. We produce highly detailed facial geometries with artist-quality UV parameterization, including secondary elements such as eyeballs, mouth pockets, nostrils, and the back of the head. Our approach consists of deforming a common template model to match multi-view input images of the subject, while satisfying cross-view, cross-subject, and cross-pose consistencies using a combination of 2D landmark detection, optical flow, and surface and volumetric Laplacian regularization. Since the flow is never computed between frames, our method is trivially parallelized by processing each frame independently. Accurate rigid head pose is extracted using a PCA-based dimension reduction and denoising scheme. We demonstrate high-fidelity performance capture results with challenging head motion and complex facial expressions around eye and mouth regions. While the quality of our results is on par with the current state-of-the-art, our approach can be fully parallelized, does not suffer from drift, and produces face models with production-quality mesh topologies.
    BibTeX
    @article {10.1111:cgf.13127,
    journal = {Computer Graphics Forum},
    title = {{Multi-View Stereo on Consistent Face Topology}},
    author = {Fyffe, Graham and Nagano, Koki and Huynh, Loc and Saito, Shunsuke and Busch, Jay and Jones, Andrew and Li, Hao and Debevec, Paul},
    year = {2017},
    publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13127}
    }
    URI
    http://dx.doi.org/10.1111/cgf.13127
    https://diglib.eg.org:443/handle/10.1111/cgf13127
    Collections
    • 36-Issue 2

    Eurographics Association copyright © 2013 - 2022 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2022 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA