• Login
    View Item 
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 40 (2021)
    • 40-Issue 4
    • View Item
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 40 (2021)
    • 40-Issue 4
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Video-Based Rendering of Dynamic Stationary Environments from Unsynchronized Inputs

    Thumbnail
    View/Open
    v40i4pp073-086.pdf (71.03Mb)
    paper1018_mm.pdf (19.30Mb)
    Date
    2021
    Author
    Thonat, Theo
    Aksoy, Yagiz ORCID
    Aittala, Miika
    Paris, Sylvain
    Durand, Fredo
    Drettakis, George
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    Image-Based Rendering allows users to easily capture a scene using a single camera and then navigate freely with realistic results. However, the resulting renderings are completely static, and dynamic effects - such as fire, waterfalls or small waves - cannot be reproduced. We tackle the challenging problem of enabling free-viewpoint navigation including such stationary dynamic effects, but still maintaining the simplicity of casual capture. Using a single camera - instead of previous complex synchronized multi-camera setups - means that we have unsynchronized videos of the dynamic effect from multiple views, making it hard to blend them when synthesizing novel views. We present a solution that allows smooth free-viewpoint video-based rendering (VBR) of such scenes using temporal Laplacian pyramid decomposition video, enabling spatio-temporal blending. For effects such as fire and waterfalls, that are semi-transparent and occupy 3D space, we first estimate their spatial volume. This allows us to create per-video geometries and alpha-matte videos that we can blend using our frequency-dependent method. We also extend Laplacian blending to the temporal dimension to remove additional temporal seams. We show results on scenes containing fire, waterfalls or rippling waves at the seaside, bringing these scenes to life.
    BibTeX
    @article {10.1111:cgf.14342,
    journal = {Computer Graphics Forum},
    title = {{Video-Based Rendering of Dynamic Stationary Environments from Unsynchronized Inputs}},
    author = {Thonat, Theo and Aksoy, Yagiz and Aittala, Miika and Paris, Sylvain and Durand, Fredo and Drettakis, George},
    year = {2021},
    publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.14342}
    }
    URI
    https://doi.org/10.1111/cgf.14342
    https://diglib.eg.org:443/handle/10.1111/cgf14342
    Collections
    • 40-Issue 4

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA