Path-space Motion Estimation and Decomposition for Robust Animation Filtering

Loading...
Thumbnail Image
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Renderings of animation sequences with physics-based Monte Carlo light transport simulations are exceedingly costly to generate frame-by-frame, yet much of this computation is highly redundant due to the strong coherence in space, time and among samples. A promising approach pursued in prior work entails subsampling the sequence in space, time, and number of samples, followed by image-based spatio-temporal upsampling and denoising. These methods can provide significant performance gains, though major issues remain: firstly, in a multiple scattering simulation, the final pixel color is the composite of many different light transport phenomena, and this conflicting information causes artifacts in image-based methods. Secondly, motion vectors are needed to establish correspondence between the pixels in different frames, but it is unclear how to obtain them for most kinds of light paths (e.g. an object seen through a curved glass panel). To reduce these ambiguities, we propose a general decomposition framework, where the final pixel color is separated into components corresponding to disjoint subsets of the space of light paths. Each component is accompanied by motion vectors and other auxiliary features such as reflectance and surface normals. The motion vectors of specular paths are computed using a temporal extension of manifold exploration and the remaining components use a specialized variant of optical flow. Our experiments show that this decomposition leads to significant improvements in three image-based applications: denoising, spatial upsampling, and temporal interpolation.
Description

        
@article{
10.1111:cgf.12685
, journal = {Computer Graphics Forum}, title = {{
Path-space Motion Estimation and Decomposition for Robust Animation Filtering
}}, author = {
Zimmer, Henning
 and
Rousselle, Fabrice
 and
Jakob, Wenzel
 and
Wang, Oliver
 and
Adler, David
 and
Jarosz, Wojciech
 and
Sorkine-Hornung, Olga
 and
Sorkine-Hornung, Alexander
}, year = {
2015
}, publisher = {
The Eurographics Association and John Wiley & Sons Ltd.
}, DOI = {
10.1111/cgf.12685
} }
Citation