Efficient GPU Based Sampling for Scene-Space Video Processing

Loading...
Thumbnail Image
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We describe a method to efficiently collect and filter a large set of 2D pixel observations of unstructured 3D points, with applications to scene-space aware video processing. One of the main challenges in scene-space video processing is to achieve reasonable computation time despite the very large volumes of data, often in the order of billions of pixels. The bottleneck is determining a suitable set of candidate samples used to compute each output video pixel color. These samples are observations of the same 3D point, and must be gathered from a large number of candidate pixels, by volumetric 3D queries in scene-space. Our approach takes advantage of the spatial and temporal continuity inherent to video to greatly reduce the candidate set of samples by solving 3D volumetric queries directly on a series of 2D projections, using out-of-core data streaming and an efficient GPU producerconsumer scheme that maximizes hardware utilization by exploiting memory locality. Our system is capable of processing over a trillion pixel samples, enabling various scene-space video processing applications on full HD video output with hundreds of frames and processing times in the order of a few minutes.
Description

        
@inproceedings{
10.2312:vmv.20151264
, booktitle = {
Vision, Modeling & Visualization
}, editor = {
David Bommes and Tobias Ritschel and Thomas Schultz
}, title = {{
Efficient GPU Based Sampling for Scene-Space Video Processing
}}, author = {
Klose, Felix
and
Wang, Oliver
and
Bazin, Jean-Charles
and
Magnor, Marcus
and
Sorkine-Hornung, Alexander
}, year = {
2015
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-905674-95-8
}, DOI = {
10.2312/vmv.20151264
} }
Citation
Collections