Convolutional Sparse Coding for Capturing High‐Speed Video Content

dc.contributor.authorSerrano, Anaen_US
dc.contributor.authorGarces, Elenaen_US
dc.contributor.authorMasia, Belenen_US
dc.contributor.authorGutierrez, Diegoen_US
dc.contributor.editorChen, Min and Zhang, Hao (Richard)en_US
dc.date.accessioned2018-01-10T07:43:02Z
dc.date.available2018-01-10T07:43:02Z
dc.date.issued2017
dc.description.abstractVideo capture is limited by the trade‐off between spatial and temporal resolution: when capturing videos of high temporal resolution, the spatial resolution decreases due to bandwidth limitations in the capture system. Achieving both high spatial temporal resolution is only possible with highly specialized and very expensive hardware, and even then the same basic trade‐off remains. The recent introduction of compressive sensing and sparse reconstruction techniques allows for the capture of high‐speed video, by coding the temporal information in a single frame, and then reconstructing the full video sequence from this single‐coded image and a trained dictionary of image patches. In this paper, we first analyse this approach, and find insights that help improve the quality of the reconstructed videos. We then introduce a novel technique, based on (CSC), and show how it outperforms the state‐of‐the‐art, patch‐based approach in terms of flexibility and efficiency, due to the convolutional nature of its filter banks. The key idea for CSC high‐speed video acquisition is extending the basic formulation by imposing an additional constraint in the temporal dimension, which enforces sparsity of the first‐order derivatives over time.Video capture is limited by the trade‐off between spatial and temporal resolution: when capturing videos of high temporal resolution, the spatial resolution decreases due to bandwidth limitations in the capture system. Achieving both high spatial and temporal resolution is only possible with highly specialized and very expensive hardware, and even then the same basic trade‐off remains. .en_US
dc.description.number8
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume36
dc.identifier.doi10.1111/cgf.13086
dc.identifier.issn1467-8659
dc.identifier.pages380-389
dc.identifier.urihttps://doi.org/10.1111/cgf.13086
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13086
dc.publisher© 2017 The Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectcomputational photography
dc.subjectI.4.1 [Computer Graphics]: Digitization and Image Capture
dc.subjectSampling
dc.titleConvolutional Sparse Coding for Capturing High‐Speed Video Contenten_US
Files
Collections