Time-Lapse Photometric Stereo and Applications
No Thumbnail Available
Date
2014
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley and Sons Ltd.
Abstract
This paper presents a technique to recover geometry from time-lapse sequences of outdoor scenes. We build upon photometric stereo techniques to recover approximate shadowing, shading and normal components allowing us to alter the material and normals of the scene. Previous work in analyzing such images has faced two fundamental difficulties: 1. the illumination in outdoor images consists of time-varying sunlight and skylight, and 2. the motion of the sun is restricted to a near-planar arc through the sky, making surface normal recovery unstable. We develop methods to estimate the reflection component due to skylight illumination. We also show that sunlight directions are usually non-planar, thus making surface normal recovery possible. This allows us to estimate approximate surface normals for outdoor scenes using a single day of data. We demonstrate the use of these surface normals for a number of image editing applications including reflectance, lighting, and normal editing.
Description
@article{:10.1111/cgf.12504,
journal = {Computer Graphics Forum},
title = {{Time-Lapse Photometric Stereo and Applications}},
author = {Shen, Fangyang and Sunkavalli, Kalyan and Bonneel, Nicolas and Rusinkiewicz, Szymon and Pfister, Hanspeter and Tong, Xin},
year = {2014},
publisher = {The Eurographics Association and John Wiley and Sons Ltd.},
ISSN = {1467-8659},
DOI = {/10.1111/cgf.12504}
}