Relighting Human Locomotion with Flowed Reflectance Fields

dc.contributor.authorEinarsson, Peren_US
dc.contributor.authorChabert, Charles-Felixen_US
dc.contributor.authorJones, Andrewen_US
dc.contributor.authorMa, Wan-Chunen_US
dc.contributor.authorLamond, Bruceen_US
dc.contributor.authorHawkins, Timen_US
dc.contributor.authorBolas, Marken_US
dc.contributor.authorSylwan, Sebastianen_US
dc.contributor.authorDebevec, Paulen_US
dc.contributor.editorTomas Akenine-Moeller and Wolfgang Heidrichen_US
dc.description.abstractWe present an image-based approach for capturing the appearance of a walking or running person so they can be rendered realistically under variable viewpoint and illumination. In our approach, a person walks on a treadmill at a regular rate as a turntable slowly rotates the person s direction. As this happens, the person is filmed with a vertical array of high-speed cameras under a time-multiplexed lighting basis, acquiring a seven-dimensional dataset of the person under variable time, illumination, and viewing direction in approximately forty seconds. We process this data into a flowed reflectance field using an optical flow algorithm to correspond pixels in neighboring camera views and time samples to each other, and we use image compression to reduce the size of this data.We then use image-based relighting and a hardware-accelerated combination of view morphing and light field rendering to render the subject under user-specified viewpoint and lighting conditions. To composite the person into a scene, we use an alpha channel derived from back lighting and a retroreflective treadmill surface and a visual hull process to render the shadows the person would cast onto the ground. We demonstrate realistic composites of several subjects into real and virtual environments using our technique.en_US
dc.description.seriesinformationSymposium on Renderingen_US
dc.publisherThe Eurographics Associationen_US
dc.subjectCategories and Subject Descriptors (according to ACM CCS): I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism -- Color, shading, shadowing, and texture I.4.8 [Image Processing and Computer Vision]: Digitization and Image Capture -- Reflectance I.4.8 [Image Processing and Computer Vision]: Scene Analysis -- Trackingen_US
dc.titleRelighting Human Locomotion with Flowed Reflectance Fieldsen_US
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
456.3 KB
Adobe Portable Document Format