Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction
Loading...
Date
2022
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Volumetric radiance fields have recently gained significant attention as promising representations of photorealistic scene reconstruction. However, the non-photorealistic rendering of such a representation has barely been explored. In this study, we investigate the artistic posterization of the volumetric radiance fields. We extend the recent palette-based image-editing framework, which naturally introduces intuitive color manipulation of the posterized results, into the radiance field. Our major challenge is applying stylization effects coherently across different views. Based on the observation that computing a palette frame-by-frame can produce flickering, we propose pre-computing a single palette from the volumetric radiance field covering its entire visible color. We present a method based on volumetric visibility to sample visible colors from the radiance field while avoiding occluded and noisy regions. We demonstrate our workflow by applying it to pre-trained volumetric radiance fields with various stylization effects. We also show that our approach can produce more coherent and robust stylization effects than baseline methods that compute a palette on each rendered view.
Description
CCS Concepts: Computing methodologies --> Non-photorealistic rendering; Image processing
@article{10.1111:cgf.14594,
journal = {Computer Graphics Forum},
title = {{Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction}},
author = {Tojo, Kenji and Umetani, Nobuyuki},
year = {2022},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14594}
}