Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction

Loading...
Thumbnail Image
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Volumetric radiance fields have recently gained significant attention as promising representations of photorealistic scene reconstruction. However, the non-photorealistic rendering of such a representation has barely been explored. In this study, we investigate the artistic posterization of the volumetric radiance fields. We extend the recent palette-based image-editing framework, which naturally introduces intuitive color manipulation of the posterized results, into the radiance field. Our major challenge is applying stylization effects coherently across different views. Based on the observation that computing a palette frame-by-frame can produce flickering, we propose pre-computing a single palette from the volumetric radiance field covering its entire visible color. We present a method based on volumetric visibility to sample visible colors from the radiance field while avoiding occluded and noisy regions. We demonstrate our workflow by applying it to pre-trained volumetric radiance fields with various stylization effects. We also show that our approach can produce more coherent and robust stylization effects than baseline methods that compute a palette on each rendered view.
Description

CCS Concepts: Computing methodologies --> Non-photorealistic rendering; Image processing

        
@article{
10.1111:cgf.14594
, journal = {Computer Graphics Forum}, title = {{
Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction
}}, author = {
Tojo, Kenji
and
Umetani, Nobuyuki
}, year = {
2022
}, publisher = {
The Eurographics Association and John Wiley & Sons Ltd.
}, ISSN = {
1467-8659
}, DOI = {
10.1111/cgf.14594
} }
Citation
Collections