Path Sampling Methods for Differentiable Rendering

No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We introduce a suite of path sampling methods for differentiable rendering of scene parameters that do not induce visibility-driven discontinuities, such as BRDF parameters. We begin by deriving a path integral formulation for differentiable rendering of such parameters, which we then use to derive methods that importance sample paths according to this formulation. Our methods are analogous to path tracing and path tracing with next event estimation for primal rendering, have linear complexity, and can be implemented efficiently using path replay backpropagation. Our methods readily benefit from differential BRDF sampling routines, and can be further enhanced using multiple importance sampling and a loss-aware pixel-space adaptive sampling procedure tailored to our path integral formulation. We show experimentally that our methods reduce variance in rendered gradients by potentially orders of magnitude, and thus help accelerate inverse rendering optimization of BRDF parameters.
Description

CCS Concepts: Computing methodologies -> Ray tracing

        
@inproceedings{
10.2312:sr.20241148
, booktitle = {
Eurographics Symposium on Rendering
}, editor = {
Haines, Eric
and
Garces, Elena
}, title = {{
Path Sampling Methods for Differentiable Rendering
}}, author = {
Su, Tanli
and
Gkioulekas, Ioannis
}, year = {
2024
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-3463
}, ISBN = {
978-3-03868-262-2
}, DOI = {
10.2312/sr.20241148
} }
Citation