NeRF-Tex: Neural Reflectance Field Textures

dc.contributor.authorBaatz, Hendriken_US
dc.contributor.authorGranskog, Jonathanen_US
dc.contributor.authorPapas, Mariosen_US
dc.contributor.authorRousselle, Fabriceen_US
dc.contributor.authorNovák, Janen_US
dc.contributor.editorBousseau, Adrien and McGuire, Morganen_US
dc.date.accessioned2021-07-12T12:12:49Z
dc.date.available2021-07-12T12:12:49Z
dc.date.issued2021
dc.description.abstractWe investigate the use of neural fields for modeling diverse mesoscale structures, such as fur, fabric, and grass. Instead of using classical graphics primitives to model the structure, we propose to employ a versatile volumetric primitive represented by a neural reflectance field (NeRF-Tex), which jointly models the geometry of the material and its response to lighting. The NeRF-Tex primitive can be instantiated over a base mesh to ''texture'' it with the desired meso and microscale appearance. We condition the reflectance field on user-defined parameters that control the appearance. A single NeRF texture thus captures an entire space of reflectance fields rather than one specific structure. This increases the gamut of appearances that can be modeled and provides a solution for combating repetitive texturing artifacts. We also demonstrate that NeRF textures naturally facilitate continuous level-of-detail rendering. Our approach unites the versatility and modeling power of neural networks with the artistic control needed for precise modeling of virtual scenes. While all our training data is currently synthetic, our work provides a recipe that can be further extended to extract complex, hard-to-model appearances from real images.en_US
dc.description.sectionheadersNeural Rendering
dc.description.seriesinformationEurographics Symposium on Rendering - DL-only Track
dc.identifier.doi10.2312/sr.20211285
dc.identifier.isbn978-3-03868-157-1
dc.identifier.issn1727-3463
dc.identifier.pages1-13
dc.identifier.urihttps://doi.org/10.2312/sr.20211285
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/sr20211285
dc.publisherThe Eurographics Associationen_US
dc.subjectComputing methodologies --> Neural networks
dc.subjectRay tracing
dc.titleNeRF-Tex: Neural Reflectance Field Texturesen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
001-013.pdf
Size:
34.13 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1042_mm.mp4
Size:
147.09 MB
Format:
Unknown data format