Differentiable Procedural Models for Single-view 3D Mesh Reconstruction

dc.contributor.authorGarifullin, Alberten_US
dc.contributor.authorMaiorov, Nikolayen_US
dc.contributor.authorFrolov, Vladimiren_US
dc.contributor.editorVangorp, Peteren_US
dc.contributor.editorHunter, Daviden_US
dc.date.accessioned2023-09-12T05:44:46Z
dc.date.available2023-09-12T05:44:46Z
dc.date.issued2023
dc.description.abstractMost existing solutions for single-view 3D object reconstruction are based on deep learning with implicit or voxel representations of the scene and are unable to produce detailed and high-quality meshes and textures that can be directly used in practice. Differentiable rendering, on the other hand, is able to produce high-quality meshes but requires several images of an object. We propose a novel approach to single-view 3D reconstruction that uses procedural generator input parameters as a scene representation. Instead of estimating the vertex positions of the mesh directly, we estimate the input parameters of a procedural generator by minimizing the silhouette loss function between reference and rendered images. We use differentiable rendering and create partly differentiable procedural generators to use gradient-based optimization of the loss function. It allows us to create a highly detailed model from a single image taken in an uncontrolled environment. Moreover, the reconstructed model can be further modified in a convenient way by changing the estimated input parameters.en_US
dc.description.sectionheadersShape Reconstruction
dc.description.seriesinformationComputer Graphics and Visual Computing (CGVC)
dc.identifier.doi10.2312/cgvc.20231189
dc.identifier.isbn978-3-03868-231-8
dc.identifier.pages39-43
dc.identifier.pages5 pages
dc.identifier.urihttps://doi.org/10.2312/cgvc.20231189
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/cgvc20231189
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies -> Rendering; Shape modeling
dc.subjectComputing methodologies
dc.subjectRendering
dc.subjectShape modeling
dc.titleDifferentiable Procedural Models for Single-view 3D Mesh Reconstructionen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
039-043.pdf
Size:
7.72 MB
Format:
Adobe Portable Document Format