ShadowPatch: Shadow Based Segmentation for Reliable Depth Discontinuities in Photometric Stereo

Simple item page
dc.contributor.authorHeep, Moritzen_US
dc.contributor.authorZell, Eduarden_US
dc.contributor.editorUmetani, Nobuyukien_US
dc.contributor.editorWojtan, Chrisen_US
dc.contributor.editorVouga, Etienneen_US
dc.date.accessioned2022-10-04T06:42:18Z
dc.date.available2022-10-04T06:42:18Z
dc.date.issued2022
dc.description.abstractPhotometric stereo is a well-established method with outstanding traits to recover surface details and material properties, like surface albedo or even specularity. However, while the surface is locally well-defined, computing absolute depth by integrating surface normals is notoriously difficult. Integration errors can be introduced and propagated by numerical inaccuracies from inter-reflection of light or non-Lambertian surfaces. But especially ignoring depth discontinuities for overlapping or disconnected objects, will introduce strong distortion artefacts. During the acquisition process the object is lit from different positions and self-shadowing is in general considered as an unavoidable drawback, complicating the numerical estimation of normals. However, we observe that shadow boundaries correlate strongly with depth discontinuities and exploit the visual structure introduced by self-shadowing to create a consistent image segmentation of continuous surfaces. In order to make depth estimation more robust, we deeply integrate photometric stereo with depth-from-stereo. Having obtained a shadow based segmentation of continuous surfaces, allows us to reduce the computational cost for correspondence search in depth-from-stereo. To speed-up computation further, we merge segments into larger meta-segments during an iterative depth optimization. The reconstruction error of our method is equal or smaller than previous work, and reconstruction results are characterized by robust handling of depth-discontinuities, without any smearing artifacts.en_US
dc.description.number7
dc.description.sectionheadersDigital Human
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14707
dc.identifier.issn1467-8659
dc.identifier.pages635-646
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14707
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14707
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies --> Reconstruction; Image segmentation; Shape inference
dc.subjectComputing methodologies
dc.subjectReconstruction
dc.subjectImage segmentation
dc.subjectShape inference
dc.titleShadowPatch: Shadow Based Segmentation for Reliable Depth Discontinuities in Photometric Stereoen_US
Files
Original bundle
Now showing 1 - 4 of 4
Thumbnail Image
Name:
v41i7pp635-646.pdf
Size:
15.54 MB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
paper1200_mm.mp4
Size:
136.82 MB
Format:
Unknown data format
Download
No Thumbnail Available
Name:
paper1200_supp.zip
Size:
202.03 MB
Format:
Zip file
Download
Thumbnail Image
Name:
cgf14707_v41i7pp635-646.pdf
Size:
15.61 MB
Format:
Adobe Portable Document Format
Description:
ProjektDeal version
Download
Collections
41-Issue 7