OutCast: Outdoor Single-image Relighting with Cast Shadows

dc.contributor.authorGriffiths, Daviden_US
dc.contributor.authorRitschel, Tobiasen_US
dc.contributor.authorPhilip, Julienen_US
dc.contributor.editorChaine, Raphaëlleen_US
dc.contributor.editorKim, Min H.en_US
dc.date.accessioned2022-04-22T06:27:41Z
dc.date.available2022-04-22T06:27:41Z
dc.date.issued2022
dc.description.abstractWe propose a relighting method for outdoor images. Our method mainly focuses on predicting cast shadows in arbitrary novel lighting directions from a single image while also accounting for shading and global effects such the sun light color and clouds. Previous solutions for this problem rely on reconstructing occluder geometry, e. g., using multi-view stereo, which requires many images of the scene. Instead, in this work we make use of a noisy off-the-shelf single-image depth map estimation as a source of geometry. Whilst this can be a good guide for some lighting effects, the resulting depth map quality is insufficient for directly ray-tracing the shadows. Addressing this, we propose a learned image space ray-marching layer that converts the approximate depth map into a deep 3D representation that is fused into occlusion queries using a learned traversal. Our proposed method achieves, for the first time, state-of-the-art relighting results, with only a single image as input.en_US
dc.description.number2
dc.description.sectionheadersAppearance and Shading
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14467
dc.identifier.issn1467-8659
dc.identifier.pages179-193
dc.identifier.pages15 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14467
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14467
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Rendering --> Relighting
dc.subjectRendering
dc.subjectRelighting
dc.titleOutCast: Outdoor Single-image Relighting with Cast Shadowsen_US
Files
Original bundle
Now showing 1 - 3 of 3
Loading...
Thumbnail Image
Name:
v41i2pp179-193.pdf
Size:
45.44 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1134_1.mov
Size:
117.91 MB
Format:
Video Quicktime
Loading...
Thumbnail Image
Name:
paper1134_2.pdf
Size:
13.43 MB
Format:
Adobe Portable Document Format
Collections