Decomposing Single Images for Layered Photo Retouching

Simple item page
dc.contributor.authorInnamorati, Carloen_US
dc.contributor.authorRitschel, Tobiasen_US
dc.contributor.authorWeyrich, Timen_US
dc.contributor.authorMitra, Niloy J.en_US
dc.contributor.editorZwicker, Matthias and Sander, Pedroen_US
dc.date.accessioned2017-06-19T06:50:13Z
dc.date.available2017-06-19T06:50:13Z
dc.date.issued2017
dc.description.abstractPhotographers routinely compose multiple manipulated photos of the same scene into a single image, producing a fidelity difficult to achieve using any individual photo. Alternately, 3D artists set up rendering systems to produce layered images to isolate individual aspects of the light transport, which are composed into the final result in post-production. Regrettably, these approaches either take considerable time and effort to capture, or remain limited to synthetic scenes. In this paper, we suggest a method to decompose a single image into multiple layers that approximates effects such as shadow, diffuse illumination, albedo, and specular shading. To this end, we extend the idea of intrinsic images along two axes: first, by complementing shading and reflectance with specularity and occlusion, and second, by introducing directional dependence. We do so by training a convolutional neural network (CNN) with synthetic data. Such decompositions can then be manipulated in any off-the-shelf image manipulation software and composited back. We demonstrate the effectiveness of our decomposition on synthetic (i. e., rendered) and real data (i. e., photographs), and use them for photo manipulations, which are otherwise impossible to perform based on single images. We provide comparisons with state-of-the-art methods and also evaluate the quality of our decompositions via a user study measuring the effectiveness of the resultant photo retouching setup. Supplementary material and code are available for research use at geometry.cs.ucl.ac.uk/projects/2017/layered-retouching.en_US
dc.description.number4
dc.description.sectionheadersRendering is Everywhere
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume36
dc.identifier.doi10.1111/cgf.13220
dc.identifier.issn1467-8659
dc.identifier.pages015-025
dc.identifier.urihttps://doi.org/10.1111/cgf.13220
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13220
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.titleDecomposing Single Images for Layered Photo Retouchingen_US
Files
Collections
36-Issue 4