A Generative Framework for Image‐based Editing of Material Appearance using Perceptual Attributes

dc.contributor.authorDelanoy, J.en_US
dc.contributor.authorLagunas, M.en_US
dc.contributor.authorCondor, J.en_US
dc.contributor.authorGutierrez, D.en_US
dc.contributor.authorMasia, B.en_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2022-03-25T12:31:07Z
dc.date.available2022-03-25T12:31:07Z
dc.date.issued2022
dc.description.abstractSingle‐image appearance editing is a challenging task, traditionally requiring the estimation of additional scene properties such as geometry or illumination. Moreover, the exact interaction of light, shape and material reflectance that elicits a given perceptual impression is still not well understood. We present an image‐based editing method that allows to modify the material appearance of an object by increasing or decreasing high‐level perceptual attributes, using a single image as input. Our framework relies on a two‐step generative network, where the first step drives the change in appearance and the second produces an image with high‐frequency details. For training, we augment an existing material appearance dataset with perceptual judgements of high‐level attributes, collected through crowd‐sourced experiments, and build upon training strategies that circumvent the cumbersome need for original‐edited image pairs. We demonstrate the editing capabilities of our framework on a variety of inputs, both synthetic and real, using two common perceptual attributes ( and ), and validate the perception of appearance in our edited images through a user study.en_US
dc.description.number1
dc.description.sectionheadersMajor Revision from Pacific Graphics
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14446
dc.identifier.issn1467-8659
dc.identifier.pages453-464
dc.identifier.urihttps://doi.org/10.1111/cgf.14446
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14446
dc.publisher© 2022 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltden_US
dc.subjectimage processing
dc.subjectimage and video processing
dc.titleA Generative Framework for Image‐based Editing of Material Appearance using Perceptual Attributesen_US
Files
Collections