CLA-GAN: A Context and Lightness Aware Generative Adversarial Network for Shadow Removal

dc.contributor.authorZhang, Lingen_US
dc.contributor.authorLong, Chengjiangen_US
dc.contributor.authorYan, Qinganen_US
dc.contributor.authorZhang, Xiaolongen_US
dc.contributor.authorXiao, Chunxiaen_US
dc.contributor.editorEisemann, Elmar and Jacobson, Alec and Zhang, Fang-Lueen_US
dc.date.accessioned2020-10-29T18:51:09Z
dc.date.available2020-10-29T18:51:09Z
dc.date.issued2020
dc.description.abstractIn this paper, we propose a novel context and lightness aware Generative Adversarial Network (CLA-GAN) framework for shadow removal, which refines a coarse result to a final shadow removal result in a coarse-to-fine fashion. At the refinement stage, we first obtain a lightness map using an encoder-decoder structure. With the lightness map and the coarse result as the inputs, the following encoder-decoder tries to refine the final result. Specifically, different from current methods restricted pixel-based features from shadow images, we embed a context-aware module into the refinement stage, which exploits patch-based features. The embedded module transfers features from non-shadow regions to shadow regions to ensure the consistency in appearance in the recovered shadow-free images. Since we consider pathces, the module can additionally enhance the spatial association and continuity around neighboring pixels. To make the model pay more attention to shadow regions during training, we use dynamic weights in the loss function. Moreover, we augment the inputs of the discriminator by rotating images in different degrees and use rotation adversarial loss during training, which can make the discriminator more stable and robust. Extensive experiments demonstrate the validity of the components in our CLA-GAN framework. Quantitative evaluation on different shadow datasets clearly shows the advantages of our CLA-GAN over the state-of-the-art methods.en_US
dc.description.number7
dc.description.sectionheadersImage Restoration
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume39
dc.identifier.doi10.1111/cgf.14161
dc.identifier.issn1467-8659
dc.identifier.pages483-494
dc.identifier.urihttps://doi.org/10.1111/cgf.14161
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14161
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectComputing methodologies
dc.subjectContext
dc.subjectLightness
dc.subjectGAN
dc.subjectCoarse
dc.subjectto
dc.subjectfine
dc.subjectShadow Removal
dc.titleCLA-GAN: A Context and Lightness Aware Generative Adversarial Network for Shadow Removalen_US
Files
Collections