Example‐Based Colourization Via Dense Encoding Pyramids

Simple item page
dc.contributor.authorXiao, Chufengen_US
dc.contributor.authorHan, Chuen_US
dc.contributor.authorZhang, Zhumingen_US
dc.contributor.authorQin, Jingen_US
dc.contributor.authorWong, Tien‐Tsinen_US
dc.contributor.authorHan, Guoqiangen_US
dc.contributor.authorHe, Shengfengen_US
dc.contributor.editorBenes, Bedrich and Hauser, Helwigen_US
dc.date.accessioned2020-05-22T12:24:38Z
dc.date.available2020-05-22T12:24:38Z
dc.date.issued2020
dc.description.abstractWe propose a novel deep example‐based image colourization method called dense encoding pyramid network. In our study, we define the colourization as a multinomial classification problem. Given a greyscale image and a reference image, the proposed network leverages large‐scale data and then predicts colours by analysing the colour distribution of the reference image. We design the network as a pyramid structure in order to exploit the inherent multi‐scale, pyramidal hierarchy of colour representations. Between two adjacent levels, we propose a hierarchical decoder–encoder filter to pass the colour distributions from the lower level to higher level in order to take both semantic information and fine details into account during the colourization process. Within the network, a novel parallel residual dense block is proposed to effectively extract the local–global context of the colour representations by widening the network. Several experiments, as well as a user study, are conducted to evaluate the performance of our network against state‐of‐the‐art colourization methods. Experimental results show that our network is able to generate colourful, semantically correct and visually pleasant colour images. In addition, unlike fully automatic colourization that produces fixed colour images, the reference image of our network is flexible; both natural images and simple colour palettes can be used to guide the colourization.en_US
dc.description.number1
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume39
dc.identifier.doi10.1111/cgf.13659
dc.identifier.issn1467-8659
dc.identifier.pages20-33
dc.identifier.urihttps://doi.org/10.1111/cgf.13659
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13659
dc.publisher© 2020 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltden_US
dc.subjectimage and video processing
dc.subjectimage processing
dc.subjectI.3.3 [Computer Graphics]: Picture/Image; Computing Methodologies: Neural Networks
dc.subjectComputational Photography
dc.titleExample‐Based Colourization Via Dense Encoding Pyramidsen_US
Files
Collections
39-Issue 1