Line Art Colorization Based on Explicit Region Segmentation

Cao, Ruizhi; Mo, Haoran; Gao, Chengying

Line Art Colorization Based on Explicit Region Segmentation

Files

v40i7pp001-010.pdf (3.42 MB)

paper1025_mm.pdf (13.7 MB)

Date

2021

Authors

Cao, Ruizhi
Mo, Haoran
Gao, Chengying

Publisher

The Eurographics Association and John Wiley & Sons Ltd.

Abstract

Automatic line art colorization plays an important role in anime and comic industry. While existing methods for line art colorization are able to generate plausible colorized results, they tend to suffer from the color bleeding issue. We introduce an explicit segmentation fusion mechanism to aid colorization frameworks in avoiding color bleeding artifacts. This mechanism is able to provide region segmentation information for the colorization process explicitly so that the colorization model can learn to avoid assigning the same color across regions with different semantics or inconsistent colors inside an individual region. The proposed mechanism is designed in a plug-and-play manner, so it can be applied to a diversity of line art colorization frameworks with various kinds of user guidances. We evaluate this mechanism in tag-based and referencebased line art colorization tasks by incorporating it into the state-of-the-art models. Comparisons with these existing models corroborate the effectiveness of our method which largely alleviates the color bleeding artifacts. The code is available at https://github.com/Ricardo-L-C/ColorizationWithRegion.

        @article{10.1111:cgf.14396
,
journal = {Computer Graphics Forum},
title = {{Line Art Colorization Based on Explicit Region Segmentation
}},
author = {Cao, Ruizhi and 
Mo, Haoran and 
Gao, Chengying
},
year = {2021
},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.
},
ISSN = {1467-8659
},
DOI = {10.1111/cgf.14396
}
}