Adversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto‐Encoder

Simple item page
dc.contributor.authorLiu, Xiaoyuen_US
dc.contributor.authorZhu, Shaoqiangen_US
dc.contributor.authorZeng, Yaoen_US
dc.contributor.authorZhang, Junsongen_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2023-10-06T11:58:50Z
dc.date.available2023-10-06T11:58:50Z
dc.date.issued2023
dc.description.abstractColouring cartoon sketches can help children develop their intellect and inspire their artistic creativity. Unlike photo colourization or anime line art colourization, cartoon sketch colourization is challenging due to the scarcity of texture information and the irregularity of the line structure, which is mainly reflected in the phenomenon of colour‐bleeding artifacts in generated images. We propose a colourization approach for cartoon sketches, which takes both sketches and colour hints as inputs to produce impressive images. To solve the problem of colour‐bleeding artifacts, we propose a multi‐discriminator colourization framework that introduces a texture discriminator in the conditional generative adversarial network (cGAN). Then we combined this framework with a pre‐trained auxiliary auto‐encoder, where an auxiliary feature loss is designed to further improve colour quality, and a condition input is introduced to increase the generalization ability over hand‐drawn sketches. We present both quantitative and qualitative evaluations, which prove the effectiveness of our proposed method. We test our method on sketches of varying complexity and structure, then build an interactive programme based on our model for user study. Experimental results demonstrate that the method generates natural and consistent colour images in real time from sketches drawn by non‐professionals.en_US
dc.description.number6
dc.description.sectionheadersORIGINAL ARTICLES
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14797
dc.identifier.issn1467-8659
dc.identifier.urihttps://doi.org/10.1111/cgf.14797
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14797
dc.publisher© 2023 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectImage and video processing
dc.titleAdversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto‐Encoderen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
v42i6_10_14797.pdf
Size:
2.67 MB
Format:
Adobe Portable Document Format
Download
Collections
42-Issue 6