CoPaint: Guiding Sketch Painting with Consistent Color and Coherent Generative Adversarial Networks

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

Art design plays an important role in attracting users. Thro- ugh art design, some sketches are more in line with aesthetics. Traditionally, we need to artificially color many series of black-and-white sketches using the same color, which is time-consuming and difficult for art designers. In addition, coherent sketch painting is challenging to automate. We propose a GAN-based approach CoPaint for sketch colorization. Our neural network takes as its input two black-and-white sketches with different rotation angles and produces a series of high-quality colored images of consistent color. We present an approach to generate a coherent sketch painting dataset. We also propose a paired generator network with shared weights that consists of convolutional layers and batch-normal layers. In addition, we propose a similarity loss that makes the images produced by the generator more similar. The provided experiments demonstrate the effectiveness of our approach.

Original languageEnglish
Title of host publicationAdvances in Computer Graphics - 38th Computer Graphics International Conference, CGI 2021, Proceedings
EditorsNadia Magnenat-Thalmann, Nadia Magnenat-Thalmann, Victoria Interrante, Daniel Thalmann, George Papagiannakis, Bin Sheng, Jinman Kim, Marina Gavrilova
PublisherSpringer Science and Business Media Deutschland GmbH
Pages229-241
Number of pages13
ISBN (Print)9783030890285
DOIs
StatePublished - 2021
Event38th Computer Graphics International Conference, CGI 2021 - Virtual, Online
Duration: 6 Sep 202110 Sep 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13002 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference38th Computer Graphics International Conference, CGI 2021
CityVirtual, Online
Period6/09/2110/09/21

Keywords

  • Generative adversarial networks
  • Image processing
  • Image to image

Fingerprint

Dive into the research topics of 'CoPaint: Guiding Sketch Painting with Consistent Color and Coherent Generative Adversarial Networks'. Together they form a unique fingerprint.

Cite this