CSAGAN: Channel and Spatial Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Rui Yang, Chao Peng, Chenchao Wang, Mengdan Wang, Yao Chen, Peng Zheng, Neal N. Xiong

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Unsupervised image-to-image translation is to learn a mapping function from one image domain to another with unpaired samples, which is an important task of computer vision. However, current unsupervised image-to-image translation methods only perform well on certain datasets. To handle the limitation, this paper proposes a novel framework termed as CSAGAN which contains a new discriminator structure, a novel attention module, and a new normalized function. The discriminator is an attention-guided feature pyramid discriminator which makes use of low-level and high-level features to determine an image's realness. The new attention module integrating channel attention and spatial attention can guide generators focus on the most discriminative regions of feature maps to generate high-quality translated images. Moreover, our attention module embedded into generators requires less computation compared with other self-attention methods. In addition, the new normalized function helps generators limberly control the variation of shape, color, and texture through learning parameters. Experimental results indicate that our approach performs better than the current state-of-the-art methods.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3258-3265
Number of pages8
ISBN (Electronic)9781665442077
DOIs
StatePublished - 2021
Event2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021 - Melbourne, Australia
Duration: 17 Oct 202120 Oct 2021

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X

Conference

Conference2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021
Country/TerritoryAustralia
CityMelbourne
Period17/10/2120/10/21

Keywords

  • Attention
  • Generative Adversarial Networks
  • Unsupervised Image-to-Image Translation

Fingerprint

Dive into the research topics of 'CSAGAN: Channel and Spatial Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation'. Together they form a unique fingerprint.

Cite this