TY - GEN
T1 - LABEL-FREE REGIONAL CONSISTENCY FOR IMAGE-TO-IMAGE TRANSLATION
AU - Guo, Shaohua
AU - Zhou, Qianyu
AU - Zhou, Ye
AU - Gu, Qiqi
AU - Tang, Junshu
AU - Feng, Zhengyang
AU - Ma, Lizhuang
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021
Y1 - 2021
N2 - Image-to-Image translation aims to translate images from one domain to another. Existing approaches mainly stylize the images globally, while the local consistency between regions has been under-explored. Some instance-aware methods capture the regional consistency but heavily depend on well-annotated labels of a large-scale dataset. Besides, we observe that content-alike regions should have similar style between the target and translated images, however, little attention has been paid to explore such intrinsic property as explicit prior knowledge to guide the image translation process. In this paper, we aim to explore the label-free regional consistency for image-to-image translation. We propose regional relation consistency not only to maintain the global structure but also to keep a close look at the regional consistency, thus achieving more rigorous preservation of image contents. Moreover, we employ the phase of images as a semantic prior to select regions with similar content. We present phase-guided amplitude consistency to perform a more efficient local stylization. Extensive experiments verify that our approach outperforms the existing methods with a clear margin.
AB - Image-to-Image translation aims to translate images from one domain to another. Existing approaches mainly stylize the images globally, while the local consistency between regions has been under-explored. Some instance-aware methods capture the regional consistency but heavily depend on well-annotated labels of a large-scale dataset. Besides, we observe that content-alike regions should have similar style between the target and translated images, however, little attention has been paid to explore such intrinsic property as explicit prior knowledge to guide the image translation process. In this paper, we aim to explore the label-free regional consistency for image-to-image translation. We propose regional relation consistency not only to maintain the global structure but also to keep a close look at the regional consistency, thus achieving more rigorous preservation of image contents. Moreover, we employ the phase of images as a semantic prior to select regions with similar content. We present phase-guided amplitude consistency to perform a more efficient local stylization. Extensive experiments verify that our approach outperforms the existing methods with a clear margin.
KW - Image-to-Image translation
KW - local regional consistency
KW - style transfer
UR - https://www.scopus.com/pages/publications/85113433681
U2 - 10.1109/ICME51207.2021.9428211
DO - 10.1109/ICME51207.2021.9428211
M3 - 会议稿件
AN - SCOPUS:85113433681
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
BT - 2021 IEEE International Conference on Multimedia and Expo, ICME 2021
PB - IEEE Computer Society
T2 - 2021 IEEE International Conference on Multimedia and Expo, ICME 2021
Y2 - 5 July 2021 through 9 July 2021
ER -