跳到主要导航 跳到搜索 跳到主要内容

Cross Attention Based Style Distribution for Controllable Person Image Synthesis

  • Xinyue Zhou
  • , Mingyu Yin
  • , Xinyuan Chen
  • , Li Sun*
  • , Changxin Gao
  • , Qingli Li
  • *此作品的通讯作者
  • East China Normal University
  • Shanghai AI Laboratory
  • Huazhong University of Science and Technology

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Controllable person image synthesis task enables a wide range of applications through explicit control over body pose and appearance. In this paper, we propose a cross attention based style distribution module that computes between the source semantic styles and target pose for pose transfer. The module intentionally selects the style represented by each semantic and distributes them according to the target pose. The attention matrix in cross attention expresses the dynamic similarities between the target pose and the source styles for all semantics. Therefore, it can be utilized to route the color and texture from the source image, and is further constrained by the target parsing map to achieve a clearer objective. At the same time, to encode the source appearance accurately, the self attention among different semantic styles is also added. The effectiveness of our model is validated quantitatively and qualitatively on pose transfer and virtual try-on tasks. Codes are available at https://github.com/xyzhouo/CASD.

源语言英语
主期刊名Computer Vision – ECCV 2022 - 17th European Conference, Proceedings
编辑Shai Avidan, Gabriel Brostow, Moustapha Cissé, Giovanni Maria Farinella, Tal Hassner
出版商Springer Science and Business Media Deutschland GmbH
页161-178
页数18
ISBN(印刷版)9783031197833
DOI
出版状态已出版 - 2022
活动17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, 以色列
期限: 23 10月 2022 → 27 10月 2022

丛书

姓名Lecture Notes in Computer Science
卷13675 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议17th European Conference on Computer Vision, ECCV 2022
国家/地区以色列
市Tel Aviv
时期23/10/22 → 27/10/22

学术指纹

探究 'Cross Attention Based Style Distribution for Controllable Person Image Synthesis' 的科研主题。它们共同构成独一无二的学术指纹。

引用此