跳到主要导航 跳到搜索 跳到主要内容

TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generation

  • Tianyi Liang
  • , Jiangqi Liu
  • , Yifei Huang
  • , Shiqi Jiang
  • , Jianshen Shi
  • , Changbo Wang
  • , Chenhui Li*
  • *此作品的通讯作者
  • East China Normal University
  • Shanghai Institute of AI for Education
  • Shanghai AI Laboratory

科研成果: 期刊稿件会议文章同行评审

摘要

Text-to-image (T2I) generation has made remarkable progress in producing high-quality images, but a fundamental challenge remains: creating backgrounds that naturally accommodate text placement without compromising image quality. This capability is non-trivial for real-world applications like graphic design, where clear visual hierarchy between content and text is essential. Prior work has primarily focused on arranging layouts within existing static images, leaving unexplored the potential of T2I models for generating text-friendly backgrounds. We present TextCenGen, a training-free dynamic background adaptation in the blank region for text-friendly image generation. Instead of directly reducing attention in text areas, which degrades image quality, we relocate conflicting objects before background optimization. Our method analyzes cross-attention maps to identify conflicting objects overlapping with text regions and uses a force-directed graph approach to guide their relocation, followed by attention excluding constraints to ensure smooth backgrounds. Our method is plug-and-play, requiring no additional training while well balancing both semantic fidelity and visual quality. Evaluated on our proposed text-friendly T2I benchmark of 27,000 images across four seed datasets, TextCenGen outperforms existing methods by achieving 23% lower saliency overlap in text regions while maintaining 98% of the semantic fidelity measured by CLIP score and our proposed Visual-Textual Concordance Metric (VTCM).

源语言英语
页(从-至)37237-37256
页数20
期刊Proceedings of Machine Learning Research
267
出版状态已出版 - 2025
活动42nd International Conference on Machine Learning, ICML 2025 - Vancouver, 加拿大
期限: 13 7月 202519 7月 2025

指纹

探究 'TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generation' 的科研主题。它们共同构成独一无二的指纹。

引用此