Progressive scene text erasing with self-supervision

  • Xiangcheng Du
  • , Zhao Zhou
  • , Yingbin Zheng
  • , Xingjiao Wu
  • , Tianlong Ma
  • , Cheng Jin*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

Scene text erasing seeks to erase text contents from scene images and current state-of-the-art text erasing models are trained on large-scale synthetic data. Although data synthetic engines can provide vast amounts of annotated training samples, there are differences between synthetic and real-world data. In this paper, we employ self-supervision for feature representation on unlabeled real-world scene text images. A novel pretext task is designed to keep consistent among text stroke masks of image variants. We design the Progressive Erasing Network in order to remove residual texts. The scene text is erased progressively by leveraging the intermediate generated results which provide the foundation for subsequent higher quality results. Experiments show that our method significantly improves the generalization of the text erasing task and achieves state-of-the-art performance on public benchmarks.

Original languageEnglish
Article number103712
JournalComputer Vision and Image Understanding
Volume233
DOIs
StatePublished - Aug 2023
Externally publishedYes

Keywords

  • Progressive strategy
  • Scene text erasing
  • Self-supervision

Fingerprint

Dive into the research topics of 'Progressive scene text erasing with self-supervision'. Together they form a unique fingerprint.

Cite this