Weakly-Supervised Saliency Detection via Salient Object Subitizing

  • Xiaoyang Zheng
  • , Xin Tan
  • , Jie Zhou
  • , Lizhuang Ma*
  • , Rynson W.H. Lau*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

25 Scopus citations

Abstract

Salient object detection aims at detecting the most visually distinct objects and producing the corresponding masks. As the cost of pixel-level annotations is high, image tags are usually used as weak supervisions. However, an image tag can only be used to annotate one class of objects. In this paper, we introduce saliency subitizing as the weak supervision since it is class-agnostic. This allows the supervision to be aligned with the property of saliency detection, where the salient objects of an image could be from more than one class. To this end, we propose a model with two modules, Saliency Subitizing Module (SSM) and Saliency Updating Module (SUM). While SSM learns to generate the initial saliency masks using the subitizing information, without the need for any unsupervised methods or some random seeds, SUM helps iteratively refine the generated saliency masks. We conduct extensive experiments on five benchmark datasets. The experimental results show that our method outperforms other weakly-supervised methods and even performs comparable to some fully-supervised methods.

Original languageEnglish
Pages (from-to)4370-4380
Number of pages11
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume31
Issue number11
DOIs
StatePublished - 1 Nov 2021
Externally publishedYes

Keywords

  • Weak supervision
  • object subitizing
  • saliency detection

Fingerprint

Dive into the research topics of 'Weakly-Supervised Saliency Detection via Salient Object Subitizing'. Together they form a unique fingerprint.

Cite this