Scanpath Prediction Based on High-Level Features and Memory Bias

  • Xuan Shao
  • , Ye Luo*
  • , Dandan Zhu
  • , Shuqin Li
  • , Laurent Itti
  • , Jianwei Lu
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

Human scanpath prediction aims to use computational models to mimic human gaze shifts under free view conditions. Previous works utilizing low-level features, hand-crafted high-level features, saccadic amplitude, memory bias cannot fully explain the mechanism of visual attention. In this paper, we propose a comprehensive method to predict scanpath from four aspects: low-level features, saccadic amplitude, semantic features learned via deep convolutional neural network, memory bias including short-term and long-term memory. By calculating the probabilities for all candidate regions in an image, the position of next fixation point can be selected via picking the one with the largest probability product. Moreover, fixation duration as a key factor is first used to model memory effect on scanpath prediction. Experiments on two public datasets demonstrate the effectiveness of the proposed method, and comparisons with state-of-the-art methods further validate the superiority of our method.

Original languageEnglish
Title of host publicationNeural Information Processing - 24th International Conference, ICONIP 2017, Proceedings
EditorsDerong Liu, Shengli Xie, El-Sayed M. El-Alfy, Dongbin Zhao, Yuanqing Li
PublisherSpringer Verlag
Pages3-13
Number of pages11
ISBN (Print)9783319700892
DOIs
StatePublished - 2017
Externally publishedYes
Event24th International Conference on Neural Information Processing, ICONIP 2017 - Guangzhou, China
Duration: 14 Nov 201718 Nov 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10636 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Conference on Neural Information Processing, ICONIP 2017
Country/TerritoryChina
CityGuangzhou
Period14/11/1718/11/17

Keywords

  • Fixation duration
  • Memory bias
  • Scanpath prediction
  • Semantic features

Fingerprint

Dive into the research topics of 'Scanpath Prediction Based on High-Level Features and Memory Bias'. Together they form a unique fingerprint.

Cite this