Inter-Observer Visual Congruency in Video-Viewing

Jiaomin Yue, Qiang Lu, Dandan Zhu, Xiongkuo Min, Xiao Ping Zhang, Guangtao Zhai

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

There are individual differences in human visual attention between observers when viewing the same scene. Inter-observer visual congruency (IOVC) describes the dispersion between different people's visual attention areas when they observe the same stimulus. Research on the IOVC of video is interesting but lacking. In this paper, we first introduce the measurement to calculate the IOVC of video. and an eye-tracking experiment is conducted in a realistic movie-watching environment to establish a movie scene dataset. Then we propose a method to predict the IOVC of video, which employs a dual-channel network to extract and integrate content and optical flow features. The effectiveness of the proposed prediction model is validated on our dataset. and the correlation between inter-observer congruency and video emotion is analyzed.

Original languageEnglish
Title of host publication2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728185514
DOIs
StatePublished - 2021
Externally publishedYes
Event2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Munich, Germany
Duration: 5 Dec 20218 Dec 2021

Publication series

Name2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings

Conference

Conference2021 International Conference on Visual Communications and Image Processing, VCIP 2021
Country/TerritoryGermany
CityMunich
Period5/12/218/12/21

Keywords

  • Inter-observer visual congruency
  • Movie analysis
  • Neural network
  • Visual attention

Fingerprint

Dive into the research topics of 'Inter-Observer Visual Congruency in Video-Viewing'. Together they form a unique fingerprint.

Cite this