OPO-FCM: A Computational Affection Based OCC-PAD-OCEAN Federation Cognitive Modeling Approach

Feng Liu, Han Yang Wang, Si Yuan Shen, Xun Jia, Jing Yi Hu, Jia Hao Zhang, Xi Yi Wang, Ying Lei, Ai Min Zhou, Jia Yin Qi, Zhi Bin Li

Research output: Contribution to journalArticlepeer-review

22 Scopus citations

Abstract

In recent years, it is a difficult issue to integrate the deep cross-fertilization and interpretable cognitive modeling methods from the basic theory of emotional psychology with deep learning and other algorithms. To address this problem, a cognitive model that integrates the VGG-facial action coding system (FACS)-OCC model based on fer2013 expression features and the OCC-pleasure-arousal-dominance (PAD)-openness, conscientiousness, extraversion, agreeableness, and neuroticism (OCEAN) fusion of the basic theory of emotional psychology, namely, a computational affection-based OCC-PAD-OCEAN federation cognitive modeling (OPO-FCM), is constructed. By constructing this model and performing formal proof algorithms, it is shown that the OPO-FCM can acquire expression features in video streams, complete the acquisition of expression features in videos by training a deep neural network, map expressions to the PAD emotion space through the established expression-basic emotions-emotion space mapping relationship, and finally complete the mapping of the average emotion over a period time. The information of personality space is obtained through it. Finally, the experimental simulation of the model is conducted, and the results show that the average accuracy of the valid tested personalities is 79.56%. This article takes the knowledge-driven approach of emotional psychology as a starting point and combines deep learning techniques to construct interpretable cognitive models, thus providing new ideas for future cross-innovation between computer technology and psychology theory.

Original languageEnglish
Pages (from-to)1813-1825
Number of pages13
JournalIEEE Transactions on Computational Social Systems
Volume10
Issue number4
DOIs
StatePublished - 1 Aug 2023

Keywords

  • Cognitive modeling
  • OCC-pleasure-arousal-dominance (PAD)-openness
  • VGG-facial action coding system (FACS)-OCC
  • agreeableness
  • and neuroticism (OCEAN)
  • computational affection
  • conscientiousness
  • emotional psychology
  • extraversion
  • five-factor model (FFM)

Fingerprint

Dive into the research topics of 'OPO-FCM: A Computational Affection Based OCC-PAD-OCEAN Federation Cognitive Modeling Approach'. Together they form a unique fingerprint.

Cite this