TY - JOUR
T1 - OPO-FCM
T2 - A Computational Affection Based OCC-PAD-OCEAN Federation Cognitive Modeling Approach
AU - Liu, Feng
AU - Wang, Han Yang
AU - Shen, Si Yuan
AU - Jia, Xun
AU - Hu, Jing Yi
AU - Zhang, Jia Hao
AU - Wang, Xi Yi
AU - Lei, Ying
AU - Zhou, Ai Min
AU - Qi, Jia Yin
AU - Li, Zhi Bin
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2023/8/1
Y1 - 2023/8/1
N2 - In recent years, it is a difficult issue to integrate the deep cross-fertilization and interpretable cognitive modeling methods from the basic theory of emotional psychology with deep learning and other algorithms. To address this problem, a cognitive model that integrates the VGG-facial action coding system (FACS)-OCC model based on fer2013 expression features and the OCC-pleasure-arousal-dominance (PAD)-openness, conscientiousness, extraversion, agreeableness, and neuroticism (OCEAN) fusion of the basic theory of emotional psychology, namely, a computational affection-based OCC-PAD-OCEAN federation cognitive modeling (OPO-FCM), is constructed. By constructing this model and performing formal proof algorithms, it is shown that the OPO-FCM can acquire expression features in video streams, complete the acquisition of expression features in videos by training a deep neural network, map expressions to the PAD emotion space through the established expression-basic emotions-emotion space mapping relationship, and finally complete the mapping of the average emotion over a period time. The information of personality space is obtained through it. Finally, the experimental simulation of the model is conducted, and the results show that the average accuracy of the valid tested personalities is 79.56%. This article takes the knowledge-driven approach of emotional psychology as a starting point and combines deep learning techniques to construct interpretable cognitive models, thus providing new ideas for future cross-innovation between computer technology and psychology theory.
AB - In recent years, it is a difficult issue to integrate the deep cross-fertilization and interpretable cognitive modeling methods from the basic theory of emotional psychology with deep learning and other algorithms. To address this problem, a cognitive model that integrates the VGG-facial action coding system (FACS)-OCC model based on fer2013 expression features and the OCC-pleasure-arousal-dominance (PAD)-openness, conscientiousness, extraversion, agreeableness, and neuroticism (OCEAN) fusion of the basic theory of emotional psychology, namely, a computational affection-based OCC-PAD-OCEAN federation cognitive modeling (OPO-FCM), is constructed. By constructing this model and performing formal proof algorithms, it is shown that the OPO-FCM can acquire expression features in video streams, complete the acquisition of expression features in videos by training a deep neural network, map expressions to the PAD emotion space through the established expression-basic emotions-emotion space mapping relationship, and finally complete the mapping of the average emotion over a period time. The information of personality space is obtained through it. Finally, the experimental simulation of the model is conducted, and the results show that the average accuracy of the valid tested personalities is 79.56%. This article takes the knowledge-driven approach of emotional psychology as a starting point and combines deep learning techniques to construct interpretable cognitive models, thus providing new ideas for future cross-innovation between computer technology and psychology theory.
KW - Cognitive modeling
KW - OCC-pleasure-arousal-dominance (PAD)-openness
KW - VGG-facial action coding system (FACS)-OCC
KW - agreeableness
KW - and neuroticism (OCEAN)
KW - computational affection
KW - conscientiousness
KW - emotional psychology
KW - extraversion
KW - five-factor model (FFM)
UR - https://www.scopus.com/pages/publications/85137604942
U2 - 10.1109/TCSS.2022.3199119
DO - 10.1109/TCSS.2022.3199119
M3 - 文章
AN - SCOPUS:85137604942
SN - 2329-924X
VL - 10
SP - 1813
EP - 1825
JO - IEEE Transactions on Computational Social Systems
JF - IEEE Transactions on Computational Social Systems
IS - 4
ER -