TY - JOUR
T1 - Multi-View Analysis of Facial Expressions in Minimally Verbal Autism
T2 - Preliminary Evidence From Social Communication Observations
AU - Qu, Lu
AU - Yin, Tongxin
AU - Zeng, Jiabei
AU - Zhang, Yuqi
AU - Han, Xuling
AU - Liu, Min
AU - Chang, Fei
AU - Yuan, Yujian
AU - Shan, Shiguang
AU - Zhao, Hang
AU - Liu, Qiaoyun
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2026.
PY - 2026
Y1 - 2026
N2 - Purpose: Minimally verbal children with autism spectrum disorder (ASD) face profound challenges in social-emotional communication, but objective methods to quantify their facial expression patterns remain limited. This study applied an automated multi-view facial expression recognition (mFER) approach to examine the frequency, synchrony, and social directedness of facial expressions in minimally verbal children with ASD. Methods: Fifty-two children aged 3–6 years participated: 18 with ASD, 17 with global developmental delay (GDD), and 17 typically developing (TD) peers. Children engaged in the Smart Observation for Social Communication (SOSC), a series of semi-structured, interaction-based activities adapted from the ADOS-2. Four synchronized cameras captured facial expressions, which were analyzed using a multi-view computer vision analysis. Results: Compared with TD peers, the ASD group showed a higher probability of Neutral and Sad expressions and a lower probability of Happiness. These group differences were context-specific, with reduced positive affect during playful interactive activities (e.g., Peekaboo) and increased Sadness during task-based activities (e.g., Puzzle). Children with ASD showed lower facial expression synchrony with the examiner and fewer socially directed expressions. Facial expression features were significantly associated with standardized measures of adaptive functioning and autism symptom severity. Conclusion: Integrating the Smart Observation for Social Communication system with multi-view facial expression analysis revealed that children with ASD exhibit context-specific increases in neutral and sad facial expression alongside reduced happiness, synchrony, and socially directed expressions. These clinically valuable features correlated significantly with standardized diagnostic scores, demonstrating the framework’s potential for objective diagnostic complement and outcome monitoring in minimally verbal autism.
AB - Purpose: Minimally verbal children with autism spectrum disorder (ASD) face profound challenges in social-emotional communication, but objective methods to quantify their facial expression patterns remain limited. This study applied an automated multi-view facial expression recognition (mFER) approach to examine the frequency, synchrony, and social directedness of facial expressions in minimally verbal children with ASD. Methods: Fifty-two children aged 3–6 years participated: 18 with ASD, 17 with global developmental delay (GDD), and 17 typically developing (TD) peers. Children engaged in the Smart Observation for Social Communication (SOSC), a series of semi-structured, interaction-based activities adapted from the ADOS-2. Four synchronized cameras captured facial expressions, which were analyzed using a multi-view computer vision analysis. Results: Compared with TD peers, the ASD group showed a higher probability of Neutral and Sad expressions and a lower probability of Happiness. These group differences were context-specific, with reduced positive affect during playful interactive activities (e.g., Peekaboo) and increased Sadness during task-based activities (e.g., Puzzle). Children with ASD showed lower facial expression synchrony with the examiner and fewer socially directed expressions. Facial expression features were significantly associated with standardized measures of adaptive functioning and autism symptom severity. Conclusion: Integrating the Smart Observation for Social Communication system with multi-view facial expression analysis revealed that children with ASD exhibit context-specific increases in neutral and sad facial expression alongside reduced happiness, synchrony, and socially directed expressions. These clinically valuable features correlated significantly with standardized diagnostic scores, demonstrating the framework’s potential for objective diagnostic complement and outcome monitoring in minimally verbal autism.
KW - Autism; Facial expression
KW - Computer vision
KW - Minimally verbal autism
UR - https://www.scopus.com/pages/publications/105035845125
U2 - 10.1007/s10803-026-07333-0
DO - 10.1007/s10803-026-07333-0
M3 - 文章
AN - SCOPUS:105035845125
SN - 0162-3257
JO - Journal of Autism and Developmental Disorders
JF - Journal of Autism and Developmental Disorders
ER -