跳到主要导航 跳到搜索 跳到主要内容

Spatial–Temporal Decoupled Invertible Neural Networks for Skeleton-Based Video Anomaly Detection

  • Yang Liu
  • , Lei Zhang
  • , Juncen Guo
  • , Lulu Guo
  • , Zhenghao Niu
  • , Jing Liu
  • , Dingkang Yang*
  • , Jiangchuan Liu
  • , Hong Chen
  • *此作品的通讯作者
  • College of Electronic and Information Engineering
  • Tongji University
  • College of Intelligent Robotics and Advanced Manufacturing
  • Fudan University
  • College of Computer Science and Artificial Intelligence
  • Department of Electrical and Computer Engineering
  • University of British Columbia
  • College of Future Information Technology
  • Physics AI
  • Multimedia Laboratory (MMLab)
  • Chinese University of Hong Kong
  • School of Computing Science
  • Simon Fraser University

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Skeleton-based video anomaly detection has gained significant attention in security and forensics applications due to its privacy-preserving properties that abstract human motion without capturing identifiable biometric information. However, existing methods typically process spatial pose configurations and temporal motion dynamics in an entangled manner, limiting both interpretability and discriminative power. We observe that anomalies manifest distinctly in spatial and temporal dimensions: spatial anomalies correspond to unusual body configurations while temporal anomalies reflect irregular motion patterns. To explicitly model this decomposition, we propose Spatial-Temporal Decoupled Invertible Neural Networks (STD-INN) that separates spatial and temporal information within normalizing flow architectures for precise anomaly detection. Specifically, STD-INN introduces a learnable invertible decomposition mechanism that adaptively splits encoded skeleton features into spatial components capturing pose structures and temporal components encoding motion dynamics. We then model them using dual independent normalizing flows: the spatial flow incorporates graph convolutional networks to leverage skeletal topology, while the temporal flow employs causal temporal convolutions to capture sequential dependencies. A lightweight cross-calibration module enables controlled information exchange between the two streams. Extensive experiments on benchmark datasets demonstrate that STD-INN achieves state-of-the-art performance with lightweight parameters while offering improved diagnostic interpretability compared to existing approaches.

源语言英语
页(从-至)7951-7966
页数16
期刊IEEE Transactions on Information Forensics and Security
卷21
DOI
出版状态已出版 - 2026
已对外发布是

学术指纹

探究 'Spatial–Temporal Decoupled Invertible Neural Networks for Skeleton-Based Video Anomaly Detection' 的科研主题。它们共同构成独一无二的学术指纹。

引用此