Skip to main navigation Skip to search Skip to main content

Spatial–Temporal Decoupled Invertible Neural Networks for Skeleton-Based Video Anomaly Detection

  • Yang Liu
  • , Lei Zhang
  • , Juncen Guo
  • , Lulu Guo
  • , Zhenghao Niu
  • , Jing Liu
  • , Dingkang Yang*
  • , Jiangchuan Liu
  • , Hong Chen
  • *Corresponding author for this work
  • College of Electronic and Information Engineering
  • Tongji University
  • College of Intelligent Robotics and Advanced Manufacturing
  • Fudan University
  • College of Computer Science and Artificial Intelligence
  • Department of Electrical and Computer Engineering
  • University of British Columbia
  • College of Future Information Technology
  • Physics AI
  • Multimedia Laboratory (MMLab)
  • Chinese University of Hong Kong
  • School of Computing Science
  • Simon Fraser University

Research output: Contribution to journal › Article › peer-review

Abstract

Skeleton-based video anomaly detection has gained significant attention in security and forensics applications due to its privacy-preserving properties that abstract human motion without capturing identifiable biometric information. However, existing methods typically process spatial pose configurations and temporal motion dynamics in an entangled manner, limiting both interpretability and discriminative power. We observe that anomalies manifest distinctly in spatial and temporal dimensions: spatial anomalies correspond to unusual body configurations while temporal anomalies reflect irregular motion patterns. To explicitly model this decomposition, we propose Spatial-Temporal Decoupled Invertible Neural Networks (STD-INN) that separates spatial and temporal information within normalizing flow architectures for precise anomaly detection. Specifically, STD-INN introduces a learnable invertible decomposition mechanism that adaptively splits encoded skeleton features into spatial components capturing pose structures and temporal components encoding motion dynamics. We then model them using dual independent normalizing flows: the spatial flow incorporates graph convolutional networks to leverage skeletal topology, while the temporal flow employs causal temporal convolutions to capture sequential dependencies. A lightweight cross-calibration module enables controlled information exchange between the two streams. Extensive experiments on benchmark datasets demonstrate that STD-INN achieves state-of-the-art performance with lightweight parameters while offering improved diagnostic interpretability compared to existing approaches.

Original languageEnglish
Pages (from-to)7951-7966
Number of pages16
JournalIEEE Transactions on Information Forensics and Security
Volume21
DOIs
StatePublished - 2026
Externally publishedYes

Keywords

  • Video anomaly detection
  • normalizing flows
  • privacy-preserving surveillance systems
  • spatial-temporal decomposition
  • video forensics

Fingerprint

Dive into the research topics of 'Spatial–Temporal Decoupled Invertible Neural Networks for Skeleton-Based Video Anomaly Detection'. Together they form a unique fingerprint.

Cite this