Exploring Versatile Prior for Human Motion via Motion Frequency Guidance

Jiachen Xu, Min Wang, Jingyu Gong, Wentao Liu, Chen Qian, Yuan Xie, Lizhuang Ma

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

Prior plays an important role in providing the plausible constraint on human motion. Previous works design motion priors following a variety of paradigms under different circumstances,leading to the lack of versatility. In this paper,we first summarize the indispensable properties of the motion prior,and accordingly,design a framework to learn the versatile motion prior,which models the inherent probability distribution of human motions. Specifically,for efficient prior representation learning,we propose a global orientation normalization to remove redundant environment information in the original motion data space. Also,a two-level,sequence-based and segment-based,frequency guidance is introduced into the encoding stage. Then,we adopt a denoising training scheme to disentangle the environment information from input motion data in a learnable way,so as to generate consistent and distinguishable representation. Embedding our motion prior into prevailing backbones on three different tasks,we conduct extensive experiments,and both quantitative and qualitative results demonstrate the versatility and effectiveness of our motion prior. Our model and code are available at https://github.com/JchenXu/human-motion-prior.

Original languageEnglish
Title of host publicationProceedings - 2021 International Conference on 3D Vision, 3DV 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages606-616
Number of pages11
ISBN (Electronic)9781665426886
DOIs
StatePublished - 2021
Event9th International Conference on 3D Vision, 3DV 2021 - Virtual, Online, United Kingdom
Duration: 1 Dec 20213 Dec 2021

Publication series

NameProceedings - 2021 International Conference on 3D Vision, 3DV 2021

Conference

Conference9th International Conference on 3D Vision, 3DV 2021
Country/TerritoryUnited Kingdom
CityVirtual, Online
Period1/12/213/12/21

Fingerprint

Dive into the research topics of 'Exploring Versatile Prior for Human Motion via Motion Frequency Guidance'. Together they form a unique fingerprint.

Cite this