TY - GEN
T1 - Exploring Versatile Prior for Human Motion via Motion Frequency Guidance
AU - Xu, Jiachen
AU - Wang, Min
AU - Gong, Jingyu
AU - Liu, Wentao
AU - Qian, Chen
AU - Xie, Yuan
AU - Ma, Lizhuang
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Prior plays an important role in providing the plausible constraint on human motion. Previous works design motion priors following a variety of paradigms under different circumstances,leading to the lack of versatility. In this paper,we first summarize the indispensable properties of the motion prior,and accordingly,design a framework to learn the versatile motion prior,which models the inherent probability distribution of human motions. Specifically,for efficient prior representation learning,we propose a global orientation normalization to remove redundant environment information in the original motion data space. Also,a two-level,sequence-based and segment-based,frequency guidance is introduced into the encoding stage. Then,we adopt a denoising training scheme to disentangle the environment information from input motion data in a learnable way,so as to generate consistent and distinguishable representation. Embedding our motion prior into prevailing backbones on three different tasks,we conduct extensive experiments,and both quantitative and qualitative results demonstrate the versatility and effectiveness of our motion prior. Our model and code are available at https://github.com/JchenXu/human-motion-prior.
AB - Prior plays an important role in providing the plausible constraint on human motion. Previous works design motion priors following a variety of paradigms under different circumstances,leading to the lack of versatility. In this paper,we first summarize the indispensable properties of the motion prior,and accordingly,design a framework to learn the versatile motion prior,which models the inherent probability distribution of human motions. Specifically,for efficient prior representation learning,we propose a global orientation normalization to remove redundant environment information in the original motion data space. Also,a two-level,sequence-based and segment-based,frequency guidance is introduced into the encoding stage. Then,we adopt a denoising training scheme to disentangle the environment information from input motion data in a learnable way,so as to generate consistent and distinguishable representation. Embedding our motion prior into prevailing backbones on three different tasks,we conduct extensive experiments,and both quantitative and qualitative results demonstrate the versatility and effectiveness of our motion prior. Our model and code are available at https://github.com/JchenXu/human-motion-prior.
UR - https://www.scopus.com/pages/publications/85125008462
U2 - 10.1109/3DV53792.2021.00070
DO - 10.1109/3DV53792.2021.00070
M3 - 会议稿件
AN - SCOPUS:85125008462
T3 - Proceedings - 2021 International Conference on 3D Vision, 3DV 2021
SP - 606
EP - 616
BT - Proceedings - 2021 International Conference on 3D Vision, 3DV 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 9th International Conference on 3D Vision, 3DV 2021
Y2 - 1 December 2021 through 3 December 2021
ER -