Real-time 2.5D facial cartoon animation based on pose and expression estimation

Jiajun Yu, Zhifeng Xie, Dongjin Huang, Youdong Ding, Shi Tang, Lizhuang Ma

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

In this paper, a real-time facial animation system is presented, that captures live facial expressions and poses from user, and uses them to animate a synthetic 2.5D cartoon character (Avatar) in real-time. Compared to existing 3D Avatar systems, the 2.5D cartoon models are easier to create than full 3D model, and the cartoon-style drawings are more popular among young people. Our system requires only an ordinary PC camera, and the initialization is fully automatic. We established a mapping from real-time facial motion to the atomic motion parameters of the cartoon model by pose and expression estimation. The animation is driven by these parameters in the way of blend shape interpolation.

Original languageEnglish
Title of host publicationProceedings - 2015 International Conference on Virtual Reality and Visualization, ICVRV 2015
EditorsZhong Zhou, Weiliang Meng, Junfeng Yao, Xiaopeng Zhang, Xun Luo
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages185-192
Number of pages8
ISBN (Electronic)9781467376730
DOIs
StatePublished - 9 May 2016
Externally publishedYes
Event5th International Conference on Virtual Reality and Visualization, ICVRV 2015 - Xiamen, Fujian, China
Duration: 17 Oct 201518 Oct 2015

Publication series

NameProceedings - 2015 International Conference on Virtual Reality and Visualization, ICVRV 2015

Conference

Conference5th International Conference on Virtual Reality and Visualization, ICVRV 2015
Country/TerritoryChina
CityXiamen, Fujian
Period17/10/1518/10/15

Keywords

  • Avatar
  • Blendshape
  • Cartoon
  • Facial animation

Fingerprint

Dive into the research topics of 'Real-time 2.5D facial cartoon animation based on pose and expression estimation'. Together they form a unique fingerprint.

Cite this