Fast and precise face alignment and 3D shape reconstruction from a single 2D image

  • Ruiqi Zhao
  • , Yan Wang
  • , C. Fabian Benitez-Quiroz
  • , Yaojie Liu
  • , Aleix M. Martinez*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

24 Scopus citations

Abstract

Many face recognition applications require a precise 3D reconstruction of the shape of the face, even when only a single 2D image is available. We present a novel regression approach that learns to detect facial landmark points and estimate their 3D shape rapidly and accurately from a single face image. The main idea is to regress a function f (.) that maps 2D images of faces to their corresponding 3D shape from a large number of sample face images under varying pose, illumination, identity and expression. To model the non-linearity of this function, we use a deep neural network and demonstrate how it can be efficiently trained using a large number of samples. During testing, our algorithm runs at more than 30 frames/s on an i7 desktop. This algorithm was the top 2 performer in the 3DFAW Challenge.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2016 Workshops, Proceedings
EditorsGang Hua, Herve Jegou
PublisherSpringer Verlag
Pages590-603
Number of pages14
ISBN (Print)9783319488806
DOIs
StatePublished - 2016
Externally publishedYes
EventComputer Vision - ECCV 2016 Workshops, Proceedings - Amsterdam, Netherlands
Duration: 8 Oct 201616 Oct 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9914 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceComputer Vision - ECCV 2016 Workshops, Proceedings
Country/TerritoryNetherlands
CityAmsterdam
Period8/10/1616/10/16

Keywords

  • 3D modeling and reconstruction of faces
  • 3D shape from a single 2D image
  • Fine-grained detection
  • Precise and detailed detections

Fingerprint

Dive into the research topics of 'Fast and precise face alignment and 3D shape reconstruction from a single 2D image'. Together they form a unique fingerprint.

Cite this