Skip to main navigation Skip to search Skip to main content

The first 3D face alignment in the wild (3DFAW) challenge

  • László A. Jeni
  • , Sergey Tulyakov
  • , Lijun Yin
  • , Nicu Sebe
  • , Jeffrey F. Cohn
  • Carnegie Mellon University
  • University of Trento
  • University of Pittsburgh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

27 Scopus citations

Abstract

2D alignment of face images works well provided images are frontal or nearly so and pitch and yaw remain modest. In spontaneous facial behavior, these constraints often are violated by moderate to large head rotation. 3D alignment from 2D video has been proposed as a solution. A number of approaches have been explored, but comparisons among them have been hampered by the lack of common test data. To enable comparisons among alternative methods, The 3D Face Alignment in the Wild (3DFAW) Challenge, presented for the first time, created an annotated corpus of over 23, 000 multi-view images from four sources together with 3D annotation, made training and validation sets available to investigators, and invited them to test their algorithms on an independent test-set. Eight teams accepted the challenge and submitted test results. We report results for four that provided necessary technical descriptions of their methods. The leading approach achieved prediction consistency error of 3.48%. Corresponding result for the lowest ranked approach was 5.9%. The results suggest that 3D alignment from 2D video is feasible on a wide range of face orientations. Differences among methods are considered and suggest directions for further research.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2016 Workshops, Proceedings
EditorsGang Hua, Herve Jegou
PublisherSpringer Verlag
Pages511-520
Number of pages10
ISBN (Print)9783319488806
DOIs
StatePublished - 2016
EventComputer Vision - ECCV 2016 Workshops, Proceedings - Amsterdam, Netherlands
Duration: Oct 8 2016Oct 16 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9914 LNCS

Conference

ConferenceComputer Vision - ECCV 2016 Workshops, Proceedings
Country/TerritoryNetherlands
CityAmsterdam
Period10/8/1610/16/16

Keywords

  • 3D alignment from 2D video
  • Faces in-the-wild
  • Head rotation
  • Prediction consistency error

Fingerprint

Dive into the research topics of 'The first 3D face alignment in the wild (3DFAW) challenge'. Together they form a unique fingerprint.

Cite this