Evaluation of dense 3D reconstruction from 2D face images in the wild

Citation

Feng Z, Huber P, Kittler J, Hancock P, Wu X, Zhao Q, Koppen P & Raetsch M (2018) Evaluation of dense 3D reconstruction from 2D face images in the wild. In: 2018 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018). 13th IEEE International Conference on Automatic Face and Gesture Recognition, 15.05.2018-19.05.2018. Xi'an, China: Institute of Electrical and Electronics Engineers Inc. pp. 780-786. https://doi.org/10.1109/FG.2018.00123

Abstract
This paper investigates the evaluation of dense 3D face reconstruction from a single 2D image in the wild. To this end, we organise a competition that provides a new benchmark dataset that contains 2000 2D facial images of 135 subjects as well as their 3D ground truth face scans. In contrast to previous competitions or challenges, the aim of this new benchmark dataset is to evaluate the accuracy of a 3D dense face reconstruction algorithm using real, accurate and high-resolution 3D ground truth face scans. In addition to the dataset, we provide a standard protocol as well as a Python script for the evaluation. Last, we report the results obtained by three state-of-the-art 3D face reconstruction systems on the new benchmark dataset. The competition is organised along with the 2018 13th IEEE Conference on Automatic Face & Gesture Recognition.

Keywords
Face; Three-dimensional displays; Two dimensional displays; Image reconstruction; Benchmark testing; Protocols; Nose

People

Professor Peter Hancock

Professor, Psychology