Pose-Robust 3D Facial Landmark Estimation from a Single 2D Image

Brandon Smith and Charles Dyer

Abstract

An algorithm is presented that estimates 3D facial landmark coordinates and occlusion state from a single 2D image. Unlike previous approaches, we divide the 3D cascaded shape regression problem into a set of viewpoint domains, which helps avoid problems in the optimization, such as local minima at test time, and averaging conflicting gradient directions in the domain maps during training. These problems are especially important to address in the 3D case, where a wider range of head poses is expected. Parametric shape models are used and are shown to have several desirable qualities compared to the recent trend of modeling shape nonparametrically. Results show quantitatively that our approach is significantly more accurate than recent work.

Session

Posters 1

Files

PDF iconExtended Abstract (PDF, 487K)
PDF iconPaper (PDF, 2M)

DOI

10.5244/C.30.18
https://dx.doi.org/10.5244/C.30.18

Citation

Brandon Smith and Charles Dyer. Pose-Robust 3D Facial Landmark Estimation from a Single 2D Image. In Richard C. Wilson, Edwin R. Hancock and William A. P. Smith, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 18.1-18.12. BMVA Press, September 2016.

Bibtex

        @inproceedings{BMVC2016_18,
        	title={Pose-Robust 3D Facial Landmark Estimation from a Single 2D Image},
        	author={Brandon Smith and Charles Dyer},
        	year={2016},
        	month={September},
        	pages={18.1-18.12},
        	articleno={18},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.18},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.18}
        }