Holistically Constrained Local Model: Going Beyond Frontal Poses for Facial Landmark Detection

Kanggeon Kim, Tadas Baltrušaitis, Amirali Zadeh, Louis-Philippe Morency and Gérard Medioni

Abstract

Facial landmark detection has received much attention in recent years, with two detection paradigms emerging: local approaches, where each facial landmark is modeled individually and with the help of a shape model; and holistic approaches, where the whole face appearance is jointly modeled for improved robustness. These approaches have shown great performance for facial landmark detection even under "in-the-wild" conditions of varying illumination, occlusion and image quality. However, their accuracy and robustness are very often reduced for profile faces where face alignment is more challenging (e.g., no more facial symmetry, less defined features and more variable background). In this paper, we present a new model, named Holistically Constrained Local Model (HCLM), which unifies local and holistic facial landmark detection by integrating head pose estimation, sparse-holistic landmark detection and dense-local landmark detection. We evaluate our new model on two publicly available datasets, 300-W and AFLW, as well as a newly introduced dataset, IJB-FL which includes a larger proportion of profile face poses. Our HCLM model shows state-of-the-art performance, especially with extreme head poses.

Session

Posters 2

Files

Extended Abstract (PDF, 130K)
Paper (PDF, 1M)

DOI

10.5244/C.30.95
https://dx.doi.org/10.5244/C.30.95

Citation

Bibtex

        @inproceedings{BMVC2016_95,
        	title={Holistically Constrained Local Model: Going Beyond Frontal Poses for Facial Landmark Detection},
            author={Kanggeon Kim, Tadas Baltru\v{s}aitis, Amirali Zadeh, Louis-Philippe Morency and G{\'e}rard Medioni},
        	year={2016},
        	month={September},
        	pages={95.1-95.12},
        	articleno={95},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.95},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.95}
        }