Structured Semi-supervised Forest for Facial Landmarks Localization with Face Mask Reasoning

Xuhui Jia, Heng Yang, Kwok-Ping Chan and ioannis Patras

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.85

Abstract

Despite the great success of recent facial landmarks localization approaches, the presence of occlusions significantly degrades the performance of the systems. However, very few works have addressed this problem explicitly due to the high diversity of occlusion in real world. In this paper, we address the face mask reasoning and facial landmarks localization in an unified Structured Decision Forests framework. We first assign a portion of the face dataset with face masks, i.e., for each face image we give each pixel a label to indicate whether it belongs to the face or not. Then we incorporate such additional information of dense pixel labelling into the training of the Structured Classification-Regression Decision Forest. The classification nodes aim at decreasing the variance of the pixel labels of the patches by using our proposed structured criterion while the regression nodes aim at decreasing the variance of the displacements between the patches and the facial landmarks. The proposed framework allows us to predict the face mask and facial landmarks locations jointly. We test the model on face images from several datasets with significant occlusion. The proposed method 1) yields promising results in face mask reasoning; 2) improves the existing Decision Forests approaches in facial landmark localization, aided by the face mask reasoning.

Session

Poster Session

Files

Extended Abstract (PDF, 1 page, 588K)

Paper (PDF, 13 pages, 2.6M)

Bibtex File

Citation

Xuhui Jia, Heng Yang, Kwok-Ping Chan, and ioannis Patras. Structured Semi-supervised Forest for Facial Landmarks Localization with Face Mask Reasoning. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.85
	title = {Structured Semi-supervised Forest for Facial Landmarks Localization with Face Mask Reasoning},
	author = {Jia, Xuhui and Yang, Heng and Chan, Kwok-Ping and Patras, ioannis},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.85 }
}