Improving 3D Facial Action Unit Detection with Intrinsic Normalization

Eric Yudin, Aaron Wetzler, Matan Sela and Ron Kimmel

Abstract

Data normalization techniques are commonly used to reduce intra-class variance while preserving inter-class differences that aid in classification and regression tasks. Such practices bring all data examples to similar scale and range, and help to decrease the dimensionality of categorization problems. In this paper we describe a novel use of a geometric framework to extend the concept of data normalization to the domain of functions that lie on surfaces. In this context, normalization is posed as an embedding of all example functions into Riemannian manifolds nearly isometric to one another. Using geometric tools, we propose an implementation for the case of discretized functions on triangulated meshes. To demonstrate the proposed framework we apply it as a preprocessing step to the task of automatic facial action unit detection for depth maps from a 3D scanner. We show how this subject-independent representation produces more accurate action unit classification results. We also empirically demonstrate that utilizing this intrinsic normalization technique indeed improves action unit recognition performance.

Session

Workshop: 1st International Workshop on DIFFerential Geometry in Computer Vision for Analysis of Shapes, Images and Trajectories (DIFF-CV)

Files

Paper (PDF, 1513K)

DOI

10.5244/C.29.DIFFCV.5
https://dx.doi.org/10.5244/C.29.DIFFCV.5

Citation

Bibtex

@inproceedings{DIFFCV2015_5,
	title={Improving 3D Facial Action Unit Detection with Intrinsic Normalization},
	author={Eric Yudin and Aaron Wetzler and Matan Sela and Ron Kimmel},
	year={2015},
	month={September},
	pages={5.1-5.10},
	articleno={5},
	numpages={10},
	booktitle={Proceedings of the 1st International Workshop on DIFFerential Geometry in Computer Vision for Analysis of Shapes, Images and Trajectories (DIFF-CV 2015)},
	publisher={BMVA Press},
	editor={H. Drira, S. Kurtek, and P. Turaga},
	doi={10.5244/C.29.DIFFCV.5},
	isbn={1-901725-56-1},
	url={https://dx.doi.org/10.5244/C.29.DIFFCV.5}
}