Learning to Invert Local Binary Patterns

Felix Juefei-Xu and Marios Savvides

Abstract

In this work, we have proposed to invert the local binary patterns (LBP) descriptor. The success of the inversion gives rise to two applications: face de-appearance and re-appearance. The de-appearance, based on image-LBP forward mapping, is thorough in the sense that not only the identity information but also the soft-biometric information of the subject is removed. The re-appearance yields face reconstruction with high fidelity and also enables secure application with a unique encryption key. The re-appearance is achieved by learning the inverse mapping of the LBP descriptors through an $\ell_0$-constrained coupled dictionary learning scheme that jointly learns two overcomplete dictionaries in both the pixel and the LBP domains such that inverse mapping from the LBP domain to the pixel domain is made possible without knowing the mapping function explicitly. The procedure also comes naturally with high selectivity when reconstructing the faces with various LBP encryption keys. We have shown the effectiveness of our proposed approach on the FRGC ver 2.0 database which involves large-scale fidelity test and face verification experiments using the state-of-the-art commercial and academic face matchers.

Session

Posters 1

Files

PDF iconExtended Abstract (PDF, 113K)
PDF iconPaper (PDF, 740K)

DOI

10.5244/C.30.29
https://dx.doi.org/10.5244/C.30.29

Citation

Felix Juefei-Xu and Marios Savvides. Learning to Invert Local Binary Patterns. In Richard C. Wilson, Edwin R. Hancock and William A. P. Smith, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 29.1-29.14. BMVA Press, September 2016.

Bibtex

        @inproceedings{BMVC2016_29,
        	title={Learning to Invert Local Binary Patterns},
        	author={Felix Juefei-Xu and Marios Savvides},
        	year={2016},
        	month={September},
        	pages={29.1-29.14},
        	articleno={29},
        	numpages={14},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.29},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.29}
        }