Leveraging Feature Uncertainty in the PnP Problem

Luis Ferraz, Xavier Binefa and Francesc Moreno-Noguer

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.83

Abstract

We propose a real-time and accurate solution to the Perspective-n-Point (P$n$P) problem --estimating the pose of a calibrated camera from $n$ 3D-to-2D point correspondences-- that exploits the fact that in practice the 2D position of not all 2D features is estimated with the same accuracy. Assuming a model of such feature uncertainties is known in advance, we reformulate the P$n$P problem as a maximum likelihood minimization approximated by an unconstrained Sampson error function, which naturally penalizes the most noisy correspondences. The advantages of this approach are clearly demonstrated in synthetic experiments where feature uncertainties are exactly known. Pre-estimating the features uncertainties in real experiments is, though, not easy. In this paper we model feature uncertainty as 2D Gaussian distributions representing the sensitivity of the 2D feature detectors to different camera viewpoints. When using these noise models with our PnP formulation we still obtain promising pose estimation results that outperform the most recent approaches.

Session

Poster Session

Files

Extended Abstract (PDF, 1 page, 360K)

Paper (PDF, 13 pages, 957K)

Bibtex File

Citation

Luis Ferraz, Xavier Binefa, and Francesc Moreno-Noguer. Leveraging Feature Uncertainty in the PnP Problem. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.83
	title = {Leveraging Feature Uncertainty in the PnP Problem},
	author = {Ferraz, Luis and Binefa, Xavier and Moreno-Noguer, Francesc},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.83 }
}