Robust Direct Visual Localisation using Normalised Information Distance

Geoffrey Pascoe, Will Maddern and Paul Newman

Abstract

We present an information-theoretic approach for direct localisation of a monocular camera within a 3D appearance prior. In contrast to existing direct visual localisation methods based on minimising photometric error, an information-theoretic metric allows us to compare the whole image without relying on individual pixel values, yielding robustness to changes in the appearance of the scene due to lighting, camera motion, occlusions and sensor modality. Using a low-fidelity textured 3D model of the environment, we synthesise virtual images at a candidate pose within the model. We use the Normalised Information Distance (NID) metric to evaluate the appearance match between the camera image and the virtual image, and present a derivation of analytical NID derivatives for the SE(3) direct localisation problem, along with an efficient GPGPU implementation capable of online processing. We present results showing successful online visual localisation under significant appearance change both in a synthetic indoor environment and outdoors with real-world data from a vehicle-mounted camera.

Session

Poster 1

Files

Extended Abstract (PDF, 695K)
Paper (PDF, 2M)
Supplemental Materials (ZIP, 23M)

DOI

10.5244/C.29.70
https://dx.doi.org/10.5244/C.29.70

Citation

Bibtex

@inproceedings{BMVC2015_70,
	title={Robust Direct Visual Localisation using Normalised Information Distance},
	author={Geoffrey Pascoe and Will Maddern and Paul Newman},
	year={2015},
	month={September},
	pages={70.1-70.13},
	articleno={70},
	numpages={13},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.70},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.70}
}