Filtering 3D Keypoints Using GIST For Accurate Image-Based Localization

Charbel Azzi, Daniel Asmar, Adel Fakih and John Zelek

Abstract

Image-Based Localization (IBL) is the problem of estimating the 3D pose of a camera with respect to a 3D representation of the scene. IBL is quite challenging in large-scale environments spanning a wide variety of viewpoints, illumination, and areas where matching a query image against hundreds of thousands of 3D points becomes prone to a large number of outliers and ambiguous situations. The current state of the art IBL solutions attempted to address the problem using paradigms such as bag-of-words, features co-occurrence, deep learning and others, with varying degrees of success. This paper presents GIST-based Search Space Reduction (GSSR) for indoor and large scale Image-Based Localization applications such as relocalization, loop closure and location recognition. GSSR explores the use of global descriptors, in particular GIST, to introduce a new similarity measure for keyframes that combines the GIST descriptor scores of all neighboring frames to qualify a limited number of 3D points for the matching process, hence reducing the problem to its small size counterpart. Our results on standard datasets show that our system can achieve better localization accuracy and speed than the main state of the art. It obtains approximately 0.24m and 0.3deg in less then 0.1 seconds.

Session

Posters 2

Files

PDF iconExtended Abstract (PDF, 130K)
PDF iconPaper (PDF, 5M)

DOI

10.5244/C.30.127
https://dx.doi.org/10.5244/C.30.127

Citation

Charbel Azzi, Daniel Asmar, Adel Fakih and John Zelek. Filtering 3D Keypoints Using GIST For Accurate Image-Based Localization. In Richard C. Wilson, Edwin R. Hancock and William A. P. Smith, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 127.1-127.12. BMVA Press, September 2016.

Bibtex

        @inproceedings{BMVC2016_127,
        	title={Filtering 3D Keypoints Using GIST For Accurate Image-Based Localization},
        	author={Charbel Azzi, Daniel Asmar, Adel Fakih and John Zelek},
        	year={2016},
        	month={September},
        	pages={127.1-127.12},
        	articleno={127},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.127},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.127}
        }