Simultaneous Mosaicing and Tracking with an Event Camera

Hanme Kim, Ankur Handa, Ryad Benosman, Sio-Hoi Ieng and Andrew Davison

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.26

Abstract

An event camera is a silicon retina which outputs not a sequence of video frames like a standard camera, but a stream of asynchronous spikes, each with pixel location, sign and precise timing, indicating when individual pixels record a threshold log intensity change. By encoding only image change, it offers the potential to transmit the information in a standard video but at vastly reduced bitrate, and with huge added advantages of very high dynamic range and temporal resolution. However, event data calls for new algorithms, and in particular we believe that algorithms which incrementally estimate global scene models are best placed to take full advantages of its properties. Here, we show for the first time that an event stream, with no additional sensing, can be used to track accurate camera rotation while building a persistent and high quality mosaic of a scene which is super-resolution accurate and has high dynamic range. Our method involves parallel camera rotation tracking and template reconstruction from estimated gradients, both operating on an event-by-event basis and based on probabilistic filtering.

Session

Tracking

Files

Extended Abstract (PDF, 1 page, 1.2M)
Paper (PDF, 12 pages, 2.2M)
Supplemental Materials (ZIP, 5.0M)
Bibtex File

Presentation

Citation

Hanme Kim, Ankur Handa, Ryad Benosman, Sio-Hoi Ieng, and Andrew Davison. Simultaneous Mosaicing and Tracking with an Event Camera. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.26
	title = {Simultaneous Mosaicing and Tracking with an Event Camera},
	author = {Kim, Hanme and Handa, Ankur and Benosman, Ryad and Ieng, Sio-Hoi and Davison, Andrew},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.26 }
}