Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation

Christian Reinbacher, Gottfried Graber and Thomas Pock

Abstract

Event cameras or neuromorphic cameras mimic the human perception system as they measure the per-pixel intensity change rather than the actual intensity level. In contrast to traditional cameras, such cameras capture new information about the scene at MHz frequency in the form of sparse events. The high temporal resolution comes at the cost of losing the familiar per-pixel intensity information. In this work we propose a variational model that accurately models the behaviour of event cameras, enabling reconstruction of intensity images with arbitrary frame rate in real-time. Our method is formulated on a per-event-basis, where we explicitly incorporate information about the asynchronous nature of events via an event manifold induced by the relative timestamps of events. In our experiments we verify that solving the variational model on the manifold produces high-quality images without explicitly estimating optical flow.

Session

Segmentation

Files

Extended Abstract (PDF, 378K)
Paper (PDF, 2M)
Supplemental Materials (ZIP, 28M)

DOI

10.5244/C.30.9
https://dx.doi.org/10.5244/C.30.9

Citation

Bibtex

        @inproceedings{BMVC2016_9,
        	title={Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation},
        	author={Christian Reinbacher, Gottfried Graber and Thomas Pock},
        	year={2016},
        	month={September},
        	pages={9.1-9.12},
        	articleno={9},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.9},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.9}
        }