Virtual Insertion: Robust Bundle Adjustment over Long Video Sequences

Ziyan Wu, Zhiwei Zhu and Han-Pang Chiu

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.12

Abstract

Our goal is to circumvent one of the roadblocks of using existing bundle adjustment algorithms for achieving satisfactory large-area structure from motion over long video sequences, namely, the need for sufficient visual features tracked across consecutive frames. We accomplish it by using a novel ""virtual insertion"" scheme, which constructs virtual points and virtual frames to adapt the existence of visual landmark link outage, namely ""visual breaks"" due to no common features observed from neighboring camera views in challenging environments. We show how to insert virtual point correspondences at each break position and its neighboring frames, by transforming initial motion estimations from non-vision sensors into 3D to 2D projection constraints of virtual scene landmarks. We also show how to add virtual frames to bridge the gap of non-overlapping field of view (FOV) across sequential frames. Experiments are conducted on several real-world challenging video sequences, collected by multi-sensor based visual odometry systems. We demonstrate our proposed scheme significantly improves bundle adjustment performance in both drift correction and reconstruction accuracy.

Session

Video and Structure From Motion

Files

Extended Abstract (PDF, 1 page, 266K)
Paper (PDF, 11 pages, 1.7M)
Bibtex File

Presentation

Citation

Ziyan Wu, Zhiwei Zhu and Han-Pang Chiu. Virtual Insertion: Robust Bundle Adjustment over Long Video Sequences. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.12
	title = {Virtual Insertion: Robust Bundle Adjustment over Long Video Sequences},
	author = {Wu, Ziyan and Zhu, Zhiwei and Chiu, Han-Pang},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.12 }
}