3D Tracking of Human Hands in Interaction with Unknown Objects

Paschalis Panteleris, Nikolaos Kyriazis and Antonis A. Argyros

Abstract

The analysis and the understanding of object manipulation scenarios based on computer vision techniques can be greatly facilitated if we can gain access to the full articulation of the manipulating hands and the 3D pose of the manipulated objects. Currently, there exist methods for tracking hands in interaction with objects whose 3D models are known. There are also methods that can reconstruct 3D models of objects that are partially observable in each frame of a sequence. However, to the best of our knowledge, no method can track hands in interaction with unknown objects. In this paper we propose such a method. Experimental results show that hand tracking can be achieved with an accuracy that is comparable to the one obtained by methods that assume knowledge of the object models. Additionally, as a by-product, the proposed method delivers accurate 3D models of the manipulated objects.

Session

Poster 2

Files

Extended Abstract (PDF, 1301K)

Paper (PDF, 4M)

Supplemental Materials (ZIP, 27M)

DOI

10.5244/C.29.123
https://dx.doi.org/10.5244/C.29.123

Citation

Paschalis Panteleris, Nikolaos Kyriazis and Antonis A. Argyros. 3D Tracking of Human Hands in Interaction with Unknown Objects. In Xianghua Xie, Mark W. Jones, and Gary K. L. Tam, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 123.1-123.12. BMVA Press, September 2015.

Bibtex

@inproceedings{BMVC2015_123,
	title={3D Tracking of Human Hands in Interaction with Unknown Objects},
	author={Paschalis Panteleris and Nikolaos Kyriazis and Antonis A. Argyros},
	year={2015},
	month={September},
	pages={123.1-123.12},
	articleno={123},
	numpages={12},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.123},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.123}
}