Time-slice Prediction of Dyadic Human Activities

Maryam Ziaeefard, Robert Bergevin and Louis-Philippe Morency

Abstract

Recognizing human activities from video data is being leveraged for surveillance and human-computer interaction applications. In this paper, we introduce the problem of time-slice activity recognition which aims to explore human activity at a smaller temporal granularity. Time-slice recognition is able to infer human behaviors from a short temporal window. It has been shown that the temporal slice analysis is helpful for motion characterization and in general for video content representation. These studies motivate us to consider time-slices for activity recognition. To this intent, we propose a new family of spatio-temporal descriptors which are optimized for early prediction with time-slice action annotations. Our predictive spatio-temporal interest point (Predict-STIP) representation is based on the intuition of temporal contingency between time-slices. Furthermore, we introduce a new dataset which is annotated at multiple short temporal windows, allowing the modeling of the inherent uncertainty in time-slice activity recognition. Our experimental results show performance comparable to human annotations.

Session

Poster 2

Files

Extended Abstract (PDF, 183K)
Paper (PDF, 598K)

DOI

10.5244/C.29.167
https://dx.doi.org/10.5244/C.29.167

Citation

Bibtex

@inproceedings{BMVC2015_167,
	title={Time-slice Prediction of Dyadic Human Activities},
	author={Maryam Ziaeefard and Robert Bergevin and Louis-Philippe Morency},
	year={2015},
	month={September},
	pages={167.1-167.13},
	articleno={167},
	numpages={13},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.167},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.167}
}