Towards 4D Coupled Models of Conversational Facial Expression Interactions

Jason Vandeventer, Lukas Gräser, Magdalena Rychlowska, Paul L. Rosin and Dave Marshall

Abstract

In this paper we introduce a novel approach for building 4D coupled statistical models of conversational facial expression interactions. To build these coupled models we use 3D AAMs for feature extraction, 4D polynomial fitting for sequence representation, and concatenated feature vectors of frontchannel-backchannel interactions (with offset values) for the coupled model. Using a coupled model of conversation smile interactions, we predicted each sequence’s backchannel signal. In a subsequent experiment, human observers rated predicted sequences as highly similar to the originals. Our results demonstrate the usefulness of coupled models as powerful tools to analyse and synthesise key aspects of conversational interactions, including conversation timings, backchannel responses to frontchannel signals, and the spatial and temporal dynamics of conversational facial expression interactions.

Session

Poster 2

Files

Extended Abstract (PDF, 88K)
Paper (PDF, 1022K)

DOI

10.5244/C.29.142
https://dx.doi.org/10.5244/C.29.142

Citation

Bibtex

@inproceedings{BMVC2015_142,
	title={Towards 4D Coupled Models of Conversational Facial Expression Interactions},
	author={Jason Vandeventer and Lukas Gräser and Magdalena Rychlowska and Paul L. Rosin and Dave Marshall},
	year={2015},
	month={September},
	pages={142.1-142.14},
	articleno={142},
	numpages={14},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.142},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.142}
}