Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation, M. E. Sargın, Y. Yemez, E. Erzin,  A. M. Tekalp, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 30, Issue 8, pp. 1330 – 1345, August 2008.

0.    A Video Presentation on Prosody-Driven Head Gesture Animation

 

1.    Head gesture capture and tracking demo:

 

2.  Head gesture animation using the original Euler angles, which are captured from the original video (speaker 1):

 

3.  Prosody-driven head gesture synthesis using the automatically generated Euler angles from the proposed synthesis system (speaker 1):

 

4.  Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual model of speaker 1:

 

5.  Prosody-driven head gesture animation with the proposed synthesis system, where speaker 1’s speech drives the visual model of speaker B (audio-visual training is based on speaker 1):

 

6.   Speaker Dependency Comparison: Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual models of speaker 1 and speaker 2:

 

7.   Sample video streams of the elementary gesture patterns of speaker 1:

 

8.   Sample video streams of the elementary gesture patterns of speaker 2:

 

Animations are generated using the talking head avatar of Momentum Inc.