Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation, M. E. Sargın, Y. Yemez, E. Erzin,  A. M. Tekalp, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 30, Issue 8, pp. 1330 – 1345, August 2008.

0.    A Video Presentation on Prosody-Driven Head Gesture Animation

 

1.    Head gesture capture and tracking demo:

https://youtu.be/tLs2mY0o5a4

 

2.  Head gesture animation using the original Euler angles, which are captured from the original video (speaker 1):

 

3.  Prosody-driven head gesture synthesis using the automatically generated Euler angles from the proposed synthesis system (speaker 1):

https://youtu.be/XafrY419F7Y

 

4.  Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual model of speaker 1:

https://youtu.be/-x0KpUq5wQY

 

5.  Prosody-driven head gesture animation with the proposed synthesis system, where speaker 1’s speech drives the visual model of speaker B (audio-visual training is based on speaker 1):

https://youtu.be/nbZse1sXnfI

 

6.   Speaker Dependency Comparison: Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual models of speaker 1 and speaker 2:

https://youtu.be/ZCzW-Xx19ao

 

7.   Sample video streams of the elementary gesture patterns of speaker 1:

https://youtu.be/X9ek-p7RAS4

https://youtu.be/qIgPlh47zrQ

https://youtu.be/1GIQJDr9CkU

https://youtu.be/1475n6Zd3eM

https://youtu.be/XGNfTgT3RxE

 

8.   Sample video streams of the elementary gesture patterns of speaker 2:

https://youtu.be/2FKlXzEz4yc

https://youtu.be/27vip7Q3HdM

https://youtu.be/7-9MltIhs68

https://youtu.be/UpZcmLFvaK8

 

Animations are generated using the talking head avatar of Momentum Inc.