Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation, M. E. Sargın, Y. Yemez, E. Erzin, A. M. Tekalp, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 30, Issue 8, pp. 1330 – 1345, August 2008.
0. A Video Presentation on Prosody-Driven Head Gesture Animation
1. Head gesture capture and tracking demo:
https://youtu.be/tLs2mY0o5a4
2. Head gesture animation using the original Euler angles, which are captured from the original video (speaker 1):
3. Prosody-driven head gesture synthesis using the automatically generated Euler angles from the proposed synthesis system (speaker 1):
https://youtu.be/XafrY419F7Y
4. Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual model of speaker 1:
https://youtu.be/-x0KpUq5wQY
5. Prosody-driven head gesture animation with the proposed synthesis system, where speaker 1’s speech drives the visual model of speaker B (audio-visual training is based on speaker 1):
https://youtu.be/nbZse1sXnfI
6. Speaker Dependency Comparison: Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual models of speaker 1 and speaker 2:
https://youtu.be/ZCzW-Xx19ao
7. Sample video streams of the elementary gesture patterns of speaker 1:
https://youtu.be/X9ek-p7RAS4
https://youtu.be/qIgPlh47zrQ
https://youtu.be/1GIQJDr9CkU
https://youtu.be/1475n6Zd3eM
https://youtu.be/XGNfTgT3RxE
8. Sample video streams of the elementary gesture patterns of speaker 2:
https://youtu.be/2FKlXzEz4yc
https://youtu.be/27vip7Q3HdM
https://youtu.be/7-9MltIhs68
https://youtu.be/UpZcmLFvaK8
Animations are generated using the talking head avatar of Momentum Inc.