Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation, M. E. Sargın, Y. Yemez, E. Erzin, A. M. Tekalp, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 30, Issue 8, pp. 1330 – 1345, August 2008.
0. A Video Presentation on Prosody-Driven Head Gesture Animation
1. Head gesture capture and tracking demo:
2. Head gesture animation using the original Euler angles, which are captured from the original video (speaker 1):
3. Prosody-driven head gesture synthesis using the automatically generated Euler angles from the proposed synthesis system (speaker 1):
4. Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual model of speaker 1:
5. Prosody-driven head gesture animation with the proposed synthesis system, where speaker 1’s speech drives the visual model of speaker B (audio-visual training is based on speaker 1):
6. Speaker Dependency Comparison: Prosody-driven head gesture animation with the proposed synthesis system, where speaker B’s speech drives the audio-visual models of speaker 1 and speaker 2:
7. Sample video streams of the elementary gesture patterns of speaker 1:
8. Sample video streams of the elementary gesture patterns of speaker 2:
Animations are generated using the talking head avatar of Momentum Inc.