Audio-driven Emotional Speech Animation

Charalambous, Constantinos; Yumak, Zerrin; Stappen, A. Frank van der

Audio-driven Emotional Speech Animation

Files

023-024.pdf (3.6 MB)

yumak_eg18_poster.pdf (463.41 KB)

Date

2018

Authors

Charalambous, Constantinos
Yumak, Zerrin
Stappen, A. Frank van der

Publisher

The Eurographics Association

Abstract

We propose a procedural audio-driven speech animation method that takes into account emotional variations in speech. Given any audio with its corresponding speech transcript, the method generates speech animation for any 3D character. The expressive speech model matches the pitch and intensity variations in audio to individual visemes. In addition, we introduce a dynamic co-articulation model that takes into account linguistic rules varying among emotions. We test our approach against two popular speech animation tools and we show that our method surpass them in a perceptual experiment.

        @inproceedings{10.2312:egp.20181019
,
booktitle = {EG 2018 - Posters
},
editor = {Jain, Eakta and Kosinka, Jirí
},
title = {{Audio-driven Emotional Speech Animation
}},
author = {Charalambous, Constantinos and 
Yumak, Zerrin and 
Stappen, A. Frank van der
},
year = {2018
},
publisher = {The Eurographics Association
},
ISSN = {1017-4656
},
ISBN = {},
DOI = {10.2312/egp.20181019
}
}