Virtual Character Performance From Speech

Simple item page
dc.contributor.authorMarsella, Stacyen_US
dc.contributor.authorXu, Yuyuen_US
dc.contributor.authorLhommet, Margauxen_US
dc.contributor.authorFeng, Andrewen_US
dc.contributor.authorScherer, Stefanen_US
dc.contributor.authorShapirok, Arien_US
dc.contributor.editorTheodore Kim and Robert Sumneren_US
dc.date.accessioned2016-02-18T12:01:20Z
dc.date.available2016-02-18T12:01:20Z
dc.date.issued2013en_US
dc.description.abstractWe demonstrate a method for generating a 3D virtual character performance from the audio signal by inferring the acoustic and semantic properties of the utterance. Through a prosodic analysis of the acoustic signal, we perform an analysis for stress and pitch, relate it to the spoken words and identify the agitation state. Our rule-based system performs a shallow analysis of the utterance text to determine its semantic, pragmatic and rhetorical content. Based on these analyses, the system generates facial expressions and behaviors including head movements, eye saccades, gestures, blinks and gazes. Our technique is able to synthesize the performance and generate novel gesture animations based on coarticulation with other closely scheduled animations. Because our method utilizes semantics in addition to prosody, we are able to generate virtual character performances that are more appropriate than methods that use only prosody. We perform a study that shows that our technique outperforms methods that use prosody alone.en_US
dc.description.sectionheadersAnimating the Human Bodyen_US
dc.description.seriesinformationEurographics/ ACM SIGGRAPH Symposium on Computer Animationen_US
dc.identifier.doi10.1145/2485895.2485900en_US
dc.identifier.isbn978-1-4503-2132-7en_US
dc.identifier.issn1727-5288en_US
dc.identifier.pages25-36en_US
dc.identifier.urihttps://doi.org/10.1145/2485895.2485900en_US
dc.publisherACM SIGGRAPH / Eurographics Associationen_US
dc.subjectCR Categoriesen_US
dc.subjectI.3.7 [Computer Graphics]en_US
dc.subjectThree Dimensional Graphics and Realismen_US
dc.subjectAnimationen_US
dc.subjectI.6.8 [Simulation and Modeling]en_US
dc.subjectTypes of Simulationen_US
dc.subjectAnimationen_US
dc.subjectKeywordsen_US
dc.subjectanimationen_US
dc.subjectgesturesen_US
dc.subjectbehavioren_US
dc.subjectconversational agenten_US
dc.titleVirtual Character Performance From Speechen_US
Files
Collections
SCA 13: Eurographics/SIGGRAPH Symposium on Computer Animation