Statistics-based Motion Synthesis for Social Conversations

dc.contributor.authorYang, Yanzheen_US
dc.contributor.authorYang, Jimeien_US
dc.contributor.authorHodgins, Jessicaen_US
dc.contributor.editorBender, Jan and Popa, Tiberiuen_US
dc.date.accessioned2020-10-16T06:25:56Z
dc.date.available2020-10-16T06:25:56Z
dc.date.issued2020
dc.description.abstractPlausible conversations among characters are required to generate the ambiance of social settings such as a restaurant, hotel lobby, or cocktail party. In this paper, we propose a motion synthesis technique that can rapidly generate animated motion for characters engaged in two-party conversations. Our system synthesizes gestures and other body motions for dyadic conversations that synchronize with novel input audio clips. Human conversations feature many different forms of coordination and synchronization. For example, speakers use hand gestures to emphasize important points, and listeners often nod in agreement or acknowledgment. To achieve the desired degree of realism, our method first constructs a motion graph that preserves the statistics of a database of recorded conversations performed by a pair of actors. This graph is then used to search for a motion sequence that respects three forms of audio-motion coordination in human conversations: coordination to phonemic clause, listener response, and partner's hesitation pause. We assess the quality of the generated animations through a user study that compares them to the originally recorded motion and evaluate the effects of each type of audio-motion coordination via ablation studies.en_US
dc.description.number8
dc.description.sectionheadersCharacter Animation 1
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume39
dc.identifier.doi10.1111/cgf.14114
dc.identifier.issn1467-8659
dc.identifier.pages201-212
dc.identifier.urihttps://doi.org/10.1111/cgf.14114
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14114
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectComputing methodologies
dc.subjectMotion capture
dc.subjectMotion processing
dc.titleStatistics-based Motion Synthesis for Social Conversationsen_US
Files
Collections