An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication

Gobron, Stephane; Ahn, Junghyun; Silvestre, Quentin; Thalmann, Daniel; Rank, Stefan; Skowron, Marcin; Paltoglou, Georgios; Thelwall, Michael

An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication

Files

087-094.pdf (850.35 KB)

Date

2011

Authors

Gobron, Stephane
Ahn, Junghyun
Silvestre, Quentin
Thalmann, Daniel
Rank, Stefan
Skowron, Marcin
Paltoglou, Georgios
Thelwall, Michael

Publisher

The Eurographics Association

Abstract

The communication between avatar and agent has already been treated from different but specialized perspectives. In contrast, this paper gives a balanced view of every key architectural aspect: from text analysis to computer graphics, the chatting system and the emotional model. Non-verbal communication, such as facial expression, gaze, or head orientation is crucial to simulate realistic behavior, but is still an aspect neglected in the simulation of virtual societies. In response, this paper aims to present the necessary modularity to allow virtual humans (VH) conversation with consistent facial expression -either between two users through their avatars, between an avatar and an agent, or even between an avatar and a Wizard of Oz. We believe such an approach is particularly suitable for the design and implementation of applications involving VHs interaction in virtual worlds. To this end, three key features are needed to design and implement this system entitled 3D-emoChatting. First, a global architecture that combines components from several research fields. Second, a real-time analysis and management of emotions that allows interactive dialogues with non-verbal communication. Third, a model of a virtual emotional mind called emoMind that allows to simulate individual emotional characteristics. To conclude the paper, we briefly present the basic description of a user-test which is beyond the scope of the present paper.

        @inproceedings{:10.2312/EGVE/JVRC11/087-094
,
booktitle = {Joint Virtual Reality Conference of EGVE - EuroVR
},
editor = {Sabine Coquillart and Anthony Steed and Greg Welch
},
title = {{An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication
}},
author = {Gobron, Stephane and 
Ahn, Junghyun and 
Silvestre, Quentin and 
Thalmann, Daniel and 
Rank, Stefan and 
Skowron, Marcin and 
Paltoglou, Georgios and 
Thelwall, Michael
},
year = {2011
},
publisher = {The Eurographics Association
},
ISSN = {1727-530X
},
ISBN = {978-3-905674-33-0
},
DOI = {/10.2312/EGVE/JVRC11/087-094
}
}