Embodied Conversational Agents with Situation Awareness for Training in Virtual Reality

Simple item page
dc.contributor.authorKán, Peteren_US
dc.contributor.authorRumpelnik, Martinen_US
dc.contributor.authorKaufmann, Hannesen_US
dc.contributor.editorJean-Marie Normanden_US
dc.contributor.editorMaki Sugimotoen_US
dc.contributor.editorVeronica Sundstedten_US
dc.date.accessioned2023-12-04T15:43:15Z
dc.date.available2023-12-04T15:43:15Z
dc.date.issued2023
dc.description.abstractEmbodied conversational agents have a great potential in virtual reality training applications. This paper investigates the impact of conversational agents on users in a first responder training scenario. We integrated methods for automatic speech recognition and speech synthesis with natural language processing into a VR training application in the Unity game engine. Additionally, we present a method for enabling situation awareness for agents in a virtual environment. Finally, we conducted a between-subject lab experiment with 24 participants which investigated differences between conversational agents and agents with pre-scripted audio. Several metrics were measured in the experiment including presence, subjective task performance, learning outcome, interaction quality, quality of information presentation, perceived realism, co-presence, and training task duration. Our results suggest that users trying our conversational agents condition experienced significantly higher level of copresence than users with pre-scripted audio. Additionally, significant differences in subjective task performance and training duration were discovered between genders. Based on the results of our qualitative analysis, we provide guidelines that can facilitate future design of VR training applications and research studies with embodied conversational agents.en_US
dc.description.sectionheadersAvatars and Virtual Agents
dc.description.seriesinformationICAT-EGVE 2023 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
dc.identifier.doi10.2312/egve.20231310
dc.identifier.isbn978-3-03868-218-9
dc.identifier.issn1727-530X
dc.identifier.pages27-36
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.2312/egve.20231310
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/egve20231310
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Virtual reality; Human-centered computing → User studies
dc.subjectComputing methodologies → Virtual reality
dc.subjectHuman
dc.subjectcentered computing → User studies
dc.titleEmbodied Conversational Agents with Situation Awareness for Training in Virtual Realityen_US
Files
Original bundle
Now showing 1 - 3 of 3
No Thumbnail Available
Name:
027-036.pdf
Size:
2.02 MB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
paper1019_mm.mp4
Size:
195.04 MB
Format:
Unknown data format
Download
No Thumbnail Available
Name:
paper1019_mm.pdf
Size:
2.47 MB
Format:
Adobe Portable Document Format
Download
Collections
ICAT-EGVE2023