Speech and Sketching: An Empirical Study of Multimodal Interaction
dc.contributor.author | Adler, A. | en_US |
dc.contributor.author | Davis, R. | en_US |
dc.contributor.editor | Michiel van de Panne and Eric Saund | en_US |
dc.date.accessioned | 2014-01-28T17:52:45Z | |
dc.date.available | 2014-01-28T17:52:45Z | |
dc.date.issued | 2007 | en_US |
dc.description.abstract | Sketch recognition can capture the sketching component of a multimodal conversation about design, but it does not capture information conveyed in the other modalities. The informal speech that accompanies a sketch often has a considerable amount of additional information. We want to develop a digital whiteboard capable of understanding both sketching and speech, and capable of participating in a conversation similar to one that the user would have with a human design partner. We conducted a user study to help us understand what kinds of conversations users would have with a whiteboard capable of recognizing a sketch. We report results that we believe will help guide the design of an effective multimodal interface, and discuss implications for system architectures. | en_US |
dc.description.seriesinformation | EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling | en_US |
dc.identifier.isbn | 978-3-905674-00-2 | en_US |
dc.identifier.issn | 1812-3503 | en_US |
dc.identifier.uri | https://doi.org/10.2312/SBM/SBM07/083-090 | en_US |
dc.publisher | The Eurographics Association | en_US |
dc.subject | Categories and Subject Descriptors (according to ACM CCS): H.5.2 [Information interfaces and presentation]: User Interfaces. - Natural language, Graphical user interfaces, Evaluation/methodology, Input devices and strategies, Interaction styles, User-centered design, Voice I/O | en_US |
dc.title | Speech and Sketching: An Empirical Study of Multimodal Interaction | en_US |
Files
Original bundle
1 - 1 of 1