Speech and Sketching: An Empirical Study of Multimodal Interaction

dc.contributor.authorAdler, A.en_US
dc.contributor.authorDavis, R.en_US
dc.contributor.editorMichiel van de Panne and Eric Saunden_US
dc.date.accessioned2014-01-28T17:52:45Z
dc.date.available2014-01-28T17:52:45Z
dc.date.issued2007en_US
dc.description.abstractSketch recognition can capture the sketching component of a multimodal conversation about design, but it does not capture information conveyed in the other modalities. The informal speech that accompanies a sketch often has a considerable amount of additional information. We want to develop a digital whiteboard capable of understanding both sketching and speech, and capable of participating in a conversation similar to one that the user would have with a human design partner. We conducted a user study to help us understand what kinds of conversations users would have with a whiteboard capable of recognizing a sketch. We report results that we believe will help guide the design of an effective multimodal interface, and discuss implications for system architectures.en_US
dc.description.seriesinformationEUROGRAPHICS Workshop on Sketch-Based Interfaces and Modelingen_US
dc.identifier.isbn978-3-905674-00-2en_US
dc.identifier.issn1812-3503en_US
dc.identifier.urihttps://doi.org/10.2312/SBM/SBM07/083-090en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectCategories and Subject Descriptors (according to ACM CCS): H.5.2 [Information interfaces and presentation]: User Interfaces. - Natural language, Graphical user interfaces, Evaluation/methodology, Input devices and strategies, Interaction styles, User-centered design, Voice I/Oen_US
dc.titleSpeech and Sketching: An Empirical Study of Multimodal Interactionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
083-090.pdf
Size:
584.31 KB
Format:
Adobe Portable Document Format