Talk2Hand: Knowledge Board Interaction in Augmented Reality Easing Analysis with Machine Learning Assistants
Loading...
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Analysts now often use machine learning (ML) assistants, but find them difficult to use, since most have little ML expertise. Talk2Hand improves the usability of ML assistants by supporting interaction with them using knowledge boards, which intuitively show association, visually aid human recall, and offer natural interaction that eases improvement of displayed associations and addition of new data into emerging models. Knowledge boards are familiar to most and studied by analytics researchers, but not in wide use, because of their large size and the challenges of using them for several projects simultaneously. Talk2Hand uses augmented reality to address these shortcomings, overlaying large but virtual knowledge boards onto typical analyst offices, and enabling analysts to switch easily between different knowledge boards. This paper describes our Talk2Hand prototype.
Description
@inproceedings{10.2312:eurova.20211090,
booktitle = {EuroVis Workshop on Visual Analytics (EuroVA)},
editor = {Vrotsou, Katerina and Bernard, Jürgen},
title = {{Talk2Hand: Knowledge Board Interaction in Augmented Reality Easing Analysis with Machine Learning Assistants}},
author = {Hong, Yu-Lun and Watson, Benjamin and Thompson, Kenneth and Davis, Paul},
year = {2021},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-150-2},
DOI = {10.2312/eurova.20211090}
}