LLM-Assisted Visual Analytics: Opportunities and Challenges
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field, examining how LLMs are integrated into data management, language interaction, visualisation generation, and language generation processes. We highlight the new possibilities that LLMs bring to VA, especially how they can change VA processes beyond the usual use cases. We especially highlight building new visualisation-language models, allowing access of a breadth of domain knowledge, multimodal interaction, and opportunities with guidance. Finally, we carefully consider the prominent challenges of using current LLMs in VA tasks. Our discussions in this paper aim to guide future researchers working on LLM-assisted VA systems and help them navigate common obstacles when developing these systems.
Description
CCS Concepts: Human-centered computing → Visual analytics; Computing methodologies → Natural language processing
@inproceedings{10.2312:cgvc.20241237,
booktitle = {Computer Graphics and Visual Computing (CGVC)},
editor = {Hunter, David and Slingsby, Aidan},
title = {{LLM-Assisted Visual Analytics: Opportunities and Challenges}},
author = {Hutchinson, Maeve and Jianu, Radu and Slingsby, Aidan and Madhyastha, Pranava},
year = {2024},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-249-3},
DOI = {10.2312/cgvc.20241237}
}