Victorelli, Eliane ZambonCabouat, Anne-FloreSantos, EmanueleCabric, FlorentIsenberg, PetraSchulz, Hans-JörgVillanova, Anna2025-05-262025-05-262025978-3-03868-283-72664-4487https://doi.org/10.2312/eurova.20251095https://diglib.eg.org/handle/10.2312/eurova20251095The evaluation of user experience in visual analytics systems is a complex and multifaceted challenge that demands a specialized approach. Traditional user experience measurement tools, including standardized questionnaires, often fail to capture the unique interactions and cognitive demands of visual analytics environments. In this position paper, we argue that it is necessary to develop a new measurement tool specifically tailored to user experience in visual analytics systems. We explore the relationship between user experience and usability and review current methods for collecting, measuring, and analyzing user experience data. We discuss the limitations of existing methods for user experience evaluations of visual analytics systems with a focus on the problematic use of current user experience questionnaires. Our research agenda outlines the key challenges for developing a dedicated evaluation instrument and proposes strategies for exploring the dimensions of user experience relevant to the visual analytics systems context. In particular, future research on a framework for developing robust and context-appropriate measurement tools that target the many important dimensions of user experience with visual analytics systems is needed.Attribution 4.0 International LicenseKeywords: User experience, measurement scale, evaluation, visual analytics CCS Concepts: Human-centered computing → Visualization design and evaluation methods; Visual analyticsKeywordsUser experiencemeasurement scaleevaluationvisual analytics CCS ConceptsHuman centered computing → Visualization design and evaluation methodsVisual analytics10.2312/eurova.202510956 pages