Search Results

Now showing 1 - 10 of 133
  • Item
    DASH: Visual Analytics for Debiasing Image Classification via User-Driven Synthetic Data Augmentation
    (The Eurographics Association, 2022) Kwon, Bum Chul; Lee, Jungsoo; Chung, Chaeyeon; Lee, Nyoungwoo; Choi, Ho-Jin; Choo, Jaegul; Agus, Marco; Aigner, Wolfgang; Hoellt, Thomas
    Image classification models often learn to predict a class based on irrelevant co-occurrences between input features and an output class in training data. We call the unwanted correlations ''data biases,'' and the visual features causing data biases ''bias factors.'' It is challenging to identify and mitigate biases automatically without human intervention. Therefore, we conducted a design study to find a human-in-the-loop solution. First, we identified user tasks that capture the bias mitigation process for image classification models with three experts. Then, to support the tasks, we developed a visual analytics system called DASH that allows users to visually identify bias factors, to iteratively generate synthetic images using a state-of-the-art image-toimage translation model, and to supervise the model training process for improving the classification accuracy. Our quantitative evaluation and qualitative study with ten participants demonstrate the usefulness of DASH and provide lessons for future work.
  • Item
    Prototype to Control a Mid-air CG Character Using Motion Capture Data of a Plush Toy
    (The Eurographics Association, 2022) Fukuoka, Miyu; Ando, Shohei; Koizumi, Naoya; Theophilus Teo; Ryota Kondo
    We propose an integrated operation system that combines puppet motion capture and human body movements to easily control various movements of a mid-air CG character. The proposed method addresses the problems in controlling CG characters via the body movements of a human operator and puppet. This method can also be used to control spatial movements and multiple parts of a character simultaneously. In addition, our method enables an operator to easily move the character in the depth direction, which is a key characteristic of a mid-air image.
  • Item
    Sketching Vocabulary for Crowd Motion
    (The Eurographics Association and John Wiley & Sons Ltd., 2022) Mathew, C. D. Tharindu; Benes, Bedrich; Aliaga, Daniel; Dominik L. Michels; Soeren Pirk
    This paper proposes and evaluates a sketching language to author crowd motion. It focuses on the path, speed, thickness, and density parameters of crowd motion. A sketch-based vocabulary is proposed for each parameter and evaluated in a user study against complex crowd scenes. A sketch recognition pipeline converts the sketches into a crowd simulation. The user study results show that 1) participants at various skill levels and can draw accurate crowd motion through sketching, 2) certain sketch styles lead to a more accurate representation of crowd parameters, and 3) sketching allows to produce complex crowd motions in a few seconds. The results show that some styles although accurate actually are less preferred over less accurate ones.
  • Item
    Evaluating Bloom's Taxonomy-based Learning Modules for Parallel Coordinates Literacy
    (The Eurographics Association, 2022) Peng, Ilena; Firat, Elif E.; Laramee, Robert S.; Joshi, Alark; Bourdin, Jean-Jacques; Paquette, Eric
    In this paper, we present the results of an intervention designed to introduce parallel coordinates to students. The intervention contains six new modules inspired by Bloom's taxonomy that featured a combination of videos, tests, and tasks. We studied the impact of our modules with a corrective feedback mechanism inspired by Mastery Learning. Based on analyzing the data of our students, we found that students in the Corrective Immediate Feedback (CIF) group performed better on average on all the modules as compared to the students in the No Feedback (NF) group. In the tasks where students were required to construct parallel coordinates plots, students in the Corrective Immediate Feedback group produced plots with appropriate use of color, labels, legends, etc. Overall, students in both groups grew more confident in their ability to recognize parallel coordinates plots and expressed high confidence in their ability to interpret, create, and use parallel coordinates plots for data exploration and presentation in the future.
  • Item
    Saliency Clouds: Visual Analysis of Point Cloud-oriented Deep Neural Networks in DeepRL for Particle Physics
    (The Eurographics Association, 2022) Mulawade, Raju Ningappa; Garth, Christoph; Wiebel, Alexander; Archambault, Daniel; Nabney, Ian; Peltonen, Jaakko
    We develop and describe saliency clouds, that is, visualization methods employing explainable AI methods to analyze and interpret deep reinforcement learning (DeepRL) agents working on point cloud-based data. The agent in our application case is tasked to track particles in high energy physics and is still under development. The point clouds contain properties of particle hits on layers of a detector as the input to reconstruct the trajectories of the particles. Through visualization of the influence of different points, their possible connections in an implicit graph, and other features on the decisions of the policy network of the DeepRL agent, we aim to explain the decision making of the agent in tracking particles and thus support its development. In particular, we adapt gradient-based saliency mapping methods to work on these point clouds. We show how the properties of the methods, which were developed for image data, translate to the structurally different point cloud data. Finally, we present visual representations of saliency clouds supporting visual analysis and interpretation of the RL agent's policy network.
  • Item
    LineageD: An Interactive Visual System for Plant Cell Lineage Assignments based on Correctable Machine Learning
    (The Eurographics Association and John Wiley & Sons Ltd., 2022) Hong, Jiayi; Trubuil, Alain; Isenberg, Tobias; Borgo, Rita; Marai, G. Elisabeta; Schreck, Tobias
    We describe LineageD-a hybrid web-based system to predict, visualize, and interactively adjust plant embryo cell lineages. Currently, plant biologists explore the development of an embryo and its hierarchical cell lineage manually, based on a 3D dataset that represents the embryo status at one point in time. This human decision-making process, however, is time-consuming, tedious, and error-prone due to the lack of integrated graphical support for specifying the cell lineage. To fill this gap, we developed a new system to support the biologists in their tasks using an interactive combination of 3D visualization, abstract data visualization, and correctable machine learning to modify the proposed cell lineage. We use existing manually established cell lineages to obtain a neural network model. We then allow biologists to use this model to repeatedly predict assignments of a single cell division stage. After each hierarchy level prediction, we allow them to interactively adjust the machine learning based assignment, which we then integrate into the pool of verified assignments for further predictions. In addition to building the hierarchy this way in a bottom-up fashion, we also offer users to divide the whole embryo and create the hierarchy tree in a top-down fashion for a few steps, improving the ML-based assignments by reducing the potential for wrong predictions. We visualize the continuously updated embryo and its hierarchical development using both 3D spatial and abstract tree representations, together with information about the model's confidence and spatial properties. We conducted case study validations with five expert biologists to explore the utility of our approach and to assess the potential for LineageD to be used in their daily workflow. We found that the visualizations of both 3D representations and abstract representations help with decision making and the hierarchy tree top-down building approach can reduce assignments errors in real practice.
  • Item
    Visual Exploration of Preference-based Routes in Ski Resorts
    (The Eurographics Association, 2022) Rauscher, Julius; Miller, Matthias; Keim, Daniel A.; Krone, Michael; Lenti, Simone; Schmidt, Johanna
    Ski resorts exhibit a variety of available pistes and lifts, to which every skier has intrinsic preferences. While novices tend to favor easy pistes, experts might opt for more advanced pistes. In large resorts, the vast possibilities render manual, optimized routing according to specific piste and lift preferences extremely tedious. So far, existing visualizations of ski resorts lack these routing capabilities.We present a visual analytics interface that allows the user to find an optimal route between arbitrary locations in a ski resort according to individual personal preferences. Furthermore, we encode steepness information along the pistes to expose segments that deviate from the difficulty classification and thus are incompatible with the given user preferences.
  • Item
    Neural Flow Map Reconstruction
    (The Eurographics Association and John Wiley & Sons Ltd., 2022) Sahoo, Saroj; Lu, Yuzhe; Berger, Matthew; Borgo, Rita; Marai, G. Elisabeta; Schreck, Tobias
    In this paper we present a reconstruction technique for the reduction of unsteady flow data based on neural representations of time-varying vector fields. Our approach is motivated by the large amount of data typically generated in numerical simulations, and in turn the types of data that domain scientists can generate in situ that are compact, yet useful, for post hoc analysis. One type of data commonly acquired during simulation are samples of the flow map, where a single sample is the result of integrating the underlying vector field for a specified time duration. In our work, we treat a collection of flow map samples for a single dataset as a meaningful, compact, and yet incomplete, representation of unsteady flow, and our central objective is to find a representation that enables us to best recover arbitrary flow map samples. To this end, we introduce a technique for learning implicit neural representations of time-varying vector fields that are specifically optimized to reproduce flow map samples sparsely covering the spatiotemporal domain of the data. We show that, despite aggressive data reduction, our optimization problem - learning a function-space neural network to reproduce flow map samples under a fixed integration scheme - leads to representations that demonstrate strong generalization, both in the field itself, and using the field to approximate the flow map. Through quantitative and qualitative analysis across different datasets we show that our approach is an improvement across a variety of data reduction methods, and across a variety of measures ranging from improved vector fields, flow maps, and features derived from the flow map.
  • Item
    AR Object Layout Method Using Miniature Room Generated from Depth Data
    (The Eurographics Association, 2022) Ihara, Keiichi; Kawaguchi, Ikkaku; Hideaki Uchiyama; Jean-Marie Normand
    In augmented reality (AR), users can place virtual objects anywhere in a real-world room, called AR layout. Although several object manipulation techniques have been proposed in AR, it is difficult to use them for AR layout owing to the difficulty in freely changing the position and size of virtual objects. In this study, we make the World-in-Miniature (WIM) technique available in AR to support AR layout. The WIM technique is a manipulation technique that uses miniatures, which has been proposed as a manipulation technique for virtual reality (VR). Our system uses the AR device's depth sensors to acquire a mesh of the room in real-time to create and update a miniature of a room in real-time. In our system, users can use miniature objects to move virtual objects to arbitrary positions and scale them to arbitrary sizes. In addition, because the miniature object can be manipulated instead of the real-scale object, we assumed that our system will shorten the placement time and reduce the workload of the user. In our previous study, we created a prototype and investigated the properties of manipulating miniature objects in AR. In this study, we conducted an experiment to evaluate how our system can support AR layout. To conduct a task close to the actual use, we used various objects and made the participants design an AR layout of their own will. The results showed that our system significantly reduced workload in physical and temporal demand. Although, there was no significant difference in the total manipulation time.
  • Item
    AR FPS Game using Static and Dynamic Physical Obstacles
    (The Eurographics Association, 2022) Sawanobori, Yuki; Iriyama, Taishi; Komuro, Takashi; Theophilus Teo; Ryota Kondo
    In this paper, we propose an AR FPS game that allows a player to use physical obstacles for avoiding enemy attacks and defeating enemies. The use of physical obstacles is intended to make the game more fun and immersive. Physical obstacles are classified into static obstacles that do not move and dynamic obstacles that can move. The game design for utilizing real space includes placing game objects in consideration of static obstacles, using physical obstacles as shields to prevent enemy attacks, and using projectiles to attack a player hiding behind obstacles. We prototyped the game using HoloLens2 and conducted a user study using a questionnaire (N = 14). The results showed that the game itself was highly evaluated, as well as the exercise promotion effect by the use of real space.