VATUN: Visual Analytics for Testing and Understanding Convolutional Neural Networks
Loading...
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Convolutional neural networks (CNNs) are popularly used in a wide range of applications, such as computer vision, natural language processing, and human-computer interaction. However, testing and understanding a trained model is difficult and very time-consuming. This is because their inner mechanisms are often considered as a 'black-box' due to difficulty in understanding the causal relationships between processes and results. To help the testing and understanding of such models, we present a user-interactive visual analytics system, VATUN, to analyze a CNN-based image classification model. Users can accomplish the following four tasks in our integrated system: (1) detect data instances in which the model confuses classification, (2) compare outcomes of the model by manipulating the conditions of the image, (3) understand reasons for the prediction of the model by highlighting highly influential parts from the image, and (4) analyze the overall what-if scenarios when augmenting the instances for each class. Moreover, by combining multiple techniques, our system lets users analyze behavior of the model from various perspectives. We conduct a user study of an image classification scenario with three domain experts. Our study will contribute to reducing the time cost for testing and understanding the CNN-based models in several industrial areas.
Description
@inproceedings{10.2312:evs.20211047,
booktitle = {EuroVis 2021 - Short Papers},
editor = {Agus, Marco and Garth, Christoph and Kerren, Andreas},
title = {{VATUN: Visual Analytics for Testing and Understanding Convolutional Neural Networks}},
author = {Park, Cheonbok and Yang, Soyoung and Na, Inyoup and Chung, Sunghyo and Shin, Sungbok and Kwon, Bum Chul and Park, Deokgun and Choo, Jaegul},
year = {2021},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-143-4},
DOI = {10.2312/evs.20211047}
}