Interactive Analysis of CNN Robustness

dc.contributor.authorSietzen, Stefanen_US
dc.contributor.authorLechner, Mathiasen_US
dc.contributor.authorBorowski, Judyen_US
dc.contributor.authorHasani, Raminen_US
dc.contributor.authorWaldner, Manuelaen_US
dc.contributor.editorZhang, Fang-Lue and Eisemann, Elmar and Singh, Karanen_US
dc.date.accessioned2021-10-14T11:12:23Z
dc.date.available2021-10-14T11:12:23Z
dc.date.issued2021
dc.description.abstractWhile convolutional neural networks (CNNs) have found wide adoption as state-of-the-art models for image-related tasks, their predictions are often highly sensitive to small input perturbations, which the human vision is robust against. This paper presents Perturber, a web-based application that allows users to instantaneously explore how CNN activations and predictions evolve when a 3D input scene is interactively perturbed. Perturber offers a large variety of scene modifications, such as camera controls, lighting and shading effects, background modifications, object morphing, as well as adversarial attacks, to facilitate the discovery of potential vulnerabilities. Fine-tuned model versions can be directly compared for qualitative evaluation of their robustness. Case studies with machine learning experts have shown that Perturber helps users to quickly generate hypotheses about model vulnerabilities and to qualitatively compare model behavior. Using quantitative analyses, we could replicate users' insights with other CNN architectures and input images, yielding new insights about the vulnerability of adversarially trained models.en_US
dc.description.number7
dc.description.sectionheadersInteraction and Interfaces
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume40
dc.identifier.doi10.1111/cgf.14418
dc.identifier.issn1467-8659
dc.identifier.pages253-264
dc.identifier.urihttps://doi.org/10.1111/cgf.14418
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14418
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectHuman centered computing
dc.subjectVisualization systems and tools
dc.subjectComputing methodologies
dc.subjectMachine learning
dc.titleInteractive Analysis of CNN Robustnessen_US
Files
Original bundle
Now showing 1 - 3 of 3
Loading...
Thumbnail Image
Name:
v40i7pp253-264.pdf
Size:
10.19 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1068_mm.mp4
Size:
205.76 MB
Format:
Unknown data format
Loading...
Thumbnail Image
Name:
paper1068_mm.pdf
Size:
23.56 MB
Format:
Adobe Portable Document Format
Collections