TopoAct: Visually Exploring the Shape of Activations in Deep Learning

Loading...
Thumbnail Image
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd
Abstract
Deep neural networks such as GoogLeNet, ResNet, and BERT have achieved impressive performance in tasks such as image and text classification. To understand how such performance is achieved, we probe a trained deep neural network by studying neuron activations, i.e.combinations of neuron firings, at various layers of the network in response to a particular input. With a large number of inputs, we aim to obtain a global view of what neurons detect by studying their activations. In particular, we develop visualizations that show the shape of the activation space, the organizational principle behind neuron activations, and the relationships of these activations within a layer. Applying tools from topological data analysis, we present , a visual exploration system to study topological summaries of activation vectors. We present exploration scenarios using that provide valuable insights into learned representations of neural networks. We expect to give a topological perspective that enriches the current toolbox of neural network analysis, and to provide a basis for network architecture diagnosis and data anomaly detection.
Description

        
@article{
10.1111:cgf.14195
, journal = {Computer Graphics Forum}, title = {{
TopoAct: Visually Exploring the Shape of Activations in Deep Learning
}}, author = {
Rathore, Archit
and
Chalapathi, Nithin
and
Palande, Sourabh
and
Wang, Bei
}, year = {
2021
}, publisher = {
© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd
}, ISSN = {
1467-8659
}, DOI = {
10.1111/cgf.14195
} }
Citation
Collections