TopoAct: Visually Exploring the Shape of Activations in Deep Learning
Loading...
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd
Abstract
Deep neural networks such as GoogLeNet, ResNet, and BERT have achieved impressive performance in tasks such as image and text classification. To understand how such performance is achieved, we probe a trained deep neural network by studying neuron activations, i.e.combinations of neuron firings, at various layers of the network in response to a particular input. With a large number of inputs, we aim to obtain a global view of what neurons detect by studying their activations. In particular, we develop visualizations that show the shape of the activation space, the organizational principle behind neuron activations, and the relationships of these activations within a layer. Applying tools from topological data analysis, we present , a visual exploration system to study topological summaries of activation vectors. We present exploration scenarios using that provide valuable insights into learned representations of neural networks. We expect to give a topological perspective that enriches the current toolbox of neural network analysis, and to provide a basis for network architecture diagnosis and data anomaly detection.
Description
@article{10.1111:cgf.14195,
journal = {Computer Graphics Forum},
title = {{TopoAct: Visually Exploring the Shape of Activations in Deep Learning}},
author = {Rathore, Archit and Chalapathi, Nithin and Palande, Sourabh and Wang, Bei},
year = {2021},
publisher = {© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14195}
}