CAN: Concept-aligned Neurons for Visual Comparison of Neural Networks

dc.contributor.authorLi, Mingweien_US
dc.contributor.authorJeong, Sangwonen_US
dc.contributor.authorLiu, Shusenen_US
dc.contributor.authorBerger, Matthewen_US
dc.contributor.editorAigner, Wolfgangen_US
dc.contributor.editorArchambault, Danielen_US
dc.contributor.editorBujack, Roxanaen_US
dc.date.accessioned2024-05-21T08:18:03Z
dc.date.available2024-05-21T08:18:03Z
dc.date.issued2024
dc.description.abstractWe present concept-aligned neurons, or CAN, a visualization design for comparing deep neural networks. The goal of CAN is to support users in understanding the similarities and differences between neural networks, with an emphasis on comparing neuron functionality across different models. To make this comparison intuitive, CAN uses concept-based representations of neurons to visually align models in an interpretable manner. A key feature of CAN is the hierarchical organization of concepts, which permits users to relate sets of neurons at different levels of detail. CAN's visualization is designed to help compare the semantic coverage of neurons, as well as assess the distinctiveness, redundancy, and multi-semantic alignment of neurons or groups of neurons, all at different concept granularity. We demonstrate the generality and effectiveness of CAN by comparing models trained on different datasets, neural networks with different architectures, and models trained for different objectives, e.g. adversarial robustness, and robustness to out-of-distribution data.en_US
dc.description.number3
dc.description.sectionheadersAI4Vis and Vis4AI
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume43
dc.identifier.doi10.1111/cgf.15085
dc.identifier.issn1467-8659
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.15085
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15085
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rights.urihttps://creativecommons.org/licenses/by-nc/4.0/
dc.subjectCCS Concepts: Human-centered computing → Visualization; Visual analytics
dc.subjectHuman centered computing → Visualization
dc.subjectVisual analytics
dc.titleCAN: Concept-aligned Neurons for Visual Comparison of Neural Networksen_US
Files
Original bundle
Now showing 1 - 3 of 3
No Thumbnail Available
Name:
v43i3_10_cgf15085.pdf
Size:
7.8 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
1247-i7.pdf
Size:
18.33 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
1247-i8.mp4
Size:
14.17 MB
Format:
Video MP4
Collections