Saliency Clouds: Visual Analysis of Point Cloud-oriented Deep Neural Networks in DeepRL for Particle Physics

Loading...
Thumbnail Image
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We develop and describe saliency clouds, that is, visualization methods employing explainable AI methods to analyze and interpret deep reinforcement learning (DeepRL) agents working on point cloud-based data. The agent in our application case is tasked to track particles in high energy physics and is still under development. The point clouds contain properties of particle hits on layers of a detector as the input to reconstruct the trajectories of the particles. Through visualization of the influence of different points, their possible connections in an implicit graph, and other features on the decisions of the policy network of the DeepRL agent, we aim to explain the decision making of the agent in tracking particles and thus support its development. In particular, we adapt gradient-based saliency mapping methods to work on these point clouds. We show how the properties of the methods, which were developed for image data, translate to the structurally different point cloud data. Finally, we present visual representations of saliency clouds supporting visual analysis and interpretation of the RL agent's policy network.
Description

CCS Concepts: Human-centered computing --> Visualization techniques; Computing methodologies --> Neural networks

        
@inproceedings{
10.2312:mlvis.20221069
, booktitle = {
Machine Learning Methods in Visualisation for Big Data
}, editor = {
Archambault, Daniel
 and
Nabney, Ian
 and
Peltonen, Jaakko
}, title = {{
Saliency Clouds: Visual Analysis of Point Cloud-oriented Deep Neural Networks in DeepRL for Particle Physics
}}, author = {
Mulawade, Raju Ningappa
 and
Garth, Christoph
 and
Wiebel, Alexander
}, year = {
2022
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-182-3
}, DOI = {
10.2312/mlvis.20221069
} }
Citation