Visual Interpretation of DNN-based Acoustic Models using Deep Autoencoders

Grósz, Tamás; Kurimo, Mikko

Visual Interpretation of DNN-based Acoustic Models using Deep Autoencoders

Files

025-029.pdf (428.49 KB)

Date

2020

Authors

Grósz, Tamás
Kurimo, Mikko

Publisher

The Eurographics Association

Abstract

In the past few years, Deep Neural Networks (DNN) have become the state-of-the-art solution in several areas, including automatic speech recognition (ASR), unfortunately, they are generally viewed as black boxes. Recently, this started to change as researchers have dedicated much effort into interpreting their behavior. In this work, we concentrate on visual interpretation by depicting the hidden activation vectors of the DNN, and propose the usage of deep Autoencoders (DAE) to transform these hidden representations for inspection. We use multiple metrics to compare our approach with other, widely-used algorithms and the results show that our approach is quite competitive. The main advantage of using Autoencoders over the existing ones is that after the training phase, it applies a fixed transformation that can be used to visualize any hidden activation vector without any further optimization, which is not true for the other methods.

        @inproceedings{10.2312:mlvis.20201103
,
booktitle = {Machine Learning Methods in Visualisation for Big Data
},
editor = {Archambault, Daniel and Nabney, Ian and Peltonen, Jaakko
},
title = {{Visual Interpretation of DNN-based Acoustic Models using Deep Autoencoders
}},
author = {Grósz, Tamás and 
Kurimo, Mikko
},
year = {2020
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-113-7
},
DOI = {10.2312/mlvis.20201103
}
}