Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
The metaphor of auscultating with a stethoscope can be an inspiration to combine visualization and sonification for exploratory data analysis. This paper presents SoniScope, a multimodal approach and its prototypical implementation based on this metaphor. It combines a scatterplot with an interactive parameter mapping sonification, thereby conveying additional information about items that were selected with a visual lens. SoniScope explores several design options for the shape of its lens and the sorting of the selected items for subsequent sonification. Furthermore, the open-source prototype serves as a blueprint framework for how to combine D3.js visualization and SuperCollider sonification in the Jupyter notebook environment.
Description
CCS Concepts: Human-centered computing --> Visualization systems and tools; Auditory feedback; Sound-based input / output
@inproceedings{10.2312:evs.20221095,
booktitle = {EuroVis 2022 - Short Papers},
editor = {Agus, Marco and Aigner, Wolfgang and Hoellt, Thomas},
title = {{Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation}},
author = {Enge, Kajetan and Rind, Alexander and Iber, Michael and Höldrich, Robert and Aigner, Wolfgang},
year = {2022},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-184-7},
DOI = {10.2312/evs.20221095}
}