Seeing Through Sounds: Mapping Auditory Dimensions to Data and Charts for People with Visual Impairments

Loading...
Thumbnail Image
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Sonification can be an effective medium for people with visual impairments to understand data in visualizations. However, there are no universal design principles that apply to various charts that encode different data types. Towards generalizable principles, we conducted an exploratory experiment to assess how different auditory channels (e.g., pitch, volume) impact the data and visualization perception among people with visual impairments. In our experiment, participants evaluated the intuitiveness and accuracy of the mapping of auditory channels on different data and chart types. We found that participants rated pitch to be the most intuitive, while the number of tappings and the length of sounds yielded the most accurate perception in decoding data. We study how audio channels can intuitively represent different charts and demonstrate that data-level perception might not directly transfer to chart-level perception as participants reflect on visual aspects of the charts while listening to audio. We conclude by how future experiments can be designed to establish a robust ranking for creating audio charts.
Description

CCS Concepts: Human-centered computing --> Empirical studies in visualization; Empirical studies in accessibility

        
@article{
10.1111:cgf.14523
, journal = {Computer Graphics Forum}, title = {{
Seeing Through Sounds: Mapping Auditory Dimensions to Data and Charts for People with Visual Impairments
}}, author = {
Wang, Ruobin
and
Jung, Crescentia
and
Kim, Yea-Seul
}, year = {
2022
}, publisher = {
The Eurographics Association and John Wiley & Sons Ltd.
}, ISSN = {
1467-8659
}, DOI = {
10.1111/cgf.14523
} }
Citation
Collections