ConAn: Measuring and Evaluating User Confidence in Visual Data Analysis Under Uncertainty

Simple item page
dc.contributor.authorMusleh, M.en_US
dc.contributor.authorCeneda, D.en_US
dc.contributor.authorEhlers, H.en_US
dc.contributor.authorRaidou, R. G.en_US
dc.date.accessioned2025-03-07T16:48:47Z
dc.date.available2025-03-07T16:48:47Z
dc.date.issued2024
dc.description.abstractUser confidence plays an important role in guided visual data analysis scenarios, especially when uncertainty is involved in the analytical process. However, measuring confidence in practical scenarios remains an open challenge, as previous work relies primarily on self‐reporting methods. In this work, we propose a quantitative approach to measure user confidence—as opposed to trust—in an analytical scenario. We do so by exploiting the respective user interaction provenance graph and examining the impact of guidance using a set of network metrics. We assess the usefulness of our proposed metrics through a user study that correlates results obtained from self‐reported confidence assessments and our metrics—both with and without guidance. The results suggest that our metrics improve the evaluation of user confidence compared to available approaches. In particular, we found a correlation between self‐reported confidence and some of the proposed provenance network metrics. The quantitative results, though, do not show a statistically significant impact of the guidance on user confidence. An additional descriptive analysis suggests that guidance could impact users' confidence and that the qualitative analysis of the provenance network topology can provide a comprehensive view of changes in user confidence. Our results indicate that our proposed metrics and the provenance network graph representation support the evaluation of user confidence and, subsequently, the effective development of guidance in VA.en_US
dc.description.number1
dc.description.sectionheadersOriginal Article
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.15272
dc.identifier.issn1467-8659
dc.identifier.pages18
dc.identifier.urihttps://doi.org/10.1111/cgf.15272
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15272
dc.publisherEurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectdecision making
dc.subjectuncertainty
dc.subjectuser confidence
dc.subjectvisual analytics
dc.subject• Human‐centred computing → visualization design and evaluation methods; empirical studies in visualization; visualization theory, concepts and paradigms; visual analytics
dc.titleConAn: Measuring and Evaluating User Confidence in Visual Data Analysis Under Uncertaintyen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
13_cgf15272.pdf
Size:
2.28 MB
Format:
Adobe Portable Document Format
Download
Collections
44-Issue 1