Impacts of Student LLM Usage on Creativity in Data Visualization Education
No Thumbnail Available
Date
2024
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Large language models (LLMs) offer new possibilities for enhancing data visualization education, but the impacts on student experiences remain underexplored. Leveraging tenets of behaviorism, constructivism and experiential learning theories, our mixed-methods study examines LLM integration strategies. We conducted two experiments with different groups of students. The first experiment involved 95 Masters of Business Analytics students who created data narratives based on the Titanic dataset either with or without LLM assistance. The second experiment involved 30 Masters of Information and Data Science students who suggested effective visual encodings for different scenarios with or without LLM assistance in a Viz of the Day activity. We collected quantitative data from surveys and project scores and qualitative data from open-ended responses. Our results show that LLMs can enhance students' ability to create clear, accurate, and effective data stories and visualizations, but they can also pose challenges, such as requiring careful prompt crafting, producing inconsistent or inaccurate outputs, and potentially reducing students' creativity and critical thinking. We discuss how our findings suggest a nuanced balance between LLM guidance and human creativity in data storytelling education and practice, and provide specific directions for future research on LLMs and data visualization.
Description
CCS Concepts: Human-centered computing → Empirical studies in visualization; Empirical studies in HCI
@inproceedings{10.2312:eved.20241055,
booktitle = {EuroVis 2024 - Education Papers},
editor = {Firat, Elif E. and Laramee, Robert S. and Andersen, Nicklas Sindelv},
title = {{Impacts of Student LLM Usage on Creativity in Data Visualization Education}},
author = {Ahmad, Mak and Ma, Kwan-Liu},
year = {2024},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-257-8},
DOI = {10.2312/eved.20241055}
}