42-Issue 3

Permanent URI for this collection

EuroVis 2023 - 25th EG Conference on Visualization
Leipzig, Germany, June 12 - 16, 2023
Awards Session
Mini-VLAT: A Short and Effective Measure of Visualization Literacy
Saugat Pandey and Alvitta Ottley
ChemoGraph: Interactive Visual Exploration of the Chemical Space
Bharat Kale, Austin Clyde, Maoyuan Sun, Arvind Ramanathan, Rick Stevens, and Michael E. Papka
A Fully Integrated Pipeline for Visual Carotid Morphology Analysis
Pepe Eulzer, Fabienne von Deylen, Wei-Chan Hsu, Ralph Wickenhöfer, Carsten M. Klingner, and Kai Lawonn
Scalar and Vector Fields
Doppler Volume Rendering: A Dynamic, Piecewise Linear Spectral Representation for Visualizing Astrophysics Simulations
Reem Alghamdi, Thomas Müller, Alberto Jaspe-Villanueva, Markus Hadwiger, and Filip Sadlo
Memory-Efficient GPU Volume Path Tracing of AMR Data Using the Dual Mesh
Stefan Zellmann, Qi Wu, Kwan-Liu Ma, and Ingo Wald
xOpat: eXplainable Open Pathology Analysis Tool
Jirí Horák, Katarína Furmanová, Barbora Kozlíková, Tomáš Brázdil, Petr Holub, Martin Kacenga, Matej Gallo, Rudolf Nenutil, Jan Byška, and Vit Rusnak
Methodology and Design Studies
Process and Pitfalls of Online Teaching and Learning with Design Study ''Lite'' Methodology: A Retrospective Analysis
Uzma Haque Syeda, Cody Dunne, and Michelle A. Borkin
Graphs and Hypergraphs
RectEuler: Visualizing Intersecting Sets using Rectangles
Patrick Paetzold, Rebecca Kehlbeck, Hendrik Strobelt, Yumeng Xue, Sabine Storandt, and Oliver Deussen
Cognition, Perception, and Stories
Data Stories of Water: Studying the Communicative Role of Data Visualizations within Long-form Journalism
Manuela Garreton, Francesca Morini, Daniela Paz Moyano, Gianna-Carina Grün, Denis Parra, and Marian Dörk
Belief Decay or Persistence? A Mixed-method Study on Belief Movement Over Time
Shrey Gupta, Alireza Karduni, and Emily Wall
Do Disease Stories need a Hero? Effects of Human Protagonists on a Narrative Visualization about Cerebral Small Vessel Disease
Sarah Mittenentzwei, Veronika Weiß, Stefanie Schreiber, Laura A. Garrison, Stefan Bruckner, Malte Pfister, Bernhard Preim, and Monique Meuschke
Don't Peek at My Chart: Privacy-preserving Visualization for Mobile Devices
Songheng Zhang, Dong Ma, and Yong Wang
Visualization Techniques I: Sequences and High-dimensional Data
VisCoMET: Visually Analyzing Team Collaboration in Medical Emergency Trainings
Carina Liebers, Shivam Agarwal, Maximilian Krug, Karola Pitsch, and Fabian Beck
FlexEvent: going beyond Case-Centric Exploration and Analysis of Multivariate Event Sequences
Sanne van der Linden, Bernice M. Wulterkens, Merel M. van Gilst, Sebastiaan Overeem, Carola van Pul, Anna Vilanova, and Stef van den Elzen
A Comparative Evaluation of Visual Summarization Techniques for Event Sequences
Kazi Tasnim Zinat, Jinhua Yang, Arjun Gandhi, Nistha Mitra, and Zhicheng Liu
Visual Analysis and Processes
Ferret: Reviewing Tabular Datasets for Manipulation
Devin Lange, Shaurya Sahai, Jeff M. Phillips, and Alexander Lex
Human-Computer Collaboration for Visual Analytics: an Agent-based Framework
Shayan Monadjemi, Mengtian Guo, David Gotz, Roman Garnett, and Alvitta Ottley
Social Sciences and Sport
Exploring Interpersonal Relationships in Historical Voting Records
Gabriel Dias Cantareira, Yiwen Xing, Nicholas Cole, Rita Borgo, and Alfie Abdul-Rahman
Tac-Anticipator: Visual Analytics of Anticipation Behaviors in Table Tennis Matches
Jiachen Wang, Yihong Wu, Xiaolong Zhang, Yixin Zeng, Zheng Zhou, Hui Zhang, Xiao Xie, and Yingcai Wu
Visualization Techniques II: Diagrams and Glyphs
Teru Teru Bozu: Defensive Raincloud Plots
Michael Correll
VENUS: A Geometrical Representation for Quantum State Visualization
Shaolun Ruan, Ribo Yuan, Qiang Guan, Yanna Lin, Ying Mao, Weiwen Jiang, Zhepeng Wang, Wei Xu, and Yong Wang
Visualization for Life Sciences
visMOP - A Visual Analytics Approach for Multi-omics Pathways
Nicolas Brich, Nadine Schacherer, Miriam Hoene, Cora Weigert, Rainer Lehmann, and Michael Krone
GO-Compass: Visual Navigation of Multiple Lists of GO terms
Theresa Harbig, Mathias Witte Paz, and Kay Nieselt
DASS Good: Explainable Data Mining of Spatial Cohort Data
Andrew Wentzel, Carla Floricel, Guadalupe Canahuate, Mohamed A. Naser, Abdallah Mohamed, Clifton David Fuller, Lisanne van Dijk, and G. Elisabeta Marai
Interaction and Accessibility
Unfolding Edges: Adding Context to Edges in Multivariate Graph Visualization
Mark-Jan Bludau, Marian Dörk, and Christian Tominski
WYTIWYR: A User Intent-Aware Framework with Multi-modal Inputs for Visualization Retrieval
Shishi Xiao, Yihan Hou, Cheng Jin, and Wei Zeng
Beyond Alternative Text and Tables: Comparative Analysis of Visualization Tools and Accessibility Methods
Nam Wook Kim, Grace Ataguba, Shakila Cherise Joyner, Chuangdian Zhao, and Hyejin Im
ParaDime: A Framework for Parametric Dimensionality Reduction
Andreas Hinterreiter, Christina Humer, Bernhard Kainz, and Marc Streit
Where to Look? AR, VR, and Attention
Evaluating View Management for Situated Visualization in Web-based Handheld AR
Andrea Batch, Sungbok Shin, Julia Liu, Peter W. S. Butcher, Panagiotis D. Ritsos, and Niklas Elmqvist
Illustrative Motion Smoothing for Attention Guidance in Dynamic Visualizations
Johannes Eschner, Peter Mindek, and Manuela Waldner
Visual Gaze Labeling for Augmented Reality Studies
Seyda Öney, Nelusa Pathmanathan, Michael Becher, Michael Sedlmair, Daniel Weiskopf, and Kuno Kurzhals
Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real-World Environments
Nelusa Pathmanathan, Seyda Öney, Michael Becher, Michael Sedlmair, Daniel Weiskopf, and Kuno Kurzhals
Visualization and Machine Learning
VISITOR: Visual Interactive State Sequence Exploration for Reinforcement Learning
Yannick Metz, Eugene Bykovets, Lucas Joos, Daniel Keim, and Mennatallah El-Assady
LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity
Anjana Arunkumar, Shubham Sharma, Rakhi Agrawal, Sriram Chandrasekaran, and Chris Bryan
Doom or Deliciousness: Challenges and Opportunities for Visualization in the Age of Generative Models
Victor Schetinger, Sara Di Bartolomeo, Mennatallah El-Assady, Andrew McNutt, Matthias Miller, João Paulo Apolinário Passos, and Jane L. Adams
Visual Analytics on Network Forgetting for Task-Incremental Learning
Ziwei Li, Jiayi Xu, Wei-Lun Chao, and Han-Wei Shen

BibTeX (42-Issue 3)
                
@article{
10.1111:cgf.14843,
journal = {Computer Graphics Forum}, title = {{
EuroVis 2023 CGF 42-3: Frontmatter}},
author = {
Bujack, Roxana
 and
Archambault, Daniel
 and
Schreck, Tobias
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14843}
}
                
@article{
10.1111:cgf.14809,
journal = {Computer Graphics Forum}, title = {{
Mini-VLAT: A Short and Effective Measure of Visualization Literacy}},
author = {
Pandey, Saugat
 and
Ottley, Alvitta
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14809}
}
                
@article{
10.1111:cgf.14807,
journal = {Computer Graphics Forum}, title = {{
ChemoGraph: Interactive Visual Exploration of the Chemical Space}},
author = {
Kale, Bharat
 and
Clyde, Austin
 and
Sun, Maoyuan
 and
Ramanathan, Arvind
 and
Stevens, Rick
 and
Papka, Michael E.
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14807}
}
                
@article{
10.1111:cgf.14808,
journal = {Computer Graphics Forum}, title = {{
A Fully Integrated Pipeline for Visual Carotid Morphology Analysis}},
author = {
Eulzer, Pepe
 and
Deylen, Fabienne von
 and
Hsu, Wei-Chan
 and
Wickenhöfer, Ralph
 and
Klingner, Carsten M.
 and
Lawonn, Kai
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14808}
}
                
@article{
10.1111:cgf.14810,
journal = {Computer Graphics Forum}, title = {{
Doppler Volume Rendering: A Dynamic, Piecewise Linear Spectral Representation for Visualizing Astrophysics Simulations}},
author = {
Alghamdi, Reem
 and
Müller, Thomas
 and
Jaspe-Villanueva, Alberto
 and
Hadwiger, Markus
 and
Sadlo, Filip
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14810}
}
                
@article{
10.1111:cgf.14811,
journal = {Computer Graphics Forum}, title = {{
Memory-Efficient GPU Volume Path Tracing of AMR Data Using the Dual Mesh}},
author = {
Zellmann, Stefan
 and
Wu, Qi
 and
Ma, Kwan-Liu
 and
Wald, Ingo
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14811}
}
                
@article{
10.1111:cgf.14812,
journal = {Computer Graphics Forum}, title = {{
xOpat: eXplainable Open Pathology Analysis Tool}},
author = {
Horák, Jirí
 and
Furmanová, Katarína
 and
Kozlíková, Barbora
 and
Brázdil, Tomáš
 and
Holub, Petr
 and
Kacenga, Martin
 and
Gallo, Matej
 and
Nenutil, Rudolf
 and
Byška, Jan
 and
Rusnak, Vit
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14812}
}
                
@article{
10.1111:cgf.14813,
journal = {Computer Graphics Forum}, title = {{
Process and Pitfalls of Online Teaching and Learning with Design Study ''Lite'' Methodology: A Retrospective Analysis}},
author = {
Syeda, Uzma Haque
 and
Dunne, Cody
 and
Borkin, Michelle A.
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14813}
}
                
@article{
10.1111:cgf.14814,
journal = {Computer Graphics Forum}, title = {{
RectEuler: Visualizing Intersecting Sets using Rectangles}},
author = {
Paetzold, Patrick
 and
Kehlbeck, Rebecca
 and
Strobelt, Hendrik
 and
Xue, Yumeng
 and
Storandt, Sabine
 and
Deussen, Oliver
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14814}
}
                
@article{
10.1111:cgf.14815,
journal = {Computer Graphics Forum}, title = {{
Data Stories of Water: Studying the Communicative Role of Data Visualizations within Long-form Journalism}},
author = {
Garreton, Manuela
 and
Morini, Francesca
 and
Moyano, Daniela Paz
 and
Grün, Gianna-Carina
 and
Parra, Denis
 and
Dörk, Marian
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14815}
}
                
@article{
10.1111:cgf.14816,
journal = {Computer Graphics Forum}, title = {{
Belief Decay or Persistence? A Mixed-method Study on Belief Movement Over Time}},
author = {
Gupta, Shrey
 and
Karduni, Alireza
 and
Wall, Emily
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14816}
}
                
@article{
10.1111:cgf.14817,
journal = {Computer Graphics Forum}, title = {{
Do Disease Stories need a Hero? Effects of Human Protagonists on a Narrative Visualization about Cerebral Small Vessel Disease}},
author = {
Mittenentzwei, Sarah
 and
Weiß, Veronika
 and
Schreiber, Stefanie
 and
Garrison, Laura A.
 and
Bruckner, Stefan
 and
Pfister, Malte
 and
Preim, Bernhard
 and
Meuschke, Monique
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14817}
}
                
@article{
10.1111:cgf.14818,
journal = {Computer Graphics Forum}, title = {{
Don't Peek at My Chart: Privacy-preserving Visualization for Mobile Devices}},
author = {
Zhang, Songheng
 and
Ma, Dong
 and
Wang, Yong
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14818}
}
                
@article{
10.1111:cgf.14819,
journal = {Computer Graphics Forum}, title = {{
VisCoMET: Visually Analyzing Team Collaboration in Medical Emergency Trainings}},
author = {
Liebers, Carina
 and
Agarwal, Shivam
 and
Krug, Maximilian
 and
Pitsch, Karola
 and
Beck, Fabian
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14819}
}
                
@article{
10.1111:cgf.14820,
journal = {Computer Graphics Forum}, title = {{
FlexEvent: going beyond Case-Centric Exploration and Analysis of Multivariate Event Sequences}},
author = {
Linden, Sanne van der
 and
Wulterkens, Bernice M.
 and
Gilst, Merel M. van
 and
Overeem, Sebastiaan
 and
Pul, Carola van
 and
Vilanova, Anna
 and
Elzen, Stef van den
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14820}
}
                
@article{
10.1111:cgf.14821,
journal = {Computer Graphics Forum}, title = {{
A Comparative Evaluation of Visual Summarization Techniques for Event Sequences}},
author = {
Zinat, Kazi Tasnim
 and
Yang, Jinhua
 and
Gandhi, Arjun
 and
Mitra, Nistha
 and
Liu, Zhicheng
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14821}
}
                
@article{
10.1111:cgf.14822,
journal = {Computer Graphics Forum}, title = {{
Ferret: Reviewing Tabular Datasets for Manipulation}},
author = {
Lange, Devin
 and
Sahai, Shaurya
 and
Phillips, Jeff M.
 and
Lex, Alexander
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14822}
}
                
@article{
10.1111:cgf.14823,
journal = {Computer Graphics Forum}, title = {{
Human-Computer Collaboration for Visual Analytics: an Agent-based Framework}},
author = {
Monadjemi, Shayan
 and
Guo, Mengtian
 and
Gotz, David
 and
Garnett, Roman
 and
Ottley, Alvitta
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14823}
}
                
@article{
10.1111:cgf.14824,
journal = {Computer Graphics Forum}, title = {{
Exploring Interpersonal Relationships in Historical Voting Records}},
author = {
Cantareira, Gabriel Dias
 and
Xing, Yiwen
 and
Cole, Nicholas
 and
Borgo, Rita
 and
Abdul-Rahman, Alfie
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14824}
}
                
@article{
10.1111:cgf.14825,
journal = {Computer Graphics Forum}, title = {{
Tac-Anticipator: Visual Analytics of Anticipation Behaviors in Table Tennis Matches}},
author = {
Wang, Jiachen
 and
Wu, Yihong
 and
Zhang, Xiaolong
 and
Zeng, Yixin
 and
Zhou, Zheng
 and
Zhang, Hui
 and
Xie, Xiao
 and
Wu, Yingcai
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14825}
}
                
@article{
10.1111:cgf.14826,
journal = {Computer Graphics Forum}, title = {{
Teru Teru Bozu: Defensive Raincloud Plots}},
author = {
Correll, Michael
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14826}
}
                
@article{
10.1111:cgf.14827,
journal = {Computer Graphics Forum}, title = {{
VENUS: A Geometrical Representation for Quantum State Visualization}},
author = {
Ruan, Shaolun
 and
Yuan, Ribo
 and
Guan, Qiang
 and
Lin, Yanna
 and
Mao, Ying
 and
Jiang, Weiwen
 and
Wang, Zhepeng
 and
Xu, Wei
 and
Wang, Yong
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14827}
}
                
@article{
10.1111:cgf.14828,
journal = {Computer Graphics Forum}, title = {{
visMOP - A Visual Analytics Approach for Multi-omics Pathways}},
author = {
Brich, Nicolas
 and
Schacherer, Nadine
 and
Hoene, Miriam
 and
Weigert, Cora
 and
Lehmann, Rainer
 and
Krone, Michael
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14828}
}
                
@article{
10.1111:cgf.14829,
journal = {Computer Graphics Forum}, title = {{
GO-Compass: Visual Navigation of Multiple Lists of GO terms}},
author = {
Harbig, Theresa
 and
Paz, Mathias Witte
 and
Nieselt, Kay
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14829}
}
                
@article{
10.1111:cgf.14830,
journal = {Computer Graphics Forum}, title = {{
DASS Good: Explainable Data Mining of Spatial Cohort Data}},
author = {
Wentzel, Andrew
 and
Floricel, Carla
 and
Canahuate, Guadalupe
 and
Naser, Mohamed A.
 and
Mohamed, Abdallah S.
 and
Fuller, Clifton David
 and
Dijk, Lisanne van
 and
Marai, G. Elisabeta
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14830}
}
                
@article{
10.1111:cgf.14832,
journal = {Computer Graphics Forum}, title = {{
WYTIWYR: A User Intent-Aware Framework with Multi-modal Inputs for Visualization Retrieval}},
author = {
Xiao, Shishi
 and
Hou, Yihan
 and
Jin, Cheng
 and
Zeng, Wei
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14832}
}
                
@article{
10.1111:cgf.14831,
journal = {Computer Graphics Forum}, title = {{
Unfolding Edges: Adding Context to Edges in Multivariate Graph Visualization}},
author = {
Bludau, Mark-Jan
 and
Dörk, Marian
 and
Tominski, Christian
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14831}
}
                
@article{
10.1111:cgf.14833,
journal = {Computer Graphics Forum}, title = {{
Beyond Alternative Text and Tables: Comparative Analysis of Visualization Tools and Accessibility Methods}},
author = {
Kim, Nam Wook
 and
Ataguba, Grace
 and
Joyner, Shakila Cherise
 and
Zhao, Chuangdian
 and
Im, Hyejin
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14833}
}
                
@article{
10.1111:cgf.14834,
journal = {Computer Graphics Forum}, title = {{
ParaDime: A Framework for Parametric Dimensionality Reduction}},
author = {
Hinterreiter, Andreas
 and
Humer, Christina
 and
Kainz, Bernhard
 and
Streit, Marc
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14834}
}
                
@article{
10.1111:cgf.14835,
journal = {Computer Graphics Forum}, title = {{
Evaluating View Management for Situated Visualization in Web-based Handheld AR}},
author = {
Batch, Andrea
 and
Shin, Sungbok
 and
Liu, Julia
 and
Butcher, Peter W. S.
 and
Ritsos, Panagiotis D.
 and
Elmqvist, Niklas
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14835}
}
                
@article{
10.1111:cgf.14836,
journal = {Computer Graphics Forum}, title = {{
Illustrative Motion Smoothing for Attention Guidance in Dynamic Visualizations}},
author = {
Eschner, Johannes
 and
Mindek, Peter
 and
Waldner, Manuela
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14836}
}
                
@article{
10.1111:cgf.14837,
journal = {Computer Graphics Forum}, title = {{
Visual Gaze Labeling for Augmented Reality Studies}},
author = {
Öney, Seyda
 and
Pathmanathan, Nelusa
 and
Becher, Michael
 and
Sedlmair, Michael
 and
Weiskopf, Daniel
 and
Kurzhals, Kuno
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14837}
}
                
@article{
10.1111:cgf.14838,
journal = {Computer Graphics Forum}, title = {{
Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real-World Environments}},
author = {
Pathmanathan, Nelusa
 and
Öney, Seyda
 and
Becher, Michael
 and
Sedlmair, Michael
 and
Weiskopf, Daniel
 and
Kurzhals, Kuno
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14838}
}
                
@article{
10.1111:cgf.14839,
journal = {Computer Graphics Forum}, title = {{
VISITOR: Visual Interactive State Sequence Exploration for Reinforcement Learning}},
author = {
Metz, Yannick
 and
Bykovets, Eugene
 and
Joos, Lucas
 and
Keim, Daniel
 and
El-Assady, Mennatallah
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14839}
}
                
@article{
10.1111:cgf.14840,
journal = {Computer Graphics Forum}, title = {{
LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity}},
author = {
Arunkumar, Anjana
 and
Sharma, Shubham
 and
Agrawal, Rakhi
 and
Chandrasekaran, Sriram
 and
Bryan, Chris
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14840}
}
                
@article{
10.1111:cgf.14841,
journal = {Computer Graphics Forum}, title = {{
Doom or Deliciousness: Challenges and Opportunities for Visualization in the Age of Generative Models}},
author = {
Schetinger, Victor
 and
Bartolomeo, Sara Di
 and
El-Assady, Mennatallah
 and
McNutt, Andrew
 and
Miller, Matthias
 and
Passos, João Paulo Apolinário
 and
Adams, Jane L.
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14841}
}
                
@article{
10.1111:cgf.14842,
journal = {Computer Graphics Forum}, title = {{
Visual Analytics on Network Forgetting for Task-Incremental Learning}},
author = {
Li, Ziwei
 and
Xu, Jiayi
 and
Chao, Wei-Lun
 and
Shen, Han-Wei
}, year = {
2023},
publisher = {
The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {
10.1111/cgf.14842}
}

Browse

Recent Submissions

Now showing 1 - 37 of 37
  • Item
    EuroVis 2023 CGF 42-3: Frontmatter
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Bujack, Roxana; Archambault, Daniel; Schreck, Tobias; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
  • Item
    Mini-VLAT: A Short and Effective Measure of Visualization Literacy
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Pandey, Saugat; Ottley, Alvitta; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    The visualization community regards visualization literacy as a necessary skill. Yet, despite the recent increase in research into visualization literacy by the education and visualization communities, we lack practical and time-effective instruments for the widespread measurements of people's comprehension and interpretation of visual designs. We present Mini-VLAT, a brief but practical visualization literacy test. The Mini-VLAT is a 12-item short form of the 53-item Visualization Literacy Assessment Test (VLAT). The Mini-VLAT is reliable (coefficient omega = 0.72) and strongly correlates with the VLAT. Five visualization experts validated the Mini-VLAT items, yielding an average content validity ratio (CVR) of 0.6. We further validate Mini-VLAT by demonstrating a strong positive correlation between study participants' Mini-VLAT scores and their aptitude for learning an unfamiliar visualization using a Parallel Coordinate Plot test. Overall, the Mini-VLAT items showed a similar pattern of validity and reliability as the 53-item VLAT. The results show that Mini-VLAT is a psychometrically sound and practical short measure of visualization literacy.
  • Item
    ChemoGraph: Interactive Visual Exploration of the Chemical Space
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Kale, Bharat; Clyde, Austin; Sun, Maoyuan; Ramanathan, Arvind; Stevens, Rick; Papka, Michael E.; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Exploratory analysis of the chemical space is an important task in the field of cheminformatics. For example, in drug discovery research, chemists investigate sets of thousands of chemical compounds in order to identify novel yet structurally similar synthetic compounds to replace natural products. Manually exploring the chemical space inhabited by all possible molecules and chemical compounds is impractical, and therefore presents a challenge. To fill this gap, we present ChemoGraph, a novel visual analytics technique for interactively exploring related chemicals. In ChemoGraph, we formalize a chemical space as a hypergraph and apply novel machine learning models to compute related chemical compounds. It uses a database to find related compounds from a known space and a machine learning model to generate new ones, which helps enlarge the known space. Moreover, ChemoGraph highlights interactive features that support users in viewing, comparing, and organizing computationally identified related chemicals. With a drug discovery usage scenario and initial expert feedback from a case study, we demonstrate the usefulness of ChemoGraph.
  • Item
    A Fully Integrated Pipeline for Visual Carotid Morphology Analysis
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Eulzer, Pepe; Deylen, Fabienne von; Hsu, Wei-Chan; Wickenhöfer, Ralph; Klingner, Carsten M.; Lawonn, Kai; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Analyzing stenoses of the internal carotids - local constrictions of the artery - is a critical clinical task in cardiovascular disease treatment and prevention. For this purpose, we propose a self-contained pipeline for the visual analysis of carotid artery geometries. The only inputs are computed tomography angiography (CTA) scans, which are already recorded in clinical routine. We show how integrated model extraction and visualization can help to efficiently detect stenoses and we provide means for automatic, highly accurate stenosis degree computation. We directly connect multiple sophisticated processing stages, including a neural prediction network for lumen and plaque segmentation and automatic global diameter computation. We enable interactive and retrospective user control over the processing stages. Our aims are to increase user trust by making the underlying data validatable on the fly, to decrease adoption costs by minimizing external dependencies, and to optimize scalability by streamlining the data processing. We use interactive visualizations for data inspection and adaption to guide the user through the processing stages. The framework was developed and evaluated in close collaboration with radiologists and neurologists. It has been used to extract and analyze over 100 carotid bifurcation geometries and is built with a modular architecture, available as an extendable open-source platform.
  • Item
    Doppler Volume Rendering: A Dynamic, Piecewise Linear Spectral Representation for Visualizing Astrophysics Simulations
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Alghamdi, Reem; Müller, Thomas; Jaspe-Villanueva, Alberto; Hadwiger, Markus; Sadlo, Filip; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    We present a novel approach for rendering volumetric data including the Doppler effect of light. Similar to the acoustic Doppler effect, which is caused by relative motion between a sound emitter and an observer, light waves also experience compression or expansion when emitter and observer exhibit relative motion. We account for this by employing spectral volume rendering in an emission-absorption model, with the volumetric matter moving according to an accompanying vector field, and emitting and attenuating light at wavelengths subject to the Doppler effect. By introducing a novel piecewise linear representation of the involved light spectra, we achieve accurate volume rendering at interactive frame rates. We compare our technique to rendering with traditional point-based spectral representation, and demonstrate its utility using a simulation of galaxy formation.
  • Item
    Memory-Efficient GPU Volume Path Tracing of AMR Data Using the Dual Mesh
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Zellmann, Stefan; Wu, Qi; Ma, Kwan-Liu; Wald, Ingo; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    A common way to render cell-centric adaptive mesh refinement (AMR) data is to compute the dual mesh and visualize that with a standard unstructured element renderer. While the dual mesh provides a high-quality interpolator, the memory requirements of the dual mesh data structure are significantly higher than those of the original grid, which prevents rendering very large data sets. We introduce a GPU-friendly data structure and a clustering algorithm that allow for efficient AMR dual mesh rendering with a competitive memory footprint. Fundamentally, any off-the-shelf unstructured element renderer running on GPUs could be extended to support our data structure just by adding a gridlet element type in addition to the standard tetrahedra, pyramids, wedges, and hexahedra supported by default. We integrated the data structure into a volumetric path tracer to compare it to various state-of-the-art unstructured element sampling methods. We show that our data structure easily competes with these methods in terms of rendering performance, but is much more memory-efficient.
  • Item
    xOpat: eXplainable Open Pathology Analysis Tool
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Horák, Jirí; Furmanová, Katarína; Kozlíková, Barbora; Brázdil, Tomáš; Holub, Petr; Kacenga, Martin; Gallo, Matej; Nenutil, Rudolf; Byška, Jan; Rusnak, Vit; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Histopathology research quickly evolves thanks to advances in whole slide imaging (WSI) and artificial intelligence (AI). However, existing WSI viewers are tailored either for clinical or research environments, but none suits both. This hinders the adoption of new methods and communication between the researchers and clinicians. The paper presents xOpat, an open-source, browserbased WSI viewer that addresses these problems. xOpat supports various data sources, such as tissue images, pathologists' annotations, or additional data produced by AI models. Furthermore, it provides efficient rendering of multiple data layers, their visual representations, and tools for annotating and presenting findings. Thanks to its modular, protocol-agnostic, and extensible architecture, xOpat can be easily integrated into different environments and thus helps to bridge the gap between research and clinical practice. To demonstrate the utility of xOpat, we present three case studies, one conducted with a developer of AI algorithms for image segmentation and two with a research pathologist.
  • Item
    Process and Pitfalls of Online Teaching and Learning with Design Study ''Lite'' Methodology: A Retrospective Analysis
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Syeda, Uzma Haque; Dunne, Cody; Borkin, Michelle A.; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Design studies are an integral method of visualization research with hundreds of instances in the literature. Although taught as a theory, the practical implementation of design studies is often excluded from visualization pedagogy due to the lengthy time commitments associated with such studies. Recent research has addressed this challenge and developed an expedited design study framework, the Design Study ''Lite'' Methodology (DSLM), which can implement design studies with novice students within just 14 weeks. The framework was developed and evaluated based on five semesters of in-person data visualization courses with 30 students or less and was implemented in conjunction with Service-Learning (S-L).With the growth and popularity of the data visualization field-and the teaching environment created by the COVID-19 pandemic-more academic institutions are offering visualization courses online. Therefore, in this paper, we strengthen and validate the epistemological foundations of the DSLM framework by testing its (1) adaptability to online learning environments and conditions and (2) scalability to larger classes with up to 57 students. We present two online implementations of the DSLM framework, with and without Service-Learning (S-L), to test the adaptability and scalability of the framework. We further demonstrate that the framework can be applied effectively without the S-L component. We reflect on our experience with the online DSLM implementations and contribute a detailed retrospective analysis using thematic analysis and grounded theory methods to draw valuable recommendations and guidelines for future applications of the framework. This work verifies that DSLM can be used successfully in online classes to teach design study methodology. Finally, we contribute novel additions to the DSLM framework to further enhance it for teaching and learning design studies in the classroom.
  • Item
    RectEuler: Visualizing Intersecting Sets using Rectangles
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Paetzold, Patrick; Kehlbeck, Rebecca; Strobelt, Hendrik; Xue, Yumeng; Storandt, Sabine; Deussen, Oliver; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Euler diagrams are a popular technique to visualize set-typed data. However, creating diagrams using simple shapes remains a challenging problem for many complex, real-life datasets. To solve this, we propose RectEuler: a flexible, fully-automatic method using rectangles to create Euler-like diagrams. We use an efficient mixed-integer optimization scheme to place set labels and element representatives (e.g., text or images) in conjunction with rectangles describing the sets. By defining appropriate constraints, we adhere to well-formedness properties and aesthetic considerations. If a dataset cannot be created within a reasonable time or at all, we iteratively split the diagram into multiple components until a drawable solution is found. Redundant encoding of the set membership using dots and set lines improves the readability of the diagram. Our web tool lets users see how the layout changes throughout the optimization process and provides interactive explanations. For evaluation, we perform quantitative and qualitative analysis across different datasets and compare our method to state-of-the-art Euler diagram generation methods.
  • Item
    Data Stories of Water: Studying the Communicative Role of Data Visualizations within Long-form Journalism
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Garreton, Manuela; Morini, Francesca; Moyano, Daniela Paz; Grün, Gianna-Carina; Parra, Denis; Dörk, Marian; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    We present a methodology for making sense of the communicative role of data visualizations in journalistic storytelling and share findings from surveying water-related data stories. Data stories are a genre of long-form journalism that integrate text, data visualization, and other visual expressions (e.g., photographs, illustrations, videos) for the purpose of data-driven storytelling. In the last decade, a considerable number of data stories about a wide range of topics have been published worldwide. Authors use a variety of techniques to make complex phenomena comprehensible and use visualizations as communicative devices that shape the understanding of a given topic. Despite the popularity of data stories, we, as scholars, still lack a methodological framework for assessing the communicative role of visualizations in data stories. To this extent, we draw from data journalism, visual culture, and multimodality studies to propose an interpretative framework in six stages. The process begins with the analysis of content blocks and framing elements and ends with the identification of dimensions, patterns, and relationships between textual and visual elements. The framework is put to the test by analyzing 17 data stories about water-related issues. Our observations from the survey illustrate how data visualizations can shape the framing of complex topics.
  • Item
    Belief Decay or Persistence? A Mixed-method Study on Belief Movement Over Time
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Gupta, Shrey; Karduni, Alireza; Wall, Emily; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    When individuals encounter new information (data), that information is incorporated with their existing beliefs (prior) to form a new belief (posterior) in a process referred to as belief updating. While most studies on rational belief updating in visual data analysis elicit beliefs immediately after data is shown, we posit that there may be critical movement in an individual's beliefs when elicited immediately after data is shown v. after a temporal delay (e.g., due to forgetfulness or weak incorporation of the data). Our paper investigates the hypothesis that posterior beliefs elicited after a time interval will ''decay'' back towards the prior beliefs compared to the posterior beliefs elicited immediately after new data is presented. In this study, we recruit 101 participants to complete three tasks where beliefs are elicited immediately after seeing new data and again after a brief distractor task. We conduct (1) a quantitative analysis of the results to understand if there are any systematic differences in beliefs elicited immediately after seeing new data or after a distractor task and (2) a qualitative analysis of participants' reflections on the reasons for their belief update. While we find no statistically significant global trends across the participants beliefs elicited immediately v. after the delay, the qualitative analysis provides rich insight into the reasons for an individual's belief movement across 9 prototypical scenarios, which includes (i) decay of beliefs as a result of either forgetting the information shown or strongly held prior beliefs, (ii) strengthening of confidence in updated beliefs by positively integrating the new data and (iii) maintaining a consistently updated belief over time, among others. These results can guide subsequent experiments to disambiguate when and by what mechanism new data is truly incorporated into one's belief system.
  • Item
    Do Disease Stories need a Hero? Effects of Human Protagonists on a Narrative Visualization about Cerebral Small Vessel Disease
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Mittenentzwei, Sarah; Weiß, Veronika; Schreiber, Stefanie; Garrison, Laura A.; Bruckner, Stefan; Pfister, Malte; Preim, Bernhard; Meuschke, Monique; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Authors use various media formats to convey disease information to a broad audience, from articles and videos to interviews or documentaries. These media often include human characters, such as patients or treating physicians, who are involved with the disease. While artistic media, such as hand-crafted illustrations and animations are used for health communication in many cases, our goal is to focus on data-driven visualizations. Over the last decade, narrative visualization has experienced increasing prominence, employing storytelling techniques to present data in an understandable way. Similar to classic storytelling formats, narrative medical visualizations may also take a human character-centered design approach. However, the impact of this form of data communication on the user is largely unexplored. This study investigates the protagonist's influence on user experience in terms of engagement, identification, self-referencing, emotional response, perceived credibility, and time spent in the story. Our experimental setup utilizes a character-driven story structure for disease stories derived from Joseph Campbell's Hero's Journey. Using this structure, we generated three conditions for a cerebral small vessel disease story that vary by their protagonist: (1) a patient, (2) a physician, and (3) a base condition with no human protagonist. These story variants formed the basis for our hypotheses on the effect of a human protagonist in disease stories, which we evaluated in an online study with 30 participants. Our findings indicate that a human protagonist exerts various influences on the story perception and that these also vary depending on the type of protagonist.
  • Item
    Don't Peek at My Chart: Privacy-preserving Visualization for Mobile Devices
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Zhang, Songheng; Ma, Dong; Wang, Yong; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Data visualizations have been widely used on mobile devices like smartphones for various tasks (e.g., visualizing personal health and financial data), making it convenient for people to view such data anytime and anywhere. However, others nearby can also easily peek at the visualizations, resulting in personal data disclosure. In this paper, we propose a perception-driven approach to transform mobile data visualizations into privacy-preserving ones. Specifically, based on human visual perception, we develop a masking scheme to adjust the spatial frequency and luminance contrast of colored visualizations. The resulting visualization retains its original information in close proximity but reduces visibility when viewed from a certain distance or farther away. We conducted two user studies to inform the design of our approach (N=16) and systematically evaluate its performance (N=18), respectively. The results demonstrate the effectiveness of our approach in terms of privacy preservation for mobile data visualizations.
  • Item
    VisCoMET: Visually Analyzing Team Collaboration in Medical Emergency Trainings
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Liebers, Carina; Agarwal, Shivam; Krug, Maximilian; Pitsch, Karola; Beck, Fabian; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Handling emergencies requires efficient and effective collaboration of medical professionals. To analyze their performance, in an application study, we have developed VisCoMET, a visual analytics approach displaying interactions of healthcare personnel in a triage training of a mass casualty incident. The application scenario stems from social interaction research, where the collaboration of teams is studied from different perspectives. We integrate recorded annotations from multiple sources, such as recorded videos of the sessions, transcribed communication, and eye-tracking information. For each session, an informationrich timeline visualizes events across these different channels, specifically highlighting interactions between the team members. We provide algorithmic support to identify frequent event patterns and to search for user-defined event sequences. Comparing different teams, an overview visualization aggregates each training session in a visual glyph as a node, connected to similar sessions through edges. An application example shows the usage of the approach in the comparative analysis of triage training sessions, where multiple teams encountered the same scene, and highlights discovered insights. The approach was evaluated through feedback from visualization and social interaction experts. The results show that the approach supports reflecting on teams' performance by exploratory analysis of collaboration behavior while particularly enabling the comparison of triage training sessions.
  • Item
    FlexEvent: going beyond Case-Centric Exploration and Analysis of Multivariate Event Sequences
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Linden, Sanne van der; Wulterkens, Bernice M.; Gilst, Merel M. van; Overeem, Sebastiaan; Pul, Carola van; Vilanova, Anna; Elzen, Stef van den; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    In many domains, multivariate event sequence data is collected focused around an entity (the case). Typically, each event has multiple attributes, for example, in healthcare a patient has events such as hospitalization, medication, and surgery. In addition to the multivariate events, also the case (a specific attribute, e.g., patient) has associated multivariate data (e.g., age, gender, weight). Current work typically only visualizes one attribute per event (label) in the event sequences. As a consequence, events can only be explored from a predefined case-centric perspective. However, to find complex relations from multiple perspectives (e.g., from different case definitions, such as doctor), users also need an event- and attribute-centric perspective. In addition, support is needed to effortlessly switch between and within perspectives. To support such a rich exploration, we present FlexEvent: an exploration and analysis method that enables investigation beyond a fixed case-centric perspective. Based on an adaptation of existing visualization techniques, such as scatterplots and juxtaposed small multiples, we enable flexible switching between different perspectives to explore the multivariate event sequence data needed to answer multi-perspective hypotheses. We evaluated FlexEvent with three domain experts in two use cases with sleep disorder and neonatal ICU data that show our method facilitates experts in exploring and analyzing real-world multivariate sequence data from different perspectives.
  • Item
    A Comparative Evaluation of Visual Summarization Techniques for Event Sequences
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Zinat, Kazi Tasnim; Yang, Jinhua; Gandhi, Arjun; Mitra, Nistha; Liu, Zhicheng; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Real-world event sequences are often complex and heterogeneous, making it difficult to create meaningful visualizations using simple data aggregation and visual encoding techniques. Consequently, visualization researchers have developed numerous visual summarization techniques to generate concise overviews of sequential data. These techniques vary widely in terms of summary structures and contents, and currently there is a knowledge gap in understanding the effectiveness of these techniques. In this work, we present the design and results of an insight-based crowdsourcing experiment evaluating three existing visual summarization techniques: CoreFlow, SentenTree, and Sequence Synopsis. We compare the visual summaries generated by these techniques across three tasks, on six datasets, at six levels of granularity. We analyze the effects of these variables on summary quality as rated by participants and completion time of the experiment tasks. Our analysis shows that Sequence Synopsis produces the highest-quality visual summaries for all three tasks, but understanding Sequence Synopsis results also takes the longest time. We also find that the participants evaluate visual summary quality based on two aspects: content and interpretability. We discuss the implications of our findings on developing and evaluating new visual summarization techniques.
  • Item
    Ferret: Reviewing Tabular Datasets for Manipulation
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Lange, Devin; Sahai, Shaurya; Phillips, Jeff M.; Lex, Alexander; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    How do we ensure the veracity of science? The act of manipulating or fabricating scientifc data has led to many high-profle fraud cases and retractions. Detecting manipulated data, however, is a challenging and time-consuming endeavor. Automated detection methods are limited due to the diversity of data types and manipulation techniques. Furthermore, patterns automatically fagged as suspicious can have reasonable explanations. Instead, we propose a nuanced approach where experts analyze tabular datasets, e.g., as part of the peer-review process, using a guided, interactive visualization approach. In this paper, we present an analysis of how manipulated datasets are created and the artifacts these techniques generate. Based on these fndings, we propose a suite of visualization methods to surface potential irregularities. We have implemented these methods in Ferret, a visualization tool for data forensics work. Ferret makes potential data issues salient and provides guidance on spotting signs of tampering and differentiating them from truthful data.
  • Item
    Human-Computer Collaboration for Visual Analytics: an Agent-based Framework
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Monadjemi, Shayan; Guo, Mengtian; Gotz, David; Garnett, Roman; Ottley, Alvitta; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    The visual analytics community has long aimed to understand users better and assist them in their analytic endeavors. As a result, numerous conceptual models of visual analytics aim to formalize common workflows, techniques, and goals leveraged by analysts. While many of the existing approaches are rich in detail, they each are specific to a particular aspect of the visual analytic process. Furthermore, with an ever-expanding array of novel artificial intelligence techniques and advances in visual analytic settings, existing conceptual models may not provide enough expressivity to bridge the two fields. In this work, we propose an agent-based conceptual model for the visual analytic process by drawing parallels from the artificial intelligence literature. We present three examples from the visual analytics literature as case studies and examine them in detail using our framework. Our simple yet robust framework unifies the visual analytic pipeline to enable researchers and practitioners to reason about scenarios that are becoming increasingly prominent in the field, namely mixed-initiative, guided, and collaborative analysis. Furthermore, it will allow us to characterize analysts, visual analytic settings, and guidance from the lenses of human agents, environments, and artificial agents, respectively.
  • Item
    Exploring Interpersonal Relationships in Historical Voting Records
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Cantareira, Gabriel Dias; Xing, Yiwen; Cole, Nicholas; Borgo, Rita; Abdul-Rahman, Alfie; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Historical records from democratic processes and negotiation of constitutional texts are a complex type of data to navigate due to the many different elements that are constantly interacting with one another: people, timelines, different proposed documents, changes to such documents, and voting to approve or reject those changes. In particular, voting records can offer various insights about relationships between people of note in that historical context, such as alliances that can form and dissolve over time and people with unusual behavior. In this paper, we present a toolset developed to aid users in exploring relationships in voting records from a particular domain of constitutional conventions. The toolset consists of two elements: a dataset visualizer, which shows the entire timeline of a convention and allows users to investigate relationships at different moments in time via dimensionality reduction, and a person visualizer, which shows details of a given person's activity in that convention to aid in understanding the behavior observed in the dataset visualizer. We discuss our design choices and how each tool in those elements works towards our goals, and how they were perceived in an evaluation conducted with domain experts.
  • Item
    Tac-Anticipator: Visual Analytics of Anticipation Behaviors in Table Tennis Matches
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Wang, Jiachen; Wu, Yihong; Zhang, Xiaolong; Zeng, Yixin; Zhou, Zheng; Zhang, Hui; Xie, Xiao; Wu, Yingcai; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Anticipation skill is important for elite racquet sports players. Successful anticipation allows them to predict the actions of the opponent better and take early actions in matches. Existing studies of anticipation behaviors, largely based on the analysis of in-lab behaviors, failed to capture the characteristics of in-situ anticipation behaviors in real matches. This research proposes a data-driven approach for research on anticipation behaviors to gain more accurate and reliable insight into anticipation skills. Collaborating with domain experts in table tennis, we develop a complete solution that includes data collection, the development of a model to evaluate anticipation behaviors, and the design of a visual analytics system called Tac-Anticipator. Our case study reveals the strengths and weaknesses of top table tennis players' anticipation behaviors. In a word, our work enriches the research methods and guidelines for visual analytics of anticipation behaviors.
  • Item
    Teru Teru Bozu: Defensive Raincloud Plots
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Correll, Michael; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Univariate visualizations like histograms, rug plots, or box plots provide concise visual summaries of distributions. However, each individual visualization may fail to robustly distinguish important features of a distribution, or provide sufficient information for all of the relevant tasks involved in summarizing univariate data. One solution is to juxtapose or superimpose multiple univariate visualizations in the same chart, as in Allen et al.'s [APW*19] ''raincloud plots.'' In this paper I examine the design space of raincloud plots, and, through a series of simulation studies, explore designs where the component visualizations mutually ''defend'' against situations where important distribution features are missed or trivial features are given undue prominence. I suggest a class of ''defensive'' raincloud plot designs that provide good mutual coverage for surfacing distributional features of interest.
  • Item
    VENUS: A Geometrical Representation for Quantum State Visualization
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Ruan, Shaolun; Yuan, Ribo; Guan, Qiang; Lin, Yanna; Mao, Ying; Jiang, Weiwen; Wang, Zhepeng; Xu, Wei; Wang, Yong; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Visualizations have played a crucial role in helping quantum computing users explore quantum states in various quantum computing applications. Among them, Bloch Sphere is the widely-used visualization for showing quantum states, which leverages angles to represent quantum amplitudes. However, it cannot support the visualization of quantum entanglement and superposition, the two essential properties of quantum computing. To address this issue, we propose VENUS, a novel visualization for quantum state representation. By explicitly correlating 2D geometric shapes based on the math foundation of quantum computing characteristics, VENUS effectively represents quantum amplitudes of both the single qubit and two qubits for quantum entanglement. Also, we use multiple coordinated semicircles to naturally encode probability distribution, making the quantum superposition intuitive to analyze. We conducted two well-designed case studies and an in-depth expert interview to evaluate the usefulness and effectiveness of VENUS. The result shows that VENUS can effectively facilitate the exploration of quantum states for the single qubit and two qubits.
  • Item
    visMOP - A Visual Analytics Approach for Multi-omics Pathways
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Brich, Nicolas; Schacherer, Nadine; Hoene, Miriam; Weigert, Cora; Lehmann, Rainer; Krone, Michael; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    We present an approach for the visual analysis of multi-omics data obtained using high-throughput methods. The term ''omics'' denotes measurements of different types of biologically relevant molecules, like the products of gene transcription (transcriptomics) or the abundance of proteins (proteomics). Current popular visualization approaches often only support analyzing each of these omics separately. This, however, disregards the interconnectedness of different biologically relevant molecules and processes. Consequently, it describes the actual events in the organism suboptimally or only partially. Our visual analytics approach for multi-omics data provides a comprehensive overview and details-on-demand by integrating the different omics types in multiple linked views. To give an overview, we map the measurements to known biological pathways and use a combination of a clustered network visualization, glyphs, and interactive filtering. To ensure the effectiveness and utility of our approach, we designed it in close collaboration with domain experts and assessed it using an exemplary workflow with real-world transcriptomics, proteomics, and lipidomics measurements from mice.
  • Item
    GO-Compass: Visual Navigation of Multiple Lists of GO terms
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Harbig, Theresa; Paz, Mathias Witte; Nieselt, Kay; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Analysis pipelines in genomics, transcriptomics, and proteomics commonly produce lists of genes, e.g., differentially expressed genes. Often these lists overlap only partly or not at all and contain too many genes for manual comparison. However, using background knowledge, such as the functional annotations of the genes, the lists can be abstracted to functional terms. One approach is to run Gene Ontology (GO) enrichment analyses to determine over- and/or underrepresented functions for every list of genes. Due to the hierarchical structure of the Gene Ontology, lists of enriched GO terms can contain many closely related terms, rendering the lists still long, redundant, and difficult to interpret for researchers. In this paper, we present GO-Compass (Gene Ontology list comparison using Semantic Similarity), a visual analytics tool for the dispensability reduction and visual comparison of lists of GO terms. For dispensability reduction, we adapted the REVIGO algorithm, a summarization method based on the semantic similarity of GO terms, to perform hierarchical dispensability clustering on multiple lists. In an interactive dashboard, GO-Compass offers several visualizations for the comparison and improved interpretability of GO terms lists. The hierarchical dispensability clustering is visualized as a tree, where users can interactively filter out dispensable GO terms and create flat clusters by cutting the tree at a chosen dispensability. The flat clusters are visualized in animated treemaps and are compared using a correlation heatmap, UpSet plots, and bar charts. With two use cases on published datasets from different omics domains, we demonstrate the general applicability and effectiveness of our approach. In the first use case, we show how the tool can be used to compare lists of differentially expressed genes from a transcriptomics pipeline and incorporate gene information into the analysis. In the second use case using genomics data, we show how GO-Compass facilitates the analysis of many hundreds of GO terms. For qualitative evaluation of the tool, we conducted feedback sessions with five domain experts and received positive comments. GO-Compass is part of the Tue- Vis Visualization Server as a web application available at https://go-compass-tuevis.cs.uni-tuebingen.de/
  • Item
    DASS Good: Explainable Data Mining of Spatial Cohort Data
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Wentzel, Andrew; Floricel, Carla; Canahuate, Guadalupe; Naser, Mohamed A.; Mohamed, Abdallah S.; Fuller, Clifton David; Dijk, Lisanne van; Marai, G. Elisabeta; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Developing applicable clinical machine learning models is a difficult task when the data includes spatial information, for example, radiation dose distributions across adjacent organs at risk. We describe the co-design of a modeling system, DASS, to support the hybrid human-machine development and validation of predictive models for estimating long-term toxicities related to radiotherapy doses in head and neck cancer patients. Developed in collaboration with domain experts in oncology and data mining, DASS incorporates human-in-the-loop visual steering, spatial data, and explainable AI to augment domain knowledge with automatic data mining. We demonstrate DASS with the development of two practical clinical stratification models and report feedback from domain experts. Finally, we describe the design lessons learned from this collaborative experience.
  • Item
    WYTIWYR: A User Intent-Aware Framework with Multi-modal Inputs for Visualization Retrieval
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Xiao, Shishi; Hou, Yihan; Jin, Cheng; Zeng, Wei; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Retrieving charts from a large corpus is a fundamental task that can benefit numerous applications such as visualization recommendations. The retrieved results are expected to conform to both explicit visual attributes (e.g., chart type, colormap) and implicit user intents (e.g., design style, context information) that vary upon application scenarios. However, existing examplebased chart retrieval methods are built upon non-decoupled and low-level visual features that are hard to interpret, while definition-based ones are constrained to pre-defined attributes that are hard to extend. In this work, we propose a new framework, namely WYTIWYR (What-You-Think-Is-What-You-Retrieve), that integrates user intents into the chart retrieval process. The framework consists of two stages: first, the Annotation stage disentangles the visual attributes within the query chart; and second, the Retrieval stage embeds the user's intent with customized text prompt as well as bitmap query chart, to recall targeted retrieval result. We develop a prototype WYTIWYR system leveraging a contrastive language-image pre-training (CLIP) model to achieve zero-shot classification as well as multi-modal input encoding, and test the prototype on a large corpus with charts crawled from the Internet. Quantitative experiments, case studies, and qualitative interviews are conducted. The results demonstrate the usability and effectiveness of our proposed framework.
  • Item
    Unfolding Edges: Adding Context to Edges in Multivariate Graph Visualization
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Bludau, Mark-Jan; Dörk, Marian; Tominski, Christian; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Existing work on visualizing multivariate graphs is primarily concerned with representing the attributes of nodes. Even though edges are the constitutive elements of networks, there have been only few attempts to visualize attributes of edges. In this work, we focus on the critical importance of edge attributes for interpreting network visualizations and building trust in the underlying data. We propose 'unfolding of edges' as an interactive approach to integrate multivariate edge attributes dynamically into existing node-link diagrams. Unfolding edges is an in-situ approach that gradually transforms basic links into detailed representations of the associated edge attributes. This approach extends focus+context, semantic zoom, and animated transitions for network visualizations to accommodate edge details on-demand without cluttering the overall graph layout. We explore the design space for the unfolding of edges, which covers aspects of making space for the unfolding, of actually representing the edge context, and of navigating between edges. To demonstrate the utility of our approach, we present two case studies in the context of historical network analysis and computational social science. For these, web-based prototypes were implemented based on which we conducted interviews with domain experts. The experts' feedback suggests that the proposed unfolding of edges is a useful tool for exploring rich edge information of multivariate graphs.
  • Item
    Beyond Alternative Text and Tables: Comparative Analysis of Visualization Tools and Accessibility Methods
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Kim, Nam Wook; Ataguba, Grace; Joyner, Shakila Cherise; Zhao, Chuangdian; Im, Hyejin; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Modern visualization software and programming libraries have made data visualization construction easier for everyone. However, the extent of accessibility design they support for blind and low-vision people is relatively unknown. It is also unclear how they can improve chart content accessibility beyond conventional alternative text and data tables. To address these issues, we examined the current accessibility features in popular visualization tools, revealing limited support for the standard accessibility methods and scarce support for chart content exploration. Next, we investigate two promising accessibility approaches that provide off-the-shelf solutions for chart content accessibility: structured navigation and conversational interaction. We present a comparative evaluation study and discuss what to consider when incorporating them into visualization tools.
  • Item
    ParaDime: A Framework for Parametric Dimensionality Reduction
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Hinterreiter, Andreas; Humer, Christina; Kainz, Bernhard; Streit, Marc; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    ParaDime is a framework for parametric dimensionality reduction (DR). In parametric DR, neural networks are trained to embed high-dimensional data items in a low-dimensional space while minimizing an objective function. ParaDime builds on the idea that the objective functions of several modern DR techniques result from transformed inter-item relationships. It provides a common interface for specifying these relations and transformations and for defining how they are used within the losses that govern the training process. Through this interface, ParaDime unifies parametric versions of DR techniques such as metric MDS, t-SNE, and UMAP. It allows users to fully customize all aspects of the DR process.We show how this ease of customization makes ParaDime suitable for experimenting with interesting techniques such as hybrid classification/embedding models and supervised DR. This way, ParaDime opens up new possibilities for visualizing high-dimensional data.
  • Item
    Evaluating View Management for Situated Visualization in Web-based Handheld AR
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Batch, Andrea; Shin, Sungbok; Liu, Julia; Butcher, Peter W. S.; Ritsos, Panagiotis D.; Elmqvist, Niklas; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    As visualization makes the leap to mobile and situated settings, where data is increasingly integrated with the physical world using mixed reality, there is a corresponding need for effectively managing the immersed user's view of situated visualizations. In this paper we present an analysis of view management techniques for situated 3D visualizations in handheld augmented reality: a shadowbox, a world-in-miniature metaphor, and an interactive tour. We validate these view management solutions through a concrete implementation of all techniques within a situated visualization framework built using a web-based augmented reality visualization toolkit, and present results from a user study in augmented reality accessed using handheld mobile devices.
  • Item
    Illustrative Motion Smoothing for Attention Guidance in Dynamic Visualizations
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Eschner, Johannes; Mindek, Peter; Waldner, Manuela; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    3D animations are an effective method to learn about complex dynamic phenomena, such as mesoscale biological processes. The animators' goals are to convey a sense of the scene's overall complexity while, at the same time, visually guiding the user through a story of subsequent events embedded in the chaotic environment. Animators use a variety of visual emphasis techniques to guide the observers' attention through the story, such as highlighting, halos - or by manipulating motion parameters of the scene. In this paper, we investigate the effect of smoothing the motion of contextual scene elements to attract attention to focus elements of the story exhibiting high-frequency motion. We conducted a crowdsourced study with 108 participants observing short animations with two illustrative motion smoothing strategies: geometric smoothing through noise reduction of contextual motion trajectories and visual smoothing through motion blur of context items. We investigated the observers' ability to follow the story as well as the effect of the techniques on speed perception in a molecular scene. Our results show that moderate motion blur significantly improves users' ability to follow the story. Geometric motion smoothing is less effective but increases the visual appeal of the animation. However, both techniques also slow down the perceived speed of the animation. We discuss the implications of these results and derive design guidelines for animators of complex dynamic visualizations.
  • Item
    Visual Gaze Labeling for Augmented Reality Studies
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Öney, Seyda; Pathmanathan, Nelusa; Becher, Michael; Sedlmair, Michael; Weiskopf, Daniel; Kurzhals, Kuno; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Augmented Reality (AR) provides new ways for situated visualization and human-computer interaction in physical environments. Current evaluation procedures for AR applications rely primarily on questionnaires and interviews, providing qualitative means to assess usability and task solution strategies. Eye tracking extends these existing evaluation methodologies by providing indicators for visual attention to virtual and real elements in the environment. However, the analysis of viewing behavior, especially the comparison of multiple participants, is difficult to achieve in AR. Specifically, the definition of areas of interest (AOIs), which is often a prerequisite for such analysis, is cumbersome and tedious with existing approaches. To address this issue, we present a new visualization approach to define AOIs, label fixations, and investigate the resulting annotated scanpaths. Our approach utilizes automatic annotation of gaze on virtual objects and an image-based approach that also considers spatial context for the manual annotation of objects in the real world. Our results show, that with our approach, eye tracking data from AR scenes can be annotated and analyzed flexibly with respect to data aspects and annotation strategies.
  • Item
    Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real-World Environments
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Pathmanathan, Nelusa; Öney, Seyda; Becher, Michael; Sedlmair, Michael; Weiskopf, Daniel; Kurzhals, Kuno; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    The distribution of visual attention can be evaluated using eye tracking, providing valuable insights into usability issues and interaction patterns. However, when used in real, augmented, and collaborative environments, new challenges arise that go beyond desktop scenarios and purely virtual environments. Toward addressing these challenges, we present a visualization technique that provides complementary views on the movement and eye tracking data recorded from multiple people in realworld environments. Our method is based on a space-time cube visualization and a linked 3D replay of recorded data. We showcase our approach with an experiment that examines how people investigate an artwork collection. The visualization provides insights into how people moved and inspected individual pictures in their spatial context over time. In contrast to existing methods, this analysis is possible for multiple participants without extensive annotation of areas of interest. Our technique was evaluated with a think-aloud experiment to investigate analysis strategies and an interview with domain experts to examine the applicability in other research fields.
  • Item
    VISITOR: Visual Interactive State Sequence Exploration for Reinforcement Learning
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Metz, Yannick; Bykovets, Eugene; Joos, Lucas; Keim, Daniel; El-Assady, Mennatallah; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Understanding the behavior of deep reinforcement learning agents is a crucial requirement throughout their development. Existing work has addressed the identification of observable behavioral patterns in state sequences or analysis of isolated internal representations; however, the overall decision-making of deep-learning RL agents remains opaque. To tackle this, we present VISITOR, a visual analytics system enabling the analysis of entire state sequences, the diagnosis of singular predictions, and the comparison between agents. A sequence embedding view enables the multiscale analysis of state sequences, utilizing custom embedding techniques for a stable spatialization of the observations and internal states. We provide multiple layers: (1) a state space embedding, highlighting different groups of states inside the state-action sequences, (2) a trajectory view, emphasizing decision points, (3) a network activation mapping, visualizing the relationship between observations and network activations, (4) a transition embedding, enabling the analysis of state-to-state transitions. The embedding view is accompanied by an interactive reward view that captures the temporal development of metrics, which can be linked directly to states in the embedding. Lastly, a model list allows for the quick comparison of models across multiple metrics. Annotations can be exported to communicate results to different audiences. Our two-stage evaluation with eight experts confirms the effectiveness in identifying states of interest, comparing the quality of policies, and reasoning about the internal decision-making processes.
  • Item
    LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Arunkumar, Anjana; Sharma, Shubham; Agrawal, Rakhi; Chandrasekaran, Sriram; Bryan, Chris; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Cross-task generalization is a significant outcome that defines mastery in natural language understanding. Humans show a remarkable aptitude for this, and can solve many different types of tasks, given definitions in the form of textual instructions and a small set of examples. Recent work with pre-trained language models mimics this learning style: users can define and exemplify a task for the model to attempt as a series of natural language prompts or instructions. While prompting approaches have led to higher cross-task generalization compared to traditional supervised learning, analyzing 'bias' in the task instructions given to the model is a difficult problem, and has thus been relatively unexplored. For instance, are we truly modeling a task, or are we modeling a user's instructions? To help investigate this, we develop LINGO, a novel visual analytics interface that supports an effective, task-driven workflow to (1) help identify bias in natural language task instructions, (2) alter (or create) task instructions to reduce bias, and (3) evaluate pre-trained model performance on debiased task instructions. To robustly evaluate LINGO, we conduct a user study with both novice and expert instruction creators, over a dataset of 1,616 linguistic tasks and their natural language instructions, spanning 55 different languages. For both user groups, LINGO promotes the creation of more difficult tasks for pre-trained models, that contain higher linguistic diversity and lower instruction bias. We additionally discuss how the insights learned in developing and evaluating LINGO can aid in the design of future dashboards that aim to minimize the effort involved in prompt creation across multiple domains.
  • Item
    Doom or Deliciousness: Challenges and Opportunities for Visualization in the Age of Generative Models
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Schetinger, Victor; Bartolomeo, Sara Di; El-Assady, Mennatallah; McNutt, Andrew; Miller, Matthias; Passos, João Paulo Apolinário; Adams, Jane L.; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Generative text-to-image models (as exemplified by DALL-E, MidJourney, and Stable Diffusion) have recently made enormous technological leaps, demonstrating impressive results in many graphical domains-from logo design to digital painting to photographic composition. However, the quality of these results has led to existential crises in some fields of art, leading to questions about the role of human agency in the production of meaning in a graphical context. Such issues are central to visualization, and while these generative models have yet to be widely applied in visualization, it seems only a matter of time until their integration is manifest. Seeking to circumvent similar ponderous dilemmas, we attempt to understand the roles that generative models might play across visualization.We do so by constructing a framework that characterizes what these technologies offer at various stages of the visualization workflow, augmented and analyzed through semi-structured interviews with 21 experts from related domains. Through this work, we map the space of opportunities and risks that might arise in this intersection, identifying doomsday prophecies and delicious low-hanging fruits that are ripe for research.
  • Item
    Visual Analytics on Network Forgetting for Task-Incremental Learning
    (The Eurographics Association and John Wiley & Sons Ltd., 2023) Li, Ziwei; Xu, Jiayi; Chao, Wei-Lun; Shen, Han-Wei; Bujack, Roxana; Archambault, Daniel; Schreck, Tobias
    Task-incremental learning (Task-IL) aims to enable an intelligent agent to continuously accumulate knowledge from new learning tasks without catastrophically forgetting what it has learned in the past. It has drawn increasing attention in recent years, with many algorithms being proposed to mitigate neural network forgetting. However, none of the existing strategies is able to completely eliminate the issues. Moreover, explaining and fully understanding what knowledge and how it is being forgotten during the incremental learning process still remains under-explored. In this paper, we propose KnowledgeDrift, a visual analytics framework, to interpret the network forgetting with three objectives: (1) to identify when the network fails to memorize the past knowledge, (2) to visualize what information has been forgotten, and (3) to diagnose how knowledge attained in the new model interferes with the one learned in the past. Our analytical framework first identifies the occurrence of forgetting by tracking the task performance under the incremental learning process and then provides in-depth inspections of drifted information via various levels of data granularity. KnowledgeDrift allows analysts and model developers to enhance their understanding of network forgetting and compare the performance of different incremental learning algorithms. Three case studies are conducted in the paper to further provide insights and guidance for users to effectively diagnose catastrophic forgetting over time.