EuroVisShort2017

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/2631438

Browse

Browsing EuroVisShort2017 by Subject "Evaluation/methodology"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    ETK: An Evaluation Toolkit for Visualization User Studies
    (The Eurographics Association, 2017) Turton, Terece L.; Berres, Anne S.; Rogers, David H.; Ahrens, James; Barbora Kozlikova and Tobias Schreck and Thomas Wischgoll
    This paper describes the design and features of the Evaluation Toolkit (ETK), a set of JavaScript/HTML/CSS modules leveraging the Qualtrics JavaScript API that can be used to automate image-based perceptual user evaluation studies. Automating the presentation of the images can greatly decrease the time to build and implement an evaluation study while minimizing the length and complexity of a study built within Qualtrics, along with decreasing the possibility of error in image presentation. The ETK modules each focus on automating a specific psychophysical or experimental approach. Because each module is an extension or plug-in to a Qualtrics question, the resultant study can be easily used in a laboratory setting or in a crowdsourced approach. We present the open source repository of ETK with the six modules that currently make up the toolkit and invite the community to explore, utilize, and contribute to the toolkit.
  • Thumbnail Image
    Item
    Reflections on an Experiment, Evaluating the Impact of Spatialisation on Exploration
    (The Eurographics Association, 2017) Roux, Clement; McAuley, John; Barbora Kozlikova and Tobias Schreck and Thomas Wischgoll
    This paper reports on an experiment designed to evaluate whether visualising a digital library (using a spatialisation technique) can influence exploratory search behaviour. In the experiment we asked participants to complete a set of novel tasks using one of two interfaces - a visualisation interface, ExploViz, and its search-based equivalent, LibSearch. A set of measures were used to capture sensemaking and exploratory behaviour and to analyse cognitive load. As results were non-significant, we reflect upon the design of the experiment, consider possible issues and suggest how these could be addressed in future iterations.