Building a Gold Standard for Perceptual Sketch Similarity

Thumbnail Image
Date
2016
Authors
Cakmak, S.
Sezgin, T. M.
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Similarity is among the most basic concepts studied in psychology. Yet, there is no unique way of assessing similarity of two objects. In the sketch recognition domain, many tasks such as classification, detection or clustering require measuring the level of similarity between sketches. In this paper, we propose a carefully designed experiment setup to construct a gold standard for measuring the similarity of sketches. Our setup is based on table scaling, and allows efficient construction of a measure of similarity for large datasets containing hundreds of sketches in reasonable time scales. We report the results of an experiment involving a total of 9 unique assessors, and 8 groups of sketches, each containing 300 drawings. The results show high interrater agreement between the assessors, which makes the constructed gold standard trustworthy.
Description

        
@inproceedings{
10.2312:exp.20161256
,
booktitle = {
Expressive 2016 - Posters, Artworks, and Bridging Papers
},
editor = {
Ergun Akleman, Lyn Bartram, Anıl Çamcı, Angus Forbes, Penousal Machado
},
title = {{
Building a Gold Standard for Perceptual Sketch Similarity
}},
author = {
Cakmak, S.
 and 
Sezgin, T. M.
},
year = {
2016
},
publisher = {
The Eurographics Association
},
ISBN = {
978-3-03868-021-5
},
DOI = {
10.2312/exp.20161256
}
}
Citation
URI
https://doi.org/10.2312/exp.20161256
 https://diglib.eg.org:443/handle/10.2312/exp20161256
Collections
Expressive 2016 - Posters, Artworks, and Bridging Papers