Automatic Evaluation of Sketch Recognizers
Loading...
Date
2009
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We present our toolkit to automatically evaluate recognition algorithms. There are few published comparative evaluations of sketch recognition algorithms and those that exist do not provide benchmarking or direct comparisons because standardised data and an evaluation platform is not available. By unifying data collection, labelling and evaluation in one tool, fair, flexible and comprehensive evaluations are possible. Currently we have 6 existing recognizers integrated into this tool. With our initial evaluations of these recognizers we have observed that the context from which training data is taken has an effect on recognition success rates. These results suggest that an evaluation platform such as this is a powerful adjunct for sketch recognition research.
Description
@inproceedings{10.2312:SBM/SBM09/085-092,
booktitle = {EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling},
editor = {Cindy Grimm and Joseph J. LaViola, Jr.},
title = {{Automatic Evaluation of Sketch Recognizers}},
author = {Schmieder, Paul and Plimmer, Beryl and Blagojevic, Rachel},
year = {2009},
publisher = {The Eurographics Association},
ISSN = {1812-3503},
ISBN = {978-3-905674-19-4},
DOI = {10.2312/SBM/SBM09/085-092}
}