RETRIEVAL 3D: An On-line Content-Based Retrieval Performance Evaluation Tool
Loading...
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Performance benchmarking is an absolute necessity when attempting to objectively quantify the performance of content-based retrieval methods. For many years now, a number of plot-based and scalar-based measures in combination with benchmark datasets have already been used in order to provide objective results. In this work, we present the first version of an integrated on-line content-based retrieval evaluation tool, named RETRIEVAL 3D, which can be used in order to quantify the performance of a retrieval method. The current version of the system offers a set of popular performance measures that can be accessed through a dynamic visualisation environment. The user is able to upload retrieval results using different input data structures (e.g. binary ranked lists, floating point ranked lists, dissimilarity matrices and groundtruth data) that are already encountered in the literature including the SHREC competition series. Moreover, the system is able to provide evaluation mechanisms for known within the retrieval research community benchmark datasets. It offers performance measures parameterisation that enables the user to determine specific aspects of the evaluated retrieval method. Performance reports archiving and downloading are some of the system's user-oriented functionalities.
Description
@inproceedings{10.2312:3dor.20151062,
booktitle = {Eurographics Workshop on 3D Object Retrieval},
editor = {I. Pratikakis and M. Spagnuolo and T. Theoharis and L. Van Gool and R. Veltkamp},
title = {{RETRIEVAL 3D: An On-line Content-Based Retrieval Performance Evaluation Tool}},
author = {Koutsoudis, Anestis and Ioannakis, George and Pratikakis, Ioannis and Chamzas, Christos},
year = {2015},
publisher = {The Eurographics Association},
ISBN = {},
DOI = {10.2312/3dor.20151062}
}