A Deep Learned Method for Video Indexing and Retrieval
Loading...
Date
2018
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
In this paper, we proposed a deep neural network based method for content based video retrieval. Our approach leveraged the deep neural network to generate the semantic information and introduced the graph-based storage structure to establish the video indices. We devised the Inception-Single Shot Multibox Detector (ISSD) and RI3D model to extract spatial semantic information (objects) and extract temporal semantic information (actions). Our ISSD model achieved a mAP of 26.7% on MS COCO dataset, increasing 3.2% over the original SSD model, while the RI3D model achieved a top-1 accuracy of 97.7% on dataset UCF-101. And we also introduced the graph structure to build the video index with the temporal and spatial semantic information. Our experiment results showed that the deep learned semantic information is highly effective for video indexing and retrieval.
Description
@inproceedings{10.2312:pg.20181287,
booktitle = {Pacific Graphics Short Papers},
editor = {Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes},
title = {{A Deep Learned Method for Video Indexing and Retrieval}},
author = {Men, Xin and Zhou, Feng and Li, Xiaoyong},
year = {2018},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-073-4},
DOI = {10.2312/pg.20181287}
}