Video Shot Analysis for Digital Curation and Preservation of Historical Films

dc.contributor.authorHelm, Danielen_US
dc.contributor.authorkampel, martinen_US
dc.contributor.editorRizvic, Selma and Rodriguez Echavarria, Karinaen_US
dc.date.accessioned2019-11-06T06:02:16Z
dc.date.available2019-11-06T06:02:16Z
dc.date.issued2019
dc.description.abstractIn automatic video analysis and film preservation, Shot Boundary Detection (SBD) and Shot Type Classification (STC) are fundamental pre-processing steps. While previous research focuses on detecting and classifying shots in different video genres such as sports movies, documentaries or news clips only few studies investigate on SBD and STC in historical footage. In order to promote research on automatic video analysis the project Visual History of the Holocaust (VHH) has been started in January 2019. The main aim of this paper is to present first results on the fundamental topics SBD and STC in the context of the project VHH. Therefore, a deep learning-based SBD approach is implemented to detect Abrupt Transitions (ATs). Furthermore, a CNN-based algorithm is analyzed and optimized in order to classify shots into the four categories: Extreme-Long-Shot (ELS), Long-Shot (LS), Medium-Shot (MS) and Close-Up (CU). Finally, both algorithms are evaluated on a self-generated historical dataset related to the National Socialism and the Holocaust. The outcome of this paper demonstrates a first quantitative evaluation of the SBD approach and displays a F1;Score of 0.866 without the need of any re-training or optimization. Moreover, the proposed STC algorithm reaches an accuracy of 0.71 on classifying shots. This paper contributes a significant base for future research on automatic shot analysis related to the project VHH.en_US
dc.description.sectionheadersDigitisation and Digital Curation
dc.description.seriesinformationEurographics Workshop on Graphics and Cultural Heritage
dc.identifier.doi10.2312/gch.20191344
dc.identifier.isbn978-3-03868-082-6
dc.identifier.issn2312-6124
dc.identifier.pages25-28
dc.identifier.urihttps://doi.org/10.2312/gch.20191344
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/gch20191344
dc.publisherThe Eurographics Associationen_US
dc.subjectInformation systems
dc.subjectVideo search
dc.subjectComputing methodologies
dc.subjectSupervised learning by classification
dc.subjectTransfer learning
dc.titleVideo Shot Analysis for Digital Curation and Preservation of Historical Filmsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
025-028.pdf
Size:
437.44 KB
Format:
Adobe Portable Document Format