Real-Time Music-Driven Movie Design Framework
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Cutting to music is a widely used stylistic device in film making. The usual process involves an editor manually adjusting the movie's sequences contingent upon beat or other musical features. But with today's movie productions starting to leverage real-time systems, manual effort can be reduced. Automatic cameras can make decisions on their own according to pre-defined rules, even in real time. In this paper, we present an approach to automatically create a music video. We have realised its implementation as a coding framework integrating with the fmod api and Unreal Engine 4. The framework provides the means to analyze a music stream at runtime and to translate the extracted features into an animation story line, supported by cinematic cutting. We demonstrate its workings by means of an instance of an artistic, music-driven movie.
Description
CCS Concepts: Computer systems organization --> Real-time operating systems; Applied computing --> Sound and music computing; Media arts
@inproceedings{10.2312:wiced.20221052,
booktitle = {Workshop on Intelligent Cinematography and Editing},
editor = {Ronfard, Rémi and Wu, Hui-Yin},
title = {{Real-Time Music-Driven Movie Design Framework}},
author = {Hofmann, Sarah and Seeger, Maximilian and Rogge-Pott, Henning and Mammen, Sebastian von},
year = {2022},
publisher = {The Eurographics Association},
ISSN = {2411-9733},
ISBN = {978-3-03868-173-1},
DOI = {10.2312/wiced.20221052}
}