Video-Driven Animation of Neural Head Avatars
| dc.contributor.author | Paier, Wolfgang | en_US |
| dc.contributor.author | Hinzer, Paul | en_US |
| dc.contributor.author | Hilsmann, Anna | en_US |
| dc.contributor.author | Eisert, Peter | en_US |
| dc.contributor.editor | Guthe, Michael | en_US |
| dc.contributor.editor | Grosch, Thorsten | en_US |
| dc.date.accessioned | 2023-09-25T11:38:50Z | |
| dc.date.available | 2023-09-25T11:38:50Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | We present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input. Typically, high-quality generative models are learned for specific individuals from multi-view video footage, resulting in person-specific latent representations that drive the generation process. In order to achieve person-independent animation from video input, we introduce an LSTM-based animation network capable of translating person-independent expression features into personalized animation parameters of person-specific 3D head models. Our approach combines the advantages of personalized head models (high quality and realism) with the convenience of video-driven animation employing multi-person facial performance capture.We demonstrate the effectiveness of our approach on synthesized animations with high quality based on different source videos as well as an ablation study. | en_US |
| dc.description.sectionheaders | Image Processing | |
| dc.description.seriesinformation | Vision, Modeling, and Visualization | |
| dc.identifier.doi | 10.2312/vmv.20231237 | |
| dc.identifier.isbn | 978-3-03868-232-5 | |
| dc.identifier.pages | 149-156 | |
| dc.identifier.pages | 8 pages | |
| dc.identifier.uri | https://doi.org/10.2312/vmv.20231237 | |
| dc.identifier.uri | https://diglib.eg.org:443/handle/10.2312/vmv20231237 | |
| dc.publisher | The Eurographics Association | en_US |
| dc.rights | Attribution 4.0 International License | |
| dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | |
| dc.subject | CCS Concepts: Computing methodologies -> Machine learning; Computer graphics; Animation; Rendering | |
| dc.subject | Computing methodologies | |
| dc.subject | Machine learning | |
| dc.subject | Computer graphics | |
| dc.subject | Animation | |
| dc.subject | Rendering | |
| dc.title | Video-Driven Animation of Neural Head Avatars | en_US |