Learning a Style Space for Interactive Line Drawing Synthesis from Animated 3D Models

dc.contributor.authorWang, Zeyuen_US
dc.contributor.authorWang, Tuanfeng Y.en_US
dc.contributor.authorDorsey, Julieen_US
dc.contributor.editorYang, Yinen_US
dc.contributor.editorParakkat, Amal D.en_US
dc.contributor.editorDeng, Bailinen_US
dc.contributor.editorNoh, Seung-Taken_US
dc.date.accessioned2022-10-04T06:37:52Z
dc.date.available2022-10-04T06:37:52Z
dc.date.issued2022
dc.description.abstractMost non-photorealistic rendering (NPR) methods for line drawing synthesis operate on a static shape. They are not tailored to process animated 3D models due to extensive per-frame parameter tuning needed to achieve the intended look and natural transition. This paper introduces a framework for interactive line drawing synthesis from animated 3D models based on a learned style space for drawing representation and interpolation. We refer to style as the relationship between stroke placement in a line drawing and its corresponding geometric properties. Starting from a given sequence of an animated 3D character, a user creates drawings for a set of keyframes. Our system embeds the raster drawings into a latent style space after they are disentangled from the underlying geometry. By traversing the latent space, our system enables a smooth transition between the input keyframes. The user may also edit, add, or remove the keyframes interactively, similar to a typical keyframe-based workflow. We implement our system with deep neural networks trained on synthetic line drawings produced by a combination of NPR methods. Our drawing-specific supervision and optimization-based embedding mechanism allow generalization from NPR line drawings to user-created drawings during run time. Experiments show that our approach generates high-quality line drawing animations while allowing interactive control of the drawing style across frames.en_US
dc.description.sectionheadersSketch and Modeling
dc.description.seriesinformationPacific Graphics Short Papers, Posters, and Work-in-Progress Papers
dc.identifier.doi10.2312/pg.20221237
dc.identifier.isbn978-3-03868-190-8
dc.identifier.pages1-6
dc.identifier.pages6 pages
dc.identifier.urihttps://doi.org/10.2312/pg.20221237
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/pg20221237
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Non-photorealistic rendering; Animation; Learning latent representations
dc.subjectComputing methodologies → Non photorealistic rendering
dc.subjectAnimation
dc.subjectLearning latent representations
dc.titleLearning a Style Space for Interactive Line Drawing Synthesis from Animated 3D Modelsen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
001-006.pdf
Size:
2.7 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
paper1056_supp.pdf
Size:
6.73 MB
Format:
Adobe Portable Document Format