Deep‐Learning‐Based Facial Retargeting Using Local Patches

Simple item page
dc.contributor.authorChoi, Yeonsooen_US
dc.contributor.authorLee, Inyupen_US
dc.contributor.authorCha, Sihunen_US
dc.contributor.authorKim, Seonghyeonen_US
dc.contributor.authorJung, Sunjinen_US
dc.contributor.authorNoh, Junyongen_US
dc.date.accessioned2025-03-07T16:48:31Z
dc.date.available2025-03-07T16:48:31Z
dc.date.issued2024
dc.description.abstractIn the era of digital animation, the quest to produce lifelike facial animations for virtual characters has led to the development of various retargeting methods. While the retargeting facial motion between models of similar shapes has been very successful, challenges arise when the retargeting is performed on stylized or exaggerated 3D characters that deviate significantly from human facial structures. In this scenario, it is important to consider the target character's facial structure and possible range of motion to preserve the semantics assumed by the original facial motions after the retargeting. To achieve this, we propose a local patch‐based retargeting method that transfers facial animations captured in a source performance video to a target stylized 3D character. Our method consists of three modules. The Automatic Patch Extraction Module extracts local patches from the source video frame. These patches are processed through the Reenactment Module to generate correspondingly re‐enacted target local patches. The Weight Estimation Module calculates the animation parameters for the target character at every frame for the creation of a complete facial animation sequence. Extensive experiments demonstrate that our method can successfully transfer the semantic meaning of source facial expressions to stylized characters with considerable variations in facial feature proportion.en_US
dc.description.number1
dc.description.sectionheadersOriginal Article
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.15263
dc.identifier.issn1467-8659
dc.identifier.pages15
dc.identifier.urihttps://doi.org/10.1111/cgf.15263
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15263
dc.publisherEurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectanimation
dc.subjectfacial animation
dc.subjectmotion capture
dc.subjectmotion transfer
dc.subjectimage and video processing
dc.subject• Computing methodologies → Animation; Motion capture; Motion processing
dc.titleDeep‐Learning‐Based Facial Retargeting Using Local Patchesen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
07_cgf15263.pdf
Size:
5.06 MB
Format:
Adobe Portable Document Format
Download
Collections
44-Issue 1