Building and Animating User-Specific Volumetric Face Rigs

Ichim, Alexandru-Eugen; Kavan, Ladislav; Nimier-David, Merlin; Pauly, Mark

Building and Animating User-Specific Volumetric Face Rigs

Files

107-117.pdf (2.78 MB)

sca_video_with_names.mp4 (193.77 MB)

Date

2016

Authors

Ichim, Alexandru-Eugen
Kavan, Ladislav
Nimier-David, Merlin
Pauly, Mark

Publisher

The Eurographics Association

Abstract

Currently, the two main approaches to realistic facial animation are 1) blendshape models and 2) physics-based simulation. Blendshapes are fast and directly controllable, but it is not easy to incorporate features such as dynamics, collision resolution, or incompressibility of the flesh. Physics-based methods can deliver these effects automatically, but modeling of muscles, bones, and other anatomical features of the face is difficult, and direct control over the resulting shape is lost. We propose a method that combines the benefits of blendshapes with the advantages of physics-based simulation. We acquire 3D scans of a given actor with various facial expressions and compute a set of volumetric blendshapes that are compatible with physics-based simulation, while accurately matching the input scans. Furthermore, our volumetric blendshapes are driven by the same weights as traditional blendshapes, which many users are familiar with. Our final facial rig is capable of delivering physics-based effects such as dynamics and secondary motion, collision response, and volume preservation without the burden of detailed anatomical modeling.

        @inproceedings{10.2312:sca.20161228
,
booktitle = {Eurographics/ ACM SIGGRAPH Symposium on Computer Animation
},
editor = {Ladislav Kavan and Chris Wojtan
},
title = {{Building and Animating User-Specific Volumetric Face Rigs
}},
author = {Ichim, Alexandru-Eugen and 
Kavan, Ladislav and 
Nimier-David, Merlin and 
Pauly, Mark
},
year = {2016
},
publisher = {The Eurographics Association
},
ISSN = {1727-5288
},
ISBN = {978-3-03868-009-3
},
DOI = {10.2312/sca.20161228
}
}