ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data

Loading...
Thumbnail Image
Date
2020
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
This work introduces a novel strategy for generating synthetic training data for 2D and 3D pose estimation of animals using keyframe animations. With the objective to automate the process of creating animations for wildlife, we train several 2D and 3D pose estimation models with synthetic data, and put in place an end-to-end pipeline called ZooBuilder. The pipeline takes as input a video of an animal in the wild, and generates the corresponding 2D and 3D coordinates for each joint of the animal's skeleton. With this approach, we produce motion capture data that can be used to create animations for wildlife.
Description

        
@inproceedings{
10.2312:sca.20201217
, booktitle = {
Eurographics/ ACM SIGGRAPH Symposium on Computer Animation - Showcases
}, editor = {
Holden, Daniel
}, title = {{
ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data
}}, author = {
Fangbemi, Abassin Sourou
and
Lu, Yi Fei
and
Xu, Maoyuan
and
Luo, Xiaowu
and
Rolland, Alexis
and
Raissi, Chedy
}, year = {
2020
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-5288
}, ISBN = {
978-3-03868-129-8
}, DOI = {
10.2312/sca.20201217
} }
Citation