Neural Proxy: Empowering Neural Volume Rendering for Animation

Sin, Zackary P. T.; Ng, Peter H. F.; Leong, Hong Va

Neural Proxy: Empowering Neural Volume Rendering for Animation

Files

031-036.pdf (2.41 MB)

neural_proxy-multimedia_appendix.zip (2.62 MB)

Date

2021

Authors

Sin, Zackary P. T.
Ng, Peter H. F.
Leong, Hong Va

Publisher

The Eurographics Association

Abstract

Achieving photo-realistic result is an enticing proposition for the computer graphics community. Great progress has been achieved in the past decades, but the cost of human expertise has also grown. Neural rendering is a promising candidate for reducing this cost as it relies on data to construct the scene representation. However, one key component for adapting neural rendering for practical use is currently missing: animation. There seems to be a lack of discussion on how to enable neural rendering works for synthesizing frames for unseen animations. To fill this research gap, we propose neural proxy, a novel neural rendering model that utilizes animatable proxies for representing photo-realistic targets. Via a tactful combination of components from neural volume rendering and neural texture, our model is able to render unseen animations without any temporal learning. Experiment results show that the proposed model significantly outperforms current neural rendering works.

        @inproceedings{10.2312:pg.20211384
,
booktitle = {Pacific Graphics Short Papers, Posters, and Work-in-Progress Papers
},
editor = {Lee, Sung-Hee and Zollmann, Stefanie and Okabe, Makoto and Wünsche, Burkhard
},
title = {{Neural Proxy: Empowering Neural Volume Rendering for Animation
}},
author = {Sin, Zackary P. T. and 
Ng, Peter H. F. and 
Leong, Hong Va
},
year = {2021
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-162-5
},
DOI = {10.2312/pg.20211384
}
}