Coherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ Videos

dc.contributor.authorRichardt, Christianen_US
dc.contributor.authorStoll, Carstenen_US
dc.contributor.authorDodgson, Neil A.en_US
dc.contributor.authorSeidel, Hans-Peteren_US
dc.contributor.authorTheobalt, Christianen_US
dc.contributor.editorP. Cignoni and T. Ertlen_US
dc.date.accessioned2015-02-28T06:51:18Z
dc.date.available2015-02-28T06:51:18Z
dc.date.issued2012en_US
dc.description.abstractSophisticated video processing effects require both image and geometry information. We explore the possibility to augment a video camera with a recent infrared time-of-flight depth camera, to capture high-resolution RGB and low-resolution, noisy depth at video frame rates. To turn such a setup into a practical RGBZ video camera, we develop efficient data filtering techniques that are tailored to the noise characteristics of IR depth cameras. We first remove typical artefacts in the RGBZ data and then apply an efficient spatiotemporal denoising and upsampling scheme. This allows us to record temporally coherent RGBZ videos at interactive frame rates and to use them to render a variety of effects in unprecedented quality. We show effects such as video relighting, geometry-based abstraction and stylisation, background segmentation and rendering in stereoscopic 3D.en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume31
dc.identifier.doi10.1111/j.1467-8659.2012.03003.x
dc.identifier.issn1467-8659en_US
dc.identifier.urihttps://doi.org/10.1111/j.1467-8659.2012.03003.xen_US
dc.publisherThe Eurographics Association and John Wiley and Sons Ltd.en_US
dc.titleCoherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ Videosen_US
Files