Consistent Video Filtering for Camera Arrays

dc.contributor.authorBonneel, Nicolasen_US
dc.contributor.authorTompkin, Jamesen_US
dc.contributor.authorSun, Deqingen_US
dc.contributor.authorWang, Oliveren_US
dc.contributor.authorSunkavalli, Kalyanen_US
dc.contributor.authorParis, Sylvainen_US
dc.contributor.authorPfister, Hanspeteren_US
dc.contributor.editorLoic Barthe and Bedrich Benesen_US
dc.date.accessioned2017-04-22T16:27:07Z
dc.date.available2017-04-22T16:27:07Z
dc.date.issued2017
dc.description.abstractVisual formats have advanced beyond single-view images and videos: 3D movies are commonplace, researchers have developed multi-view navigation systems, and VR is helping to push light field cameras to mass market. However, editing tools for these media are still nascent, and even simple filtering operations like color correction or stylization are problematic: naively applying image filters per frame or per view rarely produces satisfying results due to time and space inconsistencies. Our method preserves and stabilizes filter effects while being agnostic to the inner working of the filter. It captures filter effects in the gradient domain, then uses input frame gradients as a reference to impose temporal and spatial consistency. Our least-squares formulation adds minimal overhead compared to naive data processing. Further, when filter cost is high, we introduce a filter transfer strategy that reduces the number of per-frame filtering computations by an order of magnitude, with only a small reduction in visual quality. We demonstrate our algorithm on several camera array formats including stereo videos, light fields, and wide baselines.en_US
dc.description.number2
dc.description.sectionheadersCamera: Depth to Motion, Lens and Filters
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume36
dc.identifier.doi10.1111/cgf.13135
dc.identifier.issn1467-8659
dc.identifier.pages397-407
dc.identifier.urihttps://doi.org/10.1111/cgf.13135
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13135
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.4.3 [Computer Graphics]
dc.subjectEnhancement
dc.subjectFiltering
dc.subjectI.2.10 [Computer Graphics]
dc.subjectVision and Scene Understanding
dc.subjectVideo analysis
dc.titleConsistent Video Filtering for Camera Arraysen_US
Files
Collections