Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

dc.contributor.authorNi, Lixiaen_US
dc.contributor.authorJiang, Haiyongen_US
dc.contributor.authorCai, Jianfeien_US
dc.contributor.authorZheng, Jianminen_US
dc.contributor.authorLi, Haifengen_US
dc.contributor.authorLiu, Xuen_US
dc.contributor.editorLee, Jehee and Theobalt, Christian and Wetzstein, Gordonen_US
dc.date.accessioned2019-10-14T05:08:34Z
dc.date.available2019-10-14T05:08:34Z
dc.date.issued2019
dc.description.abstractLight field (LF) reconstruction is a fundamental technique in light field imaging and has applications in both software and hardware aspects. This paper presents an unsupervised learning method for LF-oriented view synthesis, which provides a simple solution for generating quality light fields from a sparse set of views. The method is built on disparity estimation and image warping. Specifically, we first use per-view disparity as a geometry proxy to warp input views to novel views. Then we compensate the occlusion with a network by a forward-backward warping process. Cycle-consistency between different views are explored to enable unsupervised learning and accurate synthesis. The method overcomes the drawbacks of fully supervised learning methods that require large labeled training dataset and epipolar plane image based interpolation methods that do not make full use of geometry consistency in LFs. Experimental results demonstrate that the proposed method can generate high quality views for LF, which outperforms unsupervised approaches and is comparable to fully-supervised approaches.en_US
dc.description.number7
dc.description.sectionheadersRendering and Sampling
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume38
dc.identifier.doi10.1111/cgf.13849
dc.identifier.issn1467-8659
dc.identifier.pages425-436
dc.identifier.urihttps://doi.org/10.1111/cgf.13849
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13849
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectComputing methodologies
dc.subjectImage processing and computer vision
dc.subjectReconstruction
dc.titleUnsupervised Dense Light Field Reconstruction with Occlusion Awarenessen_US
Files
Collections