High-resolution 360 Video Foveated Stitching for Real-time VR

dc.contributor.authorLee, Wei-Tseen_US
dc.contributor.authorChen, Hsin-Ien_US
dc.contributor.authorChen, Ming-Shiuanen_US
dc.contributor.authorShen, I-Chaoen_US
dc.contributor.authorChen, Bing-Yuen_US
dc.contributor.editorJernej Barbic and Wen-Chieh Lin and Olga Sorkine-Hornungen_US
dc.date.accessioned2017-10-16T05:24:09Z
dc.date.available2017-10-16T05:24:09Z
dc.date.issued2016
dc.description.abstractIn virtual reality (VR) applications, the contents are usually generated by creating a 360 video panorama of a real-world scene. Although many capture devices are being released, getting high-resolution panoramas and displaying a virtual world in realtime remains challenging due to its computationally demanding nature. In this paper, we propose a real-time 360 video foveated stitching framework, that renders the entire scene in different level of detail, aiming to create a high-resolution panoramic video in real-time that can be streamed directly to the client. Our foveated stitching algorithm takes videos from multiple cameras as input, combined with measurements of human visual attention (i.e. the acuity map and the saliency map), can greatly reduce the number of pixels to be processed. We further parallelize the algorithm using GPU to achieve a responsive interface and validate our results via a user study. Our system accelerates graphics computation by a factor of 6 on a Google Cardboard display.en_US
dc.description.number7
dc.description.sectionheadersVideo and Visualization
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume36
dc.identifier.doi10.1111/cgf.13277
dc.identifier.issn1467-8659
dc.identifier.pages115-123
dc.identifier.urihttps://doi.org/10.1111/cgf.13277
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13277
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.3.3 [Computer Graphics]
dc.subjectPicture/Image Generation
dc.subjectLine and curve generation
dc.titleHigh-resolution 360 Video Foveated Stitching for Real-time VRen_US
Files
Collections