FoReCast: Real-time Foveated Rendering and Unicasting for Immersive Remote Telepresence

Simple item page
dc.contributor.authorTefera, Yonas T.en_US
dc.contributor.authorMazzanti, Darioen_US
dc.contributor.authorAnastasi, Saraen_US
dc.contributor.authorCaldwell, Darwin G.en_US
dc.contributor.authorFiorini, Paoloen_US
dc.contributor.authorDeshpande, Nikhilen_US
dc.contributor.editorHideaki Uchiyamaen_US
dc.contributor.editorJean-Marie Normanden_US
dc.date.accessioned2022-11-29T07:25:27Z
dc.date.available2022-11-29T07:25:27Z
dc.date.issued2022
dc.description.abstractRapidly growing modern virtual reality (VR) interfaces are increasingly used as visualization and interaction media in 3D telepresence systems. Remote environments scanned using RGB-D cameras and represented as dense point-clouds are being used to visualize remote environments in VR in real-time to increase the user's immersion. To this end, such interfaces require high quality, low latency, and high throughput transmission. In other words, the entire system pipeline from data acquisition to its visualization in VR has to be optimized for high performance. Point-cloud data particularly suffers from network latency and throughput limitations that negatively impact user experience in telepresence. The human visual system provides an insight into approaching these challenges. Human eyes have their sharpest visual acuity at the center of their field-of-view, and this falls off towards the periphery. This visual acuity fall-off was taken as an inspiration to design a novel immersive 3D data visualization framework to facilitate the processing, transmission, and visualization in VR of dense point-clouds. The proposed FoReCast framework, shows significant reductions in latency and throughput, higher than 60% in both. A preliminary user study shows that the framework does not significantly affect the user quality of experience in immersive remote telepresence.en_US
dc.description.sectionheadersHaptics and Remote
dc.description.seriesinformationICAT-EGVE 2022 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
dc.identifier.doi10.2312/egve.20221278
dc.identifier.isbn978-3-03868-179-3
dc.identifier.issn1727-530X
dc.identifier.pages75-84
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.2312/egve.20221278
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/egve20221278
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Human-centered computing -> Visualization design and evaluation methods; Mixed / augmented reality
dc.subjectHuman centered computing
dc.subjectVisualization design and evaluation methods
dc.subjectMixed / augmented reality
dc.titleFoReCast: Real-time Foveated Rendering and Unicasting for Immersive Remote Telepresenceen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
075-084.pdf
Size:
10.82 MB
Format:
Adobe Portable Document Format
Download
Collections
ICAT-EGVE2022