3D Reconstruction for Tele-Immersion in 360° Live Stream
No Thumbnail Available
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Nowadays, most volumetric tele-immersion systems are based on a multi-camera system to capture a dynamic 3D place. With these acquisition devices, the development of a mobile tele-immersion system seems compromised, as a lot of equipment would have to be moved. One promising way to achieve a mobile system would be to use a single 360° camera and develop ways of reconstructing in 3D a dynamic scene in real time from a single point of view. Therefore, we propose an approach to freely navigate into a 360° video captured with a static camera. The approach considers three types of elements in the scene, the environment, the object of interest and the people, and relies on a different 3D representation for each type of element. Distinguishing the scene elements enables a real-time method to be adopted, by reconstructing static elements once and using fast-computable 3D representations for dynamic elements. As the method is real-time, we develop a streaming pipeline to enable XR users to move live within the camera stream.
Description
CCS Concepts: Computing methodologies → Virtual reality; Reconstruction
@inproceedings{10.2312:egve.20231325,
booktitle = {ICAT-EGVE 2023 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments},
editor = {Jean-Marie Normand and Maki Sugimoto and Veronica Sundstedt},
title = {{3D Reconstruction for Tele-Immersion in 360° Live Stream}},
author = {Dluzniewski, Clément and Chekirou, Hakim and Garrec, Jérémie Le and Andriot, Claude and Noël, Frédéric},
year = {2023},
publisher = {The Eurographics Association},
ISSN = {1727-530X},
ISBN = {978-3-03868-218-9},
DOI = {10.2312/egve.20231325}
}