3D Reconstruction for Tele-Immersion in 360° Live Stream

No Thumbnail Available
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Nowadays, most volumetric tele-immersion systems are based on a multi-camera system to capture a dynamic 3D place. With these acquisition devices, the development of a mobile tele-immersion system seems compromised, as a lot of equipment would have to be moved. One promising way to achieve a mobile system would be to use a single 360° camera and develop ways of reconstructing in 3D a dynamic scene in real time from a single point of view. Therefore, we propose an approach to freely navigate into a 360° video captured with a static camera. The approach considers three types of elements in the scene, the environment, the object of interest and the people, and relies on a different 3D representation for each type of element. Distinguishing the scene elements enables a real-time method to be adopted, by reconstructing static elements once and using fast-computable 3D representations for dynamic elements. As the method is real-time, we develop a streaming pipeline to enable XR users to move live within the camera stream.
Description

CCS Concepts: Computing methodologies → Virtual reality; Reconstruction

        
@inproceedings{
10.2312:egve.20231325
, booktitle = {
ICAT-EGVE 2023 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
}, editor = {
Jean-Marie Normand
and
Maki Sugimoto
and
Veronica Sundstedt
}, title = {{
3D Reconstruction for Tele-Immersion in 360° Live Stream
}}, author = {
Dluzniewski, Clément
and
Chekirou, Hakim
and
Garrec, Jérémie Le
and
Andriot, Claude
and
Noël, Frédéric
}, year = {
2023
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-530X
}, ISBN = {
978-3-03868-218-9
}, DOI = {
10.2312/egve.20231325
} }
Citation
Collections