Incremental Reconstruction Approach for Telepresence or AR Applications
No Thumbnail Available
Files
Date
2020
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
This paper proposes an on-line incremental 3D reconstruction framework aimed at fulfilling the needs of telepresence or human machine interaction applications. The research presents a teleconference system that improves and induces the feeling that persons are in the presence of each other. A free viewpoint method, based on realistic user's appearances, is proposed to simulate a real face-to-face meeting. The contributions are: a new incremental version of Crust algorithm that enables incremental fusion of sensor data and a confidence-based method that automatically decides whether or not to integrate newly acquired data in the existing model based on measure uncertainty and novelty. To avoid the classical stereo vision reconstruction problems, the method bases on hybrid sensors to acquire simultaneous depth information and the corresponding texture image (e.g. kinect). This enables the alignment between acquired data and pre-adquired model by maximizing a criterion that is related with the matching between visual features and between acquired shapes. A mesh based representation enables the use of the surface topological geometric information during the data model integration process
Description
@inproceedings{10.2312:pt.20151202,
booktitle = {22o Encontro Português de Computação Gráfica e Interação 2015},
editor = {Dias, Paulo and Menezes, Paulo},
title = {{Incremental Reconstruction Approach for Telepresence or AR Applications}},
author = {Almeida, Luís and Menezes, Paulo and Dias, Jorge},
year = {2020},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-128-1},
DOI = {10.2312/pt.20151202}
}