Capture and Automatic Production of Digital Humans in Real Motion with a Temporal 3D Scanner
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
The demand for virtual human characters in Extended Realities (XR) is growing across industries from entertainment to healthcare. Achieving natural behaviour in virtual environments requires digitizing real-world actions, a task typically laborious and requiring specialized expertise. This paper presents an advanced approach for digitizing humans in motion, streamlining the process from capture to virtual character creation. By integrating the proposed hardware, algorithms, and data models, this approach automates the creation of high-resolution assets, reducing manual intervention and software dependencies. The resulting sequences of rigged and textured meshes ensure lifelike virtual characters with detailed facial expressions and hand gestures, surpassing the capabilities of static 3D scans animated via separate motion captures. Robust pose-dependent shape corrections and temporal consistency algorithms guarantee smooth, artifact-free body surfaces in motion, while the export capability in standard formats enhances interoperability and further character development possibilities. Additionally, this method facilitates the efficient creation of large datasets for learning human models, thus representing a significant advancement in XR technologies and digital content creation across industries.
Description
CCS Concepts: Computing methodologies → Shape modeling; Machine learning; Computer vision; Animation; Image manipulation; Graphics file formats; Mesh models; Mesh geometry models; Image processing; Computer vision problems; Reconstruction
@inproceedings{10.2312:cl.20241048,
booktitle = {CLIPE 2024 - Creating Lively Interactive Populated Environments},
editor = {Pelechano, Nuria and Pettré, Julien},
title = {{Capture and Automatic Production of Digital Humans in Real Motion with a Temporal 3D Scanner}},
author = {Parrilla, Eduardo and Ballester, Alfredo and Uriel, Jordi and Ruescas-Nicolau, Ana V. and Alemany, Sandra},
year = {2024},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-241-7},
DOI = {10.2312/cl.20241048}
}