A Robust Multi-View System for High-Fidelity Human Body Shape Reconstruction
Loading...
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
This paper proposes a passive multi-view system for human body shape reconstruction, namely RHF-Human, to overcome several challenges including accurate calibration and stereo matching in self-occluded and low-texture skin regions. The reconstruction process includes four steps: capture, multi-view camera calibration, dense reconstruction, and meshing. The capture system, which consists of 90 digital single-lens reflex cameras, is single-shot to avoid nonrigid deformation of the human body. Two technical contributions are made: (1) a two-step robust multi-view calibration approach that improves calibration accuracy and saves calibration time for each new human body acquired and (2) an accurate PatchMatch multi-view stereo method for dense reconstruction to perform correct matching in self-occluded and low-texture skin regions and to reduce the noise caused by body hair. Experiments on models of various genders, poses, and skin with different amounts of body hair show the robustness of the proposed system. A high-fidelity human body shape dataset with 227 models is constructed, and the average accuracy is within 1.5 mm. The system provides a new scheme for the accurate reconstruction of nonrigid human models based on passive vision and has good potential in fashion design and health care.
Description
@article{10.1111:cgf.14354,
journal = {Computer Graphics Forum},
title = {{A Robust Multi-View System for High-Fidelity Human Body Shape Reconstruction}},
author = {Zhang, Qitong and Wang, Lei and Ge, Linlin and Luo, Shan and Zhu, Taihao and Jiang, Feng and Ding, Jimmy and Feng, Jieqing},
year = {2021},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14354}
}