Meshtrics: Objective Quality Assessment of Textured 3D Meshes for 3D Reconstruction
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
In the context of 3D reconstruction, the pursuit of photorealistic models requires precise, objective quality evaluation methods. In this work, we investigate several potential objective metrics for the quality assessment of textured 3D meshes by evaluating their correlation with human perception of visual quality. We conduct experiments using a publicly available, subjectively-rated database of textured 3D meshes containing various types of geometry and texture distortions. Based on these experiments, we discuss the characteristics and limitations of the evaluated metrics. Notably, image-based metrics demonstrated the strongest correlation with subjective scores in most tested scenarios, suggesting that 2D image metrics are reliable predictors of 3D model visual quality. We then introduce a framework designed to facilitate the analysis of various characteristics of 3D models and their fidelity, with a particular focus on image-based metrics leveraging photographs of real-world environments as reference. Our toolkit streamlines the generation of renders and the application of quality metrics, enabling manual annotation in 2D and 3D spaces, while incorporating an automatic alignment refinement step for precise registration of reference photographs. We evaluate the proposed approach using a dataset generated through the 3D reconstruction of a complex indoor environment. Our experiments support the efficacy of the solution in benchmarking 3D reconstruction results, enabling timely informed adjustments to the reconstruction methodology. Source code is available at https://github.com/tiagomfmadeira/Meshtrics.
Description
CCS Concepts: Computing methodologies → Appearance and texture representations; Perception; Mesh models
@inproceedings{10.2312:stag.20241351,
booktitle = {Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference},
editor = {Caputo, Ariel and Garro, Valeria and Giachetti, Andrea and Castellani, Umberto and Dulecha, Tinsae Gebrechristos},
title = {{Meshtrics: Objective Quality Assessment of Textured 3D Meshes for 3D Reconstruction}},
author = {Madeira, Tiago and Oliveira, Miguel and Dias, Paulo},
year = {2024},
publisher = {The Eurographics Association},
ISSN = {2617-4855},
ISBN = {978-3-03868-265-3},
DOI = {10.2312/stag.20241351}
}