AI Based Image Segmentation of Cultural Heritage Objects used for Multi-View Stereo 3D Reconstructions
No Thumbnail Available
Files
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Image segmentation (or masking) finds a very useful use case within 3D reconstruction of cultural heritage objects. The 3D reconstructions can be accelerated, reconstructing the object without any background noise. Conventional segmentation methods can calculate erroneous masks for certain objects and environments, which can lead to errors within the reconstruction: Parts of the 3D reconstruction may be missing or are incorrectly reconstructed, which contradicts adequate archiving. The automated iterative Multi-View Stereo (MVS) scanning process makes it necessary to obtain masks that reconstruct the object in the best possible way, regardless of the environment, the stabilizing mount, the color of the background and the object. In addition, it should not be necessary to tweak the best possible parameters for conventional masking procedures and to create masks manually. State-of-the-art artificial intelligence (AI) segmentation networks will be trained and applied to the MVS scans to verify the behavior of the associated 3D reconstructions and the automated iterative scanning process. In addition, a comparison between different AI segmentation networks and a comparison between conventional masking methods and AI segmentation networks is performed.
Description
CCS Concepts: Computing methodologies → Image segmentation; Reconstruction; Hardware → Scanners
@inproceedings{10.2312:gch.20231160,
booktitle = {Eurographics Workshop on Graphics and Cultural Heritage},
editor = {Bucciero, Alberto and Fanini, Bruno and Graf, Holger and Pescarin, Sofia and Rizvic, Selma},
title = {{AI Based Image Segmentation of Cultural Heritage Objects used for Multi-View Stereo 3D Reconstructions}},
author = {Kutlu, Hasan and Brucker, Felix and Kallendrusch, Ben and Santos, Pedro and Fellner, Dieter W.},
year = {2023},
publisher = {The Eurographics Association},
ISSN = {2312-6124},
ISBN = {978-3-03868-217-2},
DOI = {10.2312/gch.20231160}
}