High Resolution 2D-/3D-Scanning and Deep Learning Segmentation for Digitization of Fragmented Wall Paintings

Simple item page
dc.contributor.authorKroeger, Oleen_US
dc.contributor.authorKrumpek, Oliveren_US
dc.contributor.authorKoch, Paulen_US
dc.contributor.authorPape, Martinen_US
dc.contributor.authorSchneider, Janen_US
dc.contributor.authorKrüger, Jörgen_US
dc.contributor.editorBucciero, Albertoen_US
dc.contributor.editorFanini, Brunoen_US
dc.contributor.editorGraf, Holgeren_US
dc.contributor.editorPescarin, Sofiaen_US
dc.contributor.editorRizvic, Selmaen_US
dc.date.accessioned2023-09-02T07:44:22Z
dc.date.available2023-09-02T07:44:22Z
dc.date.issued2023
dc.description.abstractThe preservation and study of mural wall paintings often involve the collection of numerous fragments with unknown context. In this paper the authors present a case study involving a Roman wall painting discovered in 2013 at the European Cultural Park Bliesbruck-Reinheim. The objective of this work was to develop a semi-automated assistance system for the digitization, visualization, and digital repositioning of the Roman wall painting fragments. Therefore an easy-to-use scanner system was developed, that captures high-resolution 2D images of the front and back surfaces of the fragments, along with a height map of the backside. The contributing partners also developed a control and operating software for the scanner, as well as an automated software platform for visualization and repositioning of the digital fragments. The contributions of this paper include the introduction of a ML-based algorithm for background subtraction and segmentation of the front surface of the fragments. The technical realisation for fast and accurate image acquisition of the fragments, including sensor registration and highresolution capture, has been worked out. The system calibration process, hardware setup and data correction techniques are described in detail. Additionally, the challenges of pixel-wise image segmentation for distinguishing between background, inner contour (wall painting), and outer contour (fragment surface without painting) are discussed. Our proposed approach overcomes the limitations of training ML algorithms on high-resolution images by employing patch-wise training and leveraging small features instead of large-scale features. The digitization and segmentation process demonstrated promising results in preserving and reconstructing the roman wall painting fragments. The findings of this study contribute to the field of cultural heritage preservation and provide valuable insights as the developed equipment and methods are highly transferable to future digitization projects.en_US
dc.description.sectionheadersAI and 3D Reconstruction I
dc.description.seriesinformationEurographics Workshop on Graphics and Cultural Heritage
dc.identifier.doi10.2312/gch.20231152
dc.identifier.isbn978-3-03868-217-2
dc.identifier.issn2312-6124
dc.identifier.pages11-19
dc.identifier.pages9 pages
dc.identifier.urihttps://doi.org/10.2312/gch.20231152
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/gch20231152
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Applied computing → Fine arts; Computing methodologies → Image segmentation; 3D imaging; Camera calibration
dc.subjectApplied computing → Fine arts
dc.subjectComputing methodologies → Image segmentation
dc.subject3D imaging
dc.subjectCamera calibration
dc.titleHigh Resolution 2D-/3D-Scanning and Deep Learning Segmentation for Digitization of Fragmented Wall Paintingsen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
011-019.pdf
Size:
27.32 MB
Format:
Adobe Portable Document Format
Download
Collections
GCH 2023 - Eurographics Workshop on Graphics and Cultural Heritage