Seamless and Aligned Texture Optimization for 3D Reconstruction

Wang, Lei; Ge, Linlin; Zhang, Qitong; Feng, Jieqing

Seamless and Aligned Texture Optimization for 3D Reconstruction

Files

cgf15205.pdf (5.61 MB)

paper1387_mm.pdf (107.46 KB)

Date

2024

Authors

Wang, Lei
Ge, Linlin
Zhang, Qitong
Feng, Jieqing

Publisher

The Eurographics Association and John Wiley & Sons Ltd.

Abstract

Restoring the appearance of the model is a crucial step for achieving realistic 3D reconstruction. High-fidelity textures can also conceal some geometric defects. Since the estimated camera parameters and reconstructed geometry usually contain errors, subsequent texture mapping often suffers from undesirable visual artifacts such as blurring, ghosting, and visual seams. In particular, significant misalignment between the reconstructed model and the registered images will lead to texturing the mesh with inconsistent image regions. However, eliminating various artifacts to generate high-quality textures remains a challenge. In this paper, we address this issue by designing a texture optimization method to generate seamless and aligned textures for 3D reconstruction. The main idea is to detect misalignment regions between images and geometry and exclude them from texture mapping. To handle the texture holes caused by these excluded regions, a cross-patch texture hole-filling method is proposed, which can also synthesize plausible textures for invisible faces. Moreover, for better stitching of the textures from different views, an improved camera pose optimization is present by introducing color adjustment and boundary point sampling. Experimental results show that the proposed method can eliminate the artifacts caused by inaccurate input data robustly and produce highquality texture results compared with state-of-the-art methods.

CCS Concepts: Computing methodologies->Image manipulation; Texturing

        @article{10.1111:cgf.15205
,
journal = {Computer Graphics Forum},
title = {{Seamless and Aligned Texture Optimization for 3D Reconstruction
}},
author = {Wang, Lei and 
Ge, Linlin and 
Zhang, Qitong and 
Feng, Jieqing
},
year = {2024
},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.
},
ISSN = {1467-8659
},
DOI = {10.1111/cgf.15205
}
}