3D Reconstruction and Transparent Visualization of Indonesian Cultural Heritage from a Single Image

Abstract
Herein, we propose a method for three-dimensional (3D) reconstruction of cultural heritage based on deep learning, which we apply to the reliefs of the Buddhist temple heritage of Borobudur Temple, in Indonesia. Some parts of the Borobudur reliefs have been hidden by stone walls and are not visible following the reinforcements during the Dutch rule. Today, only gray-scale photos of those hidden parts are displayed in the Borobudur Museum. First, we reconstruct 3D point clouds of the hidden reliefs from these photos and predict the pixel-wise depth information for each of them using a deep neural network model. We then apply our stochastic point-based rendering mechanism to produce a high-quality visualization of the reconstructed point clouds. We have achieved promising visualization results that provide us with an intuitive understanding of the valuable relief heritage that is no longer visible to ordinary visitors.
Description

        
@inproceedings{
10.2312:gch.20181363
, booktitle = {
Eurographics Workshop on Graphics and Cultural Heritage
}, editor = {
Sablatnig, Robert and Wimmer, Michael
}, title = {{
3D Reconstruction and Transparent Visualization of Indonesian Cultural Heritage from a Single Image
}}, author = {
Pan, Jiao
 and
Li, Liang
 and
Yamaguchi, Hiroshi
 and
Hasegawa, Kyoko
 and
Thufail, Fadjar I.
 and
Mantara, Bra
 and
Tanaka, Satoshi
}, year = {
2018
}, publisher = {
The Eurographics Association
}, ISSN = {
2312-6124
}, ISBN = {
978-3-03868-057-4
}, DOI = {
10.2312/gch.20181363
} }
Citation