GauLoc: 3D Gaussian Splatting-based Camera Relocalization

dc.contributor.authorXin, Zheen_US
dc.contributor.authorDai, Chengkaien_US
dc.contributor.authorLi, Yingen_US
dc.contributor.authorWu, Chenmingen_US
dc.contributor.editorChen, Renjieen_US
dc.contributor.editorRitschel, Tobiasen_US
dc.contributor.editorWhiting, Emilyen_US
dc.date.accessioned2024-10-13T18:09:49Z
dc.date.available2024-10-13T18:09:49Z
dc.date.issued2024
dc.description.abstract3D Gaussian Splatting (3DGS) has emerged as a promising representation for scene reconstruction and novel view synthesis for its explicit representation and real-time capabilities. This technique thus holds immense potential for use in mapping applications. Consequently, there is a growing need for an efficient and effective camera relocalization method to complement the advantages of 3DGS. This paper presents a camera relocalization method, namely GauLoc, in a scene represented by 3DGS. Unlike previous methods that rely on pose regression or photometric alignment, our proposed method leverages the differential rendering capability provided by 3DGS. The key insight of our work is the proposed implicit featuremetric alignment, which effectively optimizes the alignment between rendered keyframes and the query frames, and leverages the epipolar geometry to facilitate the convergence of camera poses conditioned explicit 3DGS representation. The proposed method significantly improves the relocalization accuracy even in complex scenarios with large initial camera rotation and translation deviations. Extensive experiments validate the effectiveness of our proposed method, showcasing its potential to be applied in many realworld applications. Source code will be released at https://github.com/xinzhe11/GauLoc.en_US
dc.description.number7
dc.description.sectionheadersNeural Radiance Fields and Gaussian Splatting
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume43
dc.identifier.doi10.1111/cgf.15256
dc.identifier.issn1467-8659
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.15256
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15256
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies → Image-based rendering; Computer vision
dc.subjectComputing methodologies → Image
dc.subjectbased rendering
dc.subjectComputer vision
dc.titleGauLoc: 3D Gaussian Splatting-based Camera Relocalizationen_US
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
cgf15256.pdf
Size:
14.66 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1215_mm.mp4
Size:
66.36 MB
Format:
Video MP4
Collections