Gaze-Contingent Perceptual Level of Detail Prediction
Loading...
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
New virtual reality headsets and wide field-of-view displays rely on foveated rendering techniques that lower the rendering quality for peripheral vision to increase performance without a perceptible quality loss. While the concept is simple, the practical realization of the foveated rendering systems and their full exploitation are still challenging. Existing techniques focus on modulating the spatial resolution of rendering or shading rate according to the characteristics of human perception. However, most rendering systems also have a significant cost related to geometry processing. In this work, we investigate the problem of mesh simplification, also known as the level of detail (LOD) technique, for foveated rendering. We aim to maximize the amount of LOD simplification while keeping the visibility of changes to the object geometry under a selected threshold. We first propose two perceptually inspired visibility models for mesh simplification suitable for gaze-contingent rendering. The first model focuses on spatial distortions in the object silhouette and body. The second model accounts for the temporal visibility of switching between two LODs. We calibrate the two models using data from perceptual experiments and derive a computational method that predicts a suitable LOD for rendering an object at a specific eccentricity without objectionable quality loss. We apply the technique to the foveated rendering of static and dynamic objects and demonstrate the benefits in a validation experiment. Using our perceptually-driven gaze-contingent LOD selection, we achieve up to 33% of extra speedup in rendering performance of complex-geometry scenes when combined with the most recent industrial solutions, i.e., Nanite from Unreal Engine.
Description
CCS Concepts: Computing methodologies -> Perception; Virtual reality
@inproceedings{10.2312:sr.20231130,
booktitle = {Eurographics Symposium on Rendering},
editor = {Ritschel, Tobias and Weidlich, Andrea},
title = {{Gaze-Contingent Perceptual Level of Detail Prediction}},
author = {Surace, Luca and Tursun, Cara and Celikcan, Ufuk and Didyk, Piotr},
year = {2023},
publisher = {The Eurographics Association},
ISSN = {1727-3463},
ISBN = {978-3-03868-229-5978-3-03868-228-8},
DOI = {10.2312/sr.20231130}
}