EG 2018 - STARs (CGF 37-2)
Permanent URI for this collection
State of the Art Reports
State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
] [
]
Michael Zollhöfer, Justus Thies, Pablo Garrido, Derek Bradley, Thabo Beeler, Patrick Pérez,
Marc Stamminger, Matthias Nießner, and Christian Theobalt
Monte Carlo Methods for Volumetric Light Transport Simulation
Jan Novák, Iliyan Georgiev, Johannes Hanika, and Wojciech Jarosz
A Survey on Data-driven Dictionary-based Methods for 3D Modeling
Thibault Lescoat, Maks Ovsjanikov, Pooran Memari, Jean-Marc Thiery, and Tamy Boubekeur
Functionality Representations and Applications for Shape Analysis
Ruizhen Hu, Manolis Savva, and Oliver van Kaick
State of the Art on 3D Reconstruction with RGB-D Cameras
Michael Zollhöfer, Patrick Stotko, Andreas Görlitz, Christian Theobalt, Matthias Nießner,
Reinhard Klein, and Andreas Kolb
Recent Advances in Projection Mapping Algorithms, Hardware and Applications
Anselm Grundhöfer and Daisuke Iwai
Browse
Recent Submissions
Item EUROGRAPHICS 2018: CGF 37-2 STARs Frontmatter(The Eurographics Association and John Wiley & Sons Ltd., 2018) Hildebrandt, Klaus; Theobalt, Christian; Hildebrandt, Klaus; Theobalt, Christian-Item State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications(The Eurographics Association and John Wiley & Sons Ltd., 2018) Zollhöfer, Michael; Thies, Justus; Garrido, Pablo; Bradley, Derek; Beeler, Thabo; Pérez, Patrick; Stamminger, Marc; Nießner, Matthias; Theobalt, Christian; Hildebrandt, Klaus and Theobalt, ChristianThe computer graphics and vision communities have dedicated long standing efforts in building computerized tools for reconstructing, tracking, and analyzing human faces based on visual input. Over the past years rapid progress has been made, which led to novel and powerful algorithms that obtain impressive results even in the very challenging case of reconstruction from a single RGB or RGB-D camera. The range of applications is vast and steadily growing as these technologies are further improving in speed, accuracy, and ease of use. Motivated by this rapid progress, this state-of-the-art report summarizes recent trends in monocular facial performance capture and discusses its applications, which range from performance-based animation to real-time facial reenactment. We focus our discussion on methods where the central task is to recover and track a three dimensional model of the human face using optimization-based reconstruction algorithms. We provide an in-depth overview of the underlying concepts of real-world image formation, and we discuss common assumptions and simplifications that make these algorithms practical. In addition, we extensively cover the priors that are used to better constrain the under-constrained monocular reconstruction problem, and discuss the optimization techniques that are employed to recover dense, photo-geometric 3D face models from monocular 2D data. Finally, we discuss a variety of use cases for the reviewed algorithms in the context of motion capture, facial animation, as well as image and video editing.Item Monte Carlo Methods for Volumetric Light Transport Simulation(The Eurographics Association and John Wiley & Sons Ltd., 2018) Novák, Jan; Georgiev, Iliyan; Hanika, Johannes; Jarosz, Wojciech; Hildebrandt, Klaus and Theobalt, ChristianThe wide adoption of path-tracing algorithms in high-end realistic rendering has stimulated many diverse research initiatives. In this paper we present a coherent survey of methods that utilize Monte Carlo integration for estimating light transport in scenes containing participating media. Our work complements the volume-rendering state-of-the-art report by Cerezo et al. [CPP 05]; we review publications accumulated since its publication over a decade ago, and include earlier methods that are key for building light transport paths in a stochastic manner. We begin by describing analog and non-analog procedures for freepath sampling and discuss various expected-value, collision, and track-length estimators for computing transmittance. We then review the various rendering algorithms that employ these as building blocks for path sampling. Special attention is devoted to null-collision methods that utilize fictitious matter to handle spatially varying densities; we import two ''next-flight'' estimators originally developed in nuclear sciences. Whenever possible, we draw connections between image-synthesis techniques and methods from particle physics and neutron transport to provide the reader with a broader context.Item A Survey on Data-driven Dictionary-based Methods for 3D Modeling(The Eurographics Association and John Wiley & Sons Ltd., 2018) Lescoat, Thibault; Ovsjanikov, Maks; Memari, Pooran; Thiery, Jean-Marc; Boubekeur, Tamy; Hildebrandt, Klaus and Theobalt, ChristianDictionaries are very useful objects for data analysis, as they enable a compact representation of large sets of objects through the combination of atoms. Dictionary-based techniques have also particularly benefited from the recent advances in machine learning, which has allowed for data-driven algorithms to take advantage of the redundancy in the input dataset and discover relations between objects without human supervision or hard-coded rules. Despite the success of dictionary-based techniques on a wide range of tasks in geometric modeling and geometry processing, the literature is missing a principled state-of-the-art of the current knowledge in this field. To fill this gap, we provide in this survey an overview of data-driven dictionary-based methods in geometric modeling. We structure our discussion by application domain: surface reconstruction, compression, and synthesis. Contrary to previous surveys, we place special emphasis on dictionary-based methods suitable for 3D data synthesis, with applications in geometric modeling and design. Our ultimate goal is to enlight the fact that these techniques can be used to combine the data-driven paradigm with design intent to synthesize new plausible objects with minimal human intervention. This is the main motivation to restrict the scope of the present survey to techniques handling point clouds and meshes, making use of dictionaries whose definition depends on the input data, and enabling shape reconstruction or synthesis through the combination of atoms.Item Functionality Representations and Applications for Shape Analysis(The Eurographics Association and John Wiley & Sons Ltd., 2018) Hu, Ruizhen; Savva, Manolis; Kaick, Oliver van; Hildebrandt, Klaus and Theobalt, ChristianA central goal of computer graphics is to provide tools for designing and simulating real or imagined artifacts. An understanding of functionality is important in enabling such modeling tools. Given that the majority of man-made artifacts are designed to serve a certain function, the functionality of objects is often reflected by their geometry, the way that they are organized in an environment, and their interaction with other objects or agents. Thus, in recent years, a variety of methods in shape analysis have been developed to extract functional information about objects and scenes from these different types of cues. In this report, we discuss recent developments that incorporate functionality aspects into the analysis of 3D shapes and scenes. We provide a summary of the state-of-the-art in this area, including a discussion of key ideas and an organized review of the relevant literature. More specifically, the report is structured around a general definition of functionality from which we derive criteria for classifying the body of prior work. This definition also facilitates a comparative view of methods for functionality analysis. We focus on studying the inference of functionality from a geometric perspective, and pose functionality analysis as a process involving both the geometry and interactions of a functional entity. In addition, we discuss a variety of applications that benefit from an analysis of functionality, and conclude the report with a discussion of current challenges and potential future works.Item State of the Art on 3D Reconstruction with RGB-D Cameras(The Eurographics Association and John Wiley & Sons Ltd., 2018) Zollhöfer, Michael; Stotko, Patrick; Görlitz, Andreas; Theobalt, Christian; Nießner, Matthias; Klein, Reinhard; Kolb, Andreas; Hildebrandt, Klaus and Theobalt, ChristianThe advent of affordable consumer grade RGB-D cameras has brought about a profound advancement of visual scene reconstruction methods. Both computer graphics and computer vision researchers spend significant effort to develop entirely new algorithms to capture comprehensive shape models of static and dynamic scenes with RGB-D cameras. This led to significant advances of the state of the art along several dimensions. Some methods achieve very high reconstruction detail, despite limited sensor resolution. Others even achieve real-time performance, yet possibly at lower quality. New concepts were developed to capture scenes at larger spatial and temporal extent. Other recent algorithms flank shape reconstruction with concurrent material and lighting estimation, even in general scenes and unconstrained conditions. In this state-of-the-art report, we analyze these recent developments in RGB-D scene reconstruction in detail and review essential related work. We explain, compare, and critically analyze the common underlying algorithmic concepts that enabled these recent advancements. Furthermore, we show how algorithms are designed to best exploit the benefits of RGB-D data while suppressing their often non-trivial data distortions. In addition, this report identifies and discusses important open research questions and suggests relevant directions for future work.Item Recent Advances in Projection Mapping Algorithms, Hardware and Applications(The Eurographics Association and John Wiley & Sons Ltd., 2018) Grundhöfer, Anselm; Iwai, Daisuke; Hildebrandt, Klaus and Theobalt, ChristianThis State-of-the-Art-Report covers the recent advances in research fields related to projection mapping applications. We summarize the novel enhancements to simplify the 3D geometric calibration task, which can now be reliably carried out either interactively or automatically using self-calibration methods. Furthermore, improvements regarding radiometric calibration and compensation as well as the neutralization of global illumination effects are summarized. We then introduce computational display approaches to overcome technical limitations of current projection hardware in terms of dynamic range, refresh rate, spatial resolution, depth-of-field, view dependency, and color space. These technologies contribute towards creating new application domains related to projection-based spatial augmentations. We summarize these emerging applications, and discuss new directions for industries.