EG2023
Permanent URI for this community
Browse
Browsing EG2023 by Title
Now showing 1 - 20 of 45
Results Per Page
Sort Options
Item Automatic Molecular Tour Creation: a Study(The Eurographics Association, 2023) Larroque, Vincent; Maria, Maxime; Mérillou, Stephane; Montes, Matthieu; Singh, Gurprit; Chu, Mengyu (Rachel)Molecular system visualization is a difficult task even for experts as molecules can contain millions of atoms. Our goal is to create a tool to improve the preliminary study of molecules by automatically creating a tour of the interesting viewpoints around them. Since we noticed limited research specific to molecular visualization, we analyzed and adapted methods from the general field. Our preliminary study shows that our molecular tour is able to smoothly present key information automatically.Item Automatic Step Size Relaxation in Sphere Tracing(The Eurographics Association, 2023) Bán, Róbert; Valasek, Gábor; Babaei, Vahid; Skouras, MelinaWe propose a robust auto-relaxed sphere tracing method that automatically scales its step sizes based on data from previous iterations. It possesses a scalar hyperparemeter that is used similarly to the learning rate of gradient descent methods. We show empirically that this scalar degree of freedom has a smaller effect on performance than the step-scale hyperparameters of concurrent sphere tracing variants. Additionally, we compare the performance of our algorithm to these both on procedural and discrete signed distance input and show that it outperforms or performs up to par to the most efficient method, depending on the limit on iteration counts. We also verify that our method takes significantly fewer robustness-preserving sphere trace fallback steps, as it generates fewer invalid, over-relaxed step sizes.Item CLIP-based Neural Neighbor Style Transfer for 3D Assets(The Eurographics Association, 2023) Mishra, Shailesh; Granskog, Jonathan; Babaei, Vahid; Skouras, MelinaWe present a method for transferring the style from a set of images to the texture of a 3D object. The texture of an asset is optimized with a differentiable renderer and losses using pretrained deep neural networks. More specifically, we utilize a nearest-neighbor feature matching (NNFM) loss with CLIP-ResNet50 that we extend to support multiple style images. We improve color accuracy and artistic control with an extra loss on user-provided or automatically extracted color palettes. Finally, we show that a CLIP-based NNFM loss provides a different appearance over a VGG-based one by focusing more on textural details over geometric shapes. However, we note that user preference is still subjective.Item A Comprehensive Review of Data-Driven Co-Speech Gesture Generation(The Eurographics Association and John Wiley & Sons Ltd., 2023) Nyatsanga, Simbarashe; Kucherenko, Taras; Ahuja, Chaitanya; Henter, Gustav Eje; Neff, Michael; Bousseau, Adrien; Theobalt, ChristianGestures that accompany speech are an essential part of natural and efficient embodied human communication. The automatic generation of such co-speech gestures is a long-standing problem in computer animation and is considered an enabling technology for creating believable characters in film, games, and virtual social spaces, as well as for interaction with social robots. The problem is made challenging by the idiosyncratic and non-periodic nature of human co-speech gesture motion, and by the great diversity of communicative functions that gestures encompass. The field of gesture generation has seen surging interest in the last few years, owing to the emergence of more and larger datasets of human gesture motion, combined with strides in deep-learning-based generative models that benefit from the growing availability of data. This review article summarizes co-speech gesture generation research, with a particular focus on deep generative models. First, we articulate the theory describing human gesticulation and how it complements speech. Next, we briefly discuss rule-based and classical statistical gesture synthesis, before delving into deep learning approaches. We employ the choice of input modalities as an organizing principle, examining systems that generate gestures from audio, text and non-linguistic input. Concurrent with the exposition of deep learning approaches, we chronicle the evolution of the related training data sets in terms of size, diversity, motion quality, and collection method (e.g., optical motion capture or pose estimation from video). Finally, we identify key research challenges in gesture generation, including data availability and quality; producing human-like motion; grounding the gesture in the co-occurring speech in interaction with other speakers, and in the environment; performing gesture evaluation; and integration of gesture synthesis into applications. We highlight recent approaches to tackling the various key challenges, as well as the limitations of these approaches, and point toward areas of future development.Item A Constructivism-based Approach to Treemap Literacy in the Classroom(The Eurographics Association, 2023) Firat, Elif E.; Lang, Colm; Srinivas, Bhumika; Peng, Ilena; Laramee, Robert S.; Joshi, Alark; Magana, Alejandra; Zara, JiriTreemaps are a popular representation to show hierarchical as well as part-to-whole relationships in data. While most students are aware of node-link representations / network diagrams based on their K-12 education, treemaps are often a novel representation to them. We present our experience of developing a software using principles from constructivism to help students understand treemaps using linked, side-by-side views of a node-link diagram and a treemap of the same data. Based on the qualitative survey conducted at the end of the intervention, students found the linked views to be beneficial for understanding hierarchical representation of data using treemaps.Item Creating 3D Asset Variations Through 2D Style Transfer and Generated Texture Maps(The Eurographics Association, 2023) Nikolov, Ivan; Singh, Gurprit; Chu, Mengyu (Rachel)Generating 3D object variations through style transfer models applied to their textures is an easy way for creating content for games and XR applications. Most workflows focus on either generating albedo textures only without changing the underlying surface and not touching the underlying surface or transforming the 3D object directly, which is computationally and resourceheavy. In this paper, we present an initial exploration of an in-between solution that aims to combine the style transfer of albedo textures with the generation of additional maps, such as normal, displacement, and roughness. The results show that the pipeline can generate variations based on different styles, which would enable the addition of smaller 3D-style surface features to objects without transforming their meshes. The project code and generated textures will be available at https: //github.com/IvanNik17/3D-Assets-From-2D-Style-Transfer.Item Draw-Cut-Glue: Comparison of Paper House Model Creation in VR and on Paper in a Museum Education Programme - Pilot Study(The Eurographics Association, 2023) Malý, Ivo; Vachková, Iva; Sedlácek, David; Magana, Alejandra; Zara, JiriIn this paper, we describe the integration of Virtual Reality (VR) into a museum education programme. The aim of the programme is to present the cultural heritage of Langweil's model of Prague in the context of author's life in the 19th century. For the programme, we developed a VR application in which students experience the creation of Langweil's model of Prague, more specifically, they virtually draw and cut out a facade of a house and insert it into the rest of the model. As part of the educational programme, the students also experience a similar activity with a paper model, which leads them to compare the creation in VR and in reality with real tools. The context of the author's life is covered by two additional programme activities using a budget simulation and a discussion using historical photographs. In a pilot study we evaluated the programme with 31 students and we describe the observed results from both the students' and the organisation's perspectives.Item DropSPH: ISPH Simulation of Droplet Interactions with a Solid Surface(The Eurographics Association, 2023) Keshtkar, Hossein; Aburumman, Nadine; Singh, Gurprit; Chu, Mengyu (Rachel)We present a physically-based model to simulate droplet behaviours when impacted on a solid surface. Our model creates the coalescence, spreading, and break-up deformations that occur when a liquid droplet collides with a solid surface. We model the attraction-repulsion forces within an improved free surface Incompressible Smoothed Particle Hydrodynamics (ISPH) framework that includes contact force and cohesion force between particles. The results show that our model is effective in simulating several small-scale liquid phenomena.Item Effective User Studies in Computer Graphics(The Eurographics Association, 2023) Malpica, Sandra; Sun, Qi; Kellnhofer, Petr; Beacco, Alejandro; Senel, Gizem; McDonnell, Rachel; Flores Vargas, Mauricio; Serrano, Ana; Slusallek, PhilippUser studies are a useful tool for researchers, allowing them to collect data on how users perceive, interact with and process different types of sensory information. If planned in advance, user experiments can be leveraged in every stage of a research project, from early design, prototyping and feature exploration to applied proofs of concept, passing through validation and data collection for model training. User studies can provide the researcher with different types of information depending on the chosen methodology: user performance metrics, surveys and interviews, field studies, physiological data, etc. Considering human perception and other cognitive processes is particularly important in computer graphics, where most research produces outputs whose ultimate purpose is to be seen or perceived by a human. Being able to measure in an objective and systematic way how the information we generate is integrated into the representational space humans create to situate themselves in the world means that researchers will have more information to implement optimal algorithms, tools and techniques. In this tutorial we will give an overview of good practices for user studies in computer graphics with a particular focus on virtual reality use cases. We will cover the basics on how to design, carry out and analyze good user studies, as well as different particularities to be taken into account in immersive environments.Item Efficient Needle Insertion Simulation using Hybrid Constraint Solver and Isolated DOFs(The Eurographics Association, 2023) Martin, Claire; Zeng, Ziqiu; Courtecuisse, Hadrien; Babaei, Vahid; Skouras, MelinaThis paper introduces a real-time compatible method to improve the location of constraints between a needle and tissues in the context of needle insertion simulation. This method is based on intersections between the Finite Element (FE) meshes of the needle and the tissues. It is coupled with the method of isolating mechanical DOFs and a hybrid solver (implying both direct and iterative resolutions) to respectively generate and solve the constraint problem while reducing the computation time.Item EUROGRAPHICS 2023: CGF 42-2 STARs Frontmatter(The Eurographics Association and John Wiley & Sons Ltd., 2023) Bousseau, Adrien; Theobalt, Christian; Bousseau, Adrien; Theobalt, ChristianItem EUROGRAPHICS 2023: Education Papers Frontmatter(The Eurographics Association, 2023) Magana, Alejandra; Zara, Jiri; Magana, Alejandra; Zara, JiriItem EUROGRAPHICS 2023: Posters Frontmatter(Eurographics Association, 2023) Singh, Gurprit; Chu, Mengyu (Rachel); Singh, Gurprit; Chu, Mengyu (Rachel)Item EUROGRAPHICS 2023: Short Papers Frontmatter(Eurographics Association, 2023) Babaei, Vahid; Skouras, Melina; Babaei, Vahid; Skouras, MelinaItem EUROGRAPHICS 2023: Tutorials Frontmatter(Eurographics Association, 2023) Serrano, Ana; Slusallek, Philipp; Serrano, Ana; Slusallek, PhilippItem Game-based Transformations: A Playful Approach to Learning Transformations in Computer Graphics(The Eurographics Association, 2023) Eisemann, Martin; Magana, Alejandra; Zara, JiriIn this paper, we present a playful and game-based learning approach to teaching transformations in a second-year undergraduate computer graphics course. While the theoretical concepts were taught in class, the exercise consists of two web-based tools that help the students to get a playful grasp on the complex topic, which is the foundation for many of the later concepts typically taught in computer graphics, such as the rendering pipeline, animation, camera motion, shadow mapping and many more. The final students' projects and feedback indicate that the game-based introduction was well-received by the students.Item Guiding Light Trees for Many-Light Direct Illumination(The Eurographics Association, 2023) Hamann, Eric; Jung, Alisa; Dachsbacher, Carsten; Babaei, Vahid; Skouras, MelinaPath guiding techniques reduce the variance in path tracing by reusing knowledge from previous samples to build adaptive sampling distributions. The Practical Path Guiding (PPG) approach stores and iteratively refines an approximation of the incident radiance field in a spatio-directional data structure that allows sampling the incident radiance. However, due to the limited resolution in both spatial and directional dimensions, this discrete approximation is not able to accurately capture a large number of very small lights. We present an emitter sampling technique to guide next event estimation (NEE) with a global light tree and adaptive tree cuts that integrates into the PPG framework. In scenes with many lights our technique significantly reduces the RMSE compared to PPG with uniform NEE, while adding close to no overhead in scenes with few light sources. The results show that our technique can also aid the incident radiance learning of PPG in scenes with difficult visibility.Item Is Drawing Order Important?(The Eurographics Association, 2023) Qiu, Sherry; Wang, Zeyu; McMillan, Leonard; Rushmeier, Holly; Dorsey, Julie; Babaei, Vahid; Skouras, MelinaThe drawing process is crucial to understanding the final result of a drawing. There has been a long history of understanding human drawing; what kinds of strokes people use and where they are placed. An area of interest in Artificial Intelligence is developing systems that simulate human behavior in drawing. However, there has been little work done to understand the order of strokes in the drawing process. Without sufficient understanding of natural drawing order, it is difficult to build models that can generate natural drawing processes. In this paper, we present a study comparing multiple types of stroke orders to confirm findings from previous work and demonstrate that multiple orderings of the same set of strokes can be perceived as human-drawn and different stroke order types achieve different perceived naturalness depending on the type of image prompt.Item Learning with Music Signals: Technology Meets Education(The Eurographics Association, 2023) Müller, Meinard; Serrano, Ana; Slusallek, PhilippMusic information retrieval (MIR) is an exciting and challenging research area that aims to develop techniques and tools for organizing, analyzing, retrieving, and presenting music-related data. Being at the intersection of engineering and humanities, MIR relates to different research disciplines, including signal processing, machine learning, information retrieval, musicology, and the digital humanities. In this tutorial, using music as a tangible and concrete application domain, we will approach the concept of learning from different angles, addressing technological and educational aspects. When talking about learning in an engineering context, one immediately thinks of data-driven techniques such as deep learning (DL), where computer-based systems are trained to extract complex features and hidden relationships from given examples. In this tutorial, we will introduce various music analysis and retrieval tasks, where we start with classical engineering approaches. We then show how such approaches may be rephrased or simulated by DL-based systems, thus indicating new avenues toward building more explainable and hybrid machine-learning systems by learning from the experience of traditional engineering approaches and integrating knowledge from the music domain. Beyond this technical perspective, another aim of this tutorial is to approach the concept of learning from an educational perspective. We argue that music, being an essential part of our lives that everyone feels connected to, yields an intuitive entry point to support education in technical disciplines. In this tutorial, we will show how music may serve as a vehicle to make learning in signal processing and machine learning an interactive pursuit. In this context, we will also introduce a novel collection of educational material for teaching and learning fundamentals of music processing (FMP). This collection, referred to as FMP notebooks (https://www.audiolabs-erlangen.de/FMP) can be used to study both theory and practice, generate educational material for lectures, and provide baseline implementations for many MIR tasks. The tutorial's novelty lies in how it presents a holistic approach to learning using music as a challenging and tangible application domain. In this way, the tutorial serves several purposes: it gives a gentle introduction to MIR while introducing a new software package for teaching and learning music processing, it highlights avenues for developing explainable machine-learning models, and it discusses how recent technology can be applied and communicated in interdisciplinary research and education.Item Luminance-Preserving and Temporally Stable Daltonization(The Eurographics Association, 2023) Ebelin, Pontus; Crassin, Cyril; Denes, Gyorgy; Oskarsson, Magnus; Åström, Kalle; Akenine-Möller, Tomas; Babaei, Vahid; Skouras, MelinaWe propose a novel, real-time algorithm for recoloring images to improve the experience for a color vision deficient observer. The output is temporally stable and preserves luminance, the most important visual cue. It runs in 0.2 ms per frame on a GPU.
- «
- 1 (current)
- 2
- 3
- »