SBM17: Sketch Based Interfaces and Modeling 2017

Permanent URI for this collection

https://diglib7.eg.org/handle/10.2312/2631852

Expressive 2017

Joint Symposium of
Computational Aesthetics (CAe)
Non-Photorealistic Animation and Rendering (NPAR)
Sketch-Based Interfaces and Modeling (SBIM)

Los Angeles, California | June 29 – 30, 2017

Front-and Backmatter
Sketching
SmartSketcher: Sketch-based Image Retrieval with Dynamic Semantic Reranking
[full paper Image] [meta data Image]
Tiziano Portenier, Qiyang Hu, Paolo Favaro, and Matthias Zwicker
Conquering the Cube: Learning to Sketch Primitives in Perspective with an Intelligent Tutoring System
[full paper Image] [meta data Image]
Swarna Keshavabhotla, Blake Williford, Shalini Kumar, Ethan Hilton, Paul Taele, Wayne Li, Julie Linsey, and Tracy Hammond
Flow2Code: From Hand-drawn Flowcharts to Code Execution
[full paper Image] [meta data Image]
Jorge-Ivan Herrera-Camara and Tracy Hammond
3D (The Third Dimension)
Interactive swept surface modeling in virtual reality with motion-tracked controllers
[full paper Image] [meta data Image]
Tim McGraw, Esteban Garcia, and Drew Sumner
General Submissions (Abstracts)
A taxonomy of motion applications in data visualization
[full paper Image] [meta data Image]
Irene de la Torre - Arenas and Pedro Cruz
Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations
[full paper Image] [meta data Image]
Saif Castaneda and Ergun Akleman
Modeling Go: A mobile sketch-based modeling system for extracting objects
[full paper Image] [meta data Image]
Chun-An Lai and Pei-Ying Chiang
Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces
[full paper Image] [meta data Image]
Ozan Can Altıok and Tev k Metin Sezgin
Sketch and Shade : An interactive assistant for sketching and shading
[full paper Image] [meta data Image]
Amal Dev Parakkat, Sarang Anil Joshi, Uday Bondi Pundarikaksha, and Ramanathan Muthuganapathy

BibTeX (SBM17: Sketch Based Interfaces and Modeling 2017)
@inproceedings{
not assigned,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Front- and Backmatter: SBIM 2017}},

author = {
Holger Winnemoeller
 and 
Lyn Bartram
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
not assigned}

}
@inproceedings{
10.1145:3092907.3092910,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
SmartSketcher: Sketch-based Image Retrieval with Dynamic Semantic Reranking}},

author = {
Portenier, Tiziano
 and 
Hu, Qiyang
 and 
Favaro, Paolo
 and 
Zwicker, Matthias
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3092907.3092910}

}
@inproceedings{
10.1145:3092907.3092911,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Conquering the Cube: Learning to Sketch Primitives in Perspective with an Intelligent Tutoring System}},

author = {
Keshavabhotla, Swarna
 and 
Williford, Blake
 and 
Kumar, Shalini
 and 
Hilton, Ethan
 and 
Taele, Paul
 and 
Li, Wayne
 and 
Linsey, Julie
 and 
Hammond, Tracy
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3092907.3092911}

}
@inproceedings{
10.1145:3092907.3092911,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Flow2Code: From Hand-drawn Flowcharts to Code Execution}},

author = {
Herrera-Camara, Jorge-Ivan
 and 
Hammond, Tracy
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3092907.3092911}

}
@inproceedings{
10.1145:3092907.3092908,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Interactive swept surface modeling in virtual reality with motion-tracked controllers}},

author = {
McGraw, Tim
 and 
Garcia, Esteban
 and 
Sumner, Drew
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3092907.3092908}

}
@inproceedings{
10.1145:3122791.3122798,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
A taxonomy of motion applications in data visualization}},

author = {
Arenas, Irene de la Torre -
 and 
Cruz, Pedro
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3122791.3122798}

}
@inproceedings{
10.1145:3122791.3122800,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations}},

author = {
Castaneda, Saif
 and 
Akleman, Ergun
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3122791.3122800}

}
@inproceedings{
10.1145:3122791.3122797,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Modeling Go: A mobile sketch-based modeling system for extracting objects}},

author = {
Lai, Chun-An
 and 
Chiang, Pei-Ying
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3122791.3122797}

}
@inproceedings{
10.1145:3122791.3122801,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces}},

author = {
Altıok, Ozan Can
 and 
Sezgin, Tev k Metin
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3122791.3122801}

}
@inproceedings{
10.1145:3122791.3122799,

booktitle = {
Sketch-Based Interfaces and Modeling},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Sketch and Shade : An interactive assistant for sketching and shading}},

author = {
Parakkat, Amal Dev
 and 
Joshi, Sarang Anil
 and 
Pundarikaksha, Uday Bondi
 and 
Muthuganapathy, Ramanathan
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {1812-3503},
ISBN = {978-1-4503-5080-8},

DOI = {
10.1145/3122791.3122799}

}

Browse

Recent Submissions

Now showing 1 - 10 of 10
  • Thumbnail Image
    Item
    Front- and Backmatter: SBIM 2017
    (Association for Computing Machinery, Inc (ACM), 2017) Holger Winnemoeller; Lyn Bartram; Holger Winnemoeller and Lyn Bartram
  • Thumbnail Image
    Item
    SmartSketcher: Sketch-based Image Retrieval with Dynamic Semantic Reranking
    (Association for Computing Machinery, Inc (ACM), 2017) Portenier, Tiziano; Hu, Qiyang; Favaro, Paolo; Zwicker, Matthias; Holger Winnemoeller and Lyn Bartram
    We present a sketch-based image retrieval system, designed to answer arbitrary queries that may go beyond searching for predefined object or scene categories. While sketching is fast and intuitive to formulate visual queries, pure sketch-based image retrieval often returns many outliers because it lacks a semantic understanding of the query. Our key idea is to combine sketch-based queries with interactive, semantic re-ranking of query results. We leverage progress in deep learning and use a feature representation learned for image classification for re-ranking. This allows us to cluster semantically similar images, re-rank based on the clusters, and present more meaningful query results to the user. We report on two large-scale benchmarks and demonstrate that our re-ranking approach leads to significant improvements over the state of the art. Finally, a user study designed to evaluate a practical use case confirms the benefits of our approach.
  • Thumbnail Image
    Item
    Conquering the Cube: Learning to Sketch Primitives in Perspective with an Intelligent Tutoring System
    (Association for Computing Machinery, Inc (ACM), 2017) Keshavabhotla, Swarna; Williford, Blake; Kumar, Shalini; Hilton, Ethan; Taele, Paul; Li, Wayne; Linsey, Julie; Hammond, Tracy; Holger Winnemoeller and Lyn Bartram
    Design sketching is a powerful tool for expressing ideas from pen and paper e ectively and becoming a more well-rounded communicator. Sketching instructors conventionally employ pen and paper in their classrooms to convey these fundamentals to students. However this traditional approach limits the bandwidth and capability of instructors to give timely and individualized feedback. An intelligent tutoring system can leverage the knowledge of domain expert design sketching instructors so that students can practice and receive real-time feedback outside of classroom hours. Our system leverages consulted instructor insights and observed pedagogical practices of an active university design sketching curriculum, and applies them in a mastery-based progression of exercises that utilize sketch recognition to give real-time feedback. An evaluation of our system's usability in a class of engineering students studying design sketching showed that it performed very well, was seen by the students as a motivating and intuitive practice tool, and allowed the students to improve the accuracy and speed of their sketches.
  • Thumbnail Image
    Item
    Flow2Code: From Hand-drawn Flowcharts to Code Execution
    (Association for Computing Machinery, Inc (ACM), 2017) Herrera-Camara, Jorge-Ivan; Hammond, Tracy; Holger Winnemoeller and Lyn Bartram
    Flowcharts play an important role when learning to program by conveying algorithms graphically and making them easy to read and understand. Computer-based owchart design requires the user to learn the so ware rst, which o en results in a steep learning curve. Paper-drawn owcharts don't provide feedback. We propose a system that allows users to draw their owcharts directly on paper combined with a mobile phone app that takes a photo of the owchart, interprets it, and generates and executes the resulting code. Flow2Code uses o -line sketch recognition and computer vision algorithms to recognize owcharts drawn on paper. To gain practice and feedback with owcharts, the user needs only a pencil, white paper, and a mobile device. e paper describes a tested system and algorithmic model for recognizing and interpreting o ine owcharts as well as a novel geometric feature, Axis Aligned Score (AAS), that enables fast accurate recognition of various quadrilaterals.
  • Thumbnail Image
    Item
    Interactive swept surface modeling in virtual reality with motion-tracked controllers
    (Association for Computing Machinery, Inc (ACM), 2017) McGraw, Tim; Garcia, Esteban; Sumner, Drew; Holger Winnemoeller and Lyn Bartram
    In this work we describe an interactive technique which enables gestural curve and surface design in an immersive virtual environment. We use a pair of motion tracked controllers to allow the user to intuitively control a Hermite spline curve which can be swept through space to create surfaces, or to de ne the location and orientation of cloned meshes. A head mounted display and tracked controllers replace the traditional keyboard and mouse for view selection and object interaction. Natural and expressive body motions allow the user to specify the parameters which de ne the curves and surfaces. Results are demonstrated using the HTC Vive VR system.
  • Thumbnail Image
    Item
    A taxonomy of motion applications in data visualization
    (Association for Computing Machinery, Inc (ACM), 2017) Arenas, Irene de la Torre -; Cruz, Pedro; Holger Winnemoeller and Lyn Bartram
    We propose a new taxonomy that explains the roles of motion in data visualization, focusing especially on their communicative aspects. Our taxonomy clarifies the main axis in how visualization designers can employ motion in data portrayal.
  • Thumbnail Image
    Item
    Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations
    (Association for Computing Machinery, Inc (ACM), 2017) Castaneda, Saif; Akleman, Ergun; Holger Winnemoeller and Lyn Bartram
    In this manuscript, we describe a process that can be used to create still and/or animated portrait paintings to be shown in Expressive Art Exhibit. Our process consists of two stages: (1) Creation of control textures for a Barycentric shader by using color information gathered from photographs to provide realistic looking skin rendering; (2) Filtering and compositing the layers of images that are obtained by control textures, which correspond to effects such as diffuse, specular and ambient. To demonstrate proof-of-concept, we have created a few rigid body animations of painterly portraits under different lighting conditions.
  • Thumbnail Image
    Item
    Modeling Go: A mobile sketch-based modeling system for extracting objects
    (Association for Computing Machinery, Inc (ACM), 2017) Lai, Chun-An; Chiang, Pei-Ying; Holger Winnemoeller and Lyn Bartram
    This article presents an easy to use mobile application which allows users to create 3D digital copies of their interested objects anywhere and anytime. An advanced 3-sweep modeling technique is developed to construct 3D primitives not only from generalized cylinder and cuboid, but also objects with symmetrical or non-uniformly scaled profiles. In addition, our system supports the texture and structure refinement which combine results created from multiple source images. The constructed 3D model will be the combination of our 3D primitives. The combined result can preserve more features which may not be seen from a single photo.
  • Thumbnail Image
    Item
    Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces
    (Association for Computing Machinery, Inc (ACM), 2017) Altıok, Ozan Can; Sezgin, Tev k Metin; Holger Winnemoeller and Lyn Bartram
    From a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy speci cation of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insu cient knowledge of how sketching and speech can be used for motion-based video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a Wizard-of-Oz protocol and a set of tools that we have developed to engage users in a sketchand speech-based video retrieval task. We report how the tools and the protocol t together using ''retrieval of soccer videos'' as a use case scenario. Our so ware is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multi-modal use cases.
  • Thumbnail Image
    Item
    Sketch and Shade : An interactive assistant for sketching and shading
    (Association for Computing Machinery, Inc (ACM), 2017) Parakkat, Amal Dev; Joshi, Sarang Anil; Pundarikaksha, Uday Bondi; Muthuganapathy, Ramanathan; Holger Winnemoeller and Lyn Bartram
    We present a drawing assistant for sketching and for assisting users in shading a hand drawn sketch. The augmented reality based system uses a sketch made by a professional and uses it to help inexperienced users to do sketching and shading. The input image is converted to a set of points based on simple heuristics for providing a “connect the dots'' interface for a user to aid sketching. With the help of a 2.5D mesh generated by our algorithm, the system assists the user by providing information about the colors that can be given in different parts of the sketch. The system was tested with users of different age groups and skill levels, indicating its usefulness.