Learning 3D Shape Aesthetics Globally and Locally

Simple item page
dc.contributor.authorChen, Minchanen_US
dc.contributor.authorLau, Manfreden_US
dc.contributor.editorUmetani, Nobuyukien_US
dc.contributor.editorWojtan, Chrisen_US
dc.contributor.editorVouga, Etienneen_US
dc.date.accessioned2022-10-04T06:41:55Z
dc.date.available2022-10-04T06:41:55Z
dc.date.issued2022
dc.description.abstractThere exist previous works in computing the visual aesthetics of 3D shapes ''globally'', where the term global means that shape aesthetics data are collected for whole 3D shapes and then used to compute the aesthetics of whole 3D shapes. In this paper, we introduce a novel method that takes such ''global'' shape aesthetics data, and learn both a ''global'' shape aesthetics measure that computes aesthetics scores for whole 3D shapes, and a ''local'' shape aesthetics measure that computes to what extent a local region on the 3D shape surface contributes to the whole shape's aesthetics. These aesthetics measures are learned, and hence do not consider existing handcrafted notions of what makes a 3D shape aesthetic. We take a dataset of global pairwise shape aesthetics, where humans compares between pairs of shapes and say which shape from each pair is more aesthetic. Our solution proposes a point-based neural network that takes a 3D shape represented by surface patches as input and jointly outputs its global aesthetics score and a local aesthetics map. To build connections between global and local aesthetics, we embed the global and local features into the same latent space and then output scores with the weights-shared aesthetics predictors. Furthermore, we designed three loss functions to supervise the training jointly. We demonstrate the shape aesthetics results globally and locally to show that our framework can make good global aesthetics predictions while the predicted aesthetics maps are consistent with human perception. In addition, we present several applications enabled by our local aesthetics metric.en_US
dc.description.number7
dc.description.sectionheadersPerception and Visualization
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14702
dc.identifier.issn1467-8659
dc.identifier.pages579-588
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14702
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14702
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies → Shape analysis; Perception
dc.subjectComputing methodologies → Shape analysis
dc.subjectPerception
dc.titleLearning 3D Shape Aesthetics Globally and Locallyen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
v41i7pp579-588.pdf
Size:
8.69 MB
Format:
Adobe Portable Document Format
Download
Collections
41-Issue 7