Reconstructing 3D Face of Infants in Social Interactions Using Morphable Models of Non-Infants

Simple item page
dc.contributor.authorSariyanidi, Evangelosen_US
dc.contributor.authorZampella, Casey J.en_US
dc.contributor.authorDrye, Madison N.en_US
dc.contributor.authorFecher, Madison L.en_US
dc.contributor.authorMagginson, Graceen_US
dc.contributor.authorCubit, Laura Soskeyen_US
dc.contributor.authorSchultz, Robert T.en_US
dc.contributor.authorGuthrie, Whitneyen_US
dc.contributor.authorTunc, Birkanen_US
dc.contributor.editorBerretti, Stefanoen_US
dc.contributor.editorThehoaris, Theoharisen_US
dc.contributor.editorDaoudi, Mohameden_US
dc.contributor.editorFerrari, Claudioen_US
dc.contributor.editorVeltkamp, Remco C.en_US
dc.date.accessioned2022-08-31T07:10:18Z
dc.date.available2022-08-31T07:10:18Z
dc.date.issued2022
dc.description.abstract3D morphable models (3DMMs) simultaneously reconstruct facial morphology, expression and pose from 2D images, and thus could be an invaluable tool for capturing and characterizing the face and facial behavior in early childhood. However, 3DMM fitting on infants is a largely unexplored problem. All publicly available 3DMMs are developed for adults, and it is unclear if and to what extent they can be used on videos of infants. In this paper, we compare five state-of-the-art 3DMM fitting methods on data from naturalistic infant-caregiver interactions. Results suggest that it is possible to produce consistent and subject-specific reconstructions of 3D shape identity from multiple frames, but not from a single frame. Qualitative evaluation highlights that facial regions with high texture variation, such as eyes, brows and mouth, are captured with higher accuracy compared to the rest of the face. Thus, even though a 3DMM developed for adults has significant limitations when reconstructing the morphology of the entire facial region of infants, applications that involve analysis of facial behavior can be feasible. Our encouraging results, combined with the unique ability of 3DMMs to disentangle two major sources of noise for expression analysis (i.e., identity bias and pose variations), motivate future research on using 3DMMs to measure the facial behavior of infants.en_US
dc.description.sectionheadersShort Papers
dc.description.seriesinformationEurographics Workshop on 3D Object Retrieval
dc.identifier.doi10.2312/3dor.20221178
dc.identifier.isbn978-3-03868-174-8
dc.identifier.issn1997-0471
dc.identifier.pages1-8
dc.identifier.pages8 pages
dc.identifier.urihttps://doi.org/10.2312/3dor.20221178
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/3dor20221178
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Human-centered computing → Empirical studies in HCI; Computing methodologies → Shape representations
dc.subjectHuman centered computing → Empirical studies in HCI
dc.subjectComputing methodologies → Shape representations
dc.titleReconstructing 3D Face of Infants in Social Interactions Using Morphable Models of Non-Infantsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
001-008.pdf
Size:
10.46 MB
Format:
Adobe Portable Document Format
Download
Collections
3DOR 2022 - Short Papers