Temporally Consistent Motion Segmentation From RGB‐D Video

dc.contributor.authorBertholet, P.en_US
dc.contributor.authorIchim, A.E.en_US
dc.contributor.authorZwicker, M.en_US
dc.contributor.editorChen, Min and Benes, Bedrichen_US
dc.date.accessioned2018-08-29T06:56:01Z
dc.date.available2018-08-29T06:56:01Z
dc.date.issued2018
dc.description.abstractTemporally consistent motion segmentation from RGB‐D videos is challenging because of the limitations of current RGB‐D sensors. We formulate segmentation as a motion assignment problem, where a motion is a sequence of rigid transformations through all frames of the input. We capture the quality of each potential assignment by defining an appropriate energy function that accounts for occlusions and a sensor‐specific noise model. To make energy minimization tractable, we work with a discrete set instead of the continuous, high dimensional space of motions, where the discrete motion set provides an upper bound for the original energy. We repeatedly minimize our energy, and in each step extend and refine the motion set to further lower the bound. A quantitative comparison to the current state of the art demonstrates the benefits of our approach in difficult scenarios.Temporally consistent motion segmentation from RGB‐D videos is challenging because of the limitations of current RGB‐D sensors. We formulate segmentation as a motion assignment problem, where a motion is a sequence of rigid transformations through all frames of the input. We capture the quality of each potential assignment by defining an appropriate energy function that accounts for occlusions and a sensor‐specific noise model. To make energy minimization tractable, we work with a discrete set instead of the continuous, high dimensional space of motions, where the discrete motion set provides an upper bound for the original energy. We repeatedly minimize our energy, and in each step extend and refine the motion set to further lower the bound. A quantitative comparison to the current state of the art demonstrates the benefits of our approach in difficult scenarios.en_US
dc.description.number6
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume37
dc.identifier.doi10.1111/cgf.13316
dc.identifier.issn1467-8659
dc.identifier.pages118-134
dc.identifier.urihttps://doi.org/10.1111/cgf.13316
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13316
dc.publisher© 2018 The Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectimage and video processing
dc.subjectvideo segmentation
dc.subjectimage and video processing
dc.subjectobject scanning/acquisition
dc.subjectmodelling
dc.subjectCategories and Subject Descriptors (according to ACM CCS): I.3.3 [Computer Graphics]: Picture/Image Generation—Line and curve generation
dc.titleTemporally Consistent Motion Segmentation From RGB‐D Videoen_US
Files
Collections