Exploiting Repetitions for Image-Based Rendering of Facades
dc.contributor.author | Rodriguez, Simon | en_US |
dc.contributor.author | Bousseau, Adrien | en_US |
dc.contributor.author | Durand, Fredo | en_US |
dc.contributor.author | Drettakis, George | en_US |
dc.contributor.editor | Jakob, Wenzel and Hachisuka, Toshiya | en_US |
dc.date.accessioned | 2018-07-01T07:23:07Z | |
dc.date.available | 2018-07-01T07:23:07Z | |
dc.date.issued | 2018 | |
dc.description.abstract | Street-level imagery is now abundant but does not have sufficient capture density to be usable for Image-Based Rendering (IBR) of facades. We present a method that exploits repetitive elements in facades - such as windows - to perform data augmentation, in turn improving camera calibration, reconstructed geometry and overall rendering quality for IBR. The main intuition behind our approach is that a few views of several instances of an element provide similar information to many views of a single instance of that element. We first select similar instances of an element from 3-4 views of a facade and transform them into a common coordinate system, creating a ''platonic'' element. We use this common space to refine the camera calibration of each view of each instance and to reconstruct a 3D mesh of the element with multi-view stereo, that we regularize to obtain a piecewise-planar mesh aligned with dominant image contours. Observing the same element under multiple views also allows us to identify reflective areas - such as glass panels - which we use at rendering time to generate plausible reflections using an environment map. Our detailed 3D mesh, augmented set of views, and reflection mask enable image-based rendering of much higher quality than results obtained using the input images directly. | en_US |
dc.description.number | 4 | |
dc.description.sectionheaders | Image-based Techniques | |
dc.description.seriesinformation | Computer Graphics Forum | |
dc.description.volume | 37 | |
dc.identifier.doi | 10.1111/cgf.13480 | |
dc.identifier.issn | 1467-8659 | |
dc.identifier.pages | 119-131 | |
dc.identifier.uri | https://doi.org/10.1111/cgf.13480 | |
dc.identifier.uri | https://diglib.eg.org:443/handle/10.1111/cgf13480 | |
dc.publisher | The Eurographics Association and John Wiley & Sons Ltd. | en_US |
dc.subject | Computing methodologies | |
dc.subject | Computer graphics | |
dc.subject | Image | |
dc.subject | based rendering | |
dc.subject | Reconstruction | |
dc.title | Exploiting Repetitions for Image-Based Rendering of Facades | en_US |