Exploiting Repetitions for Image-Based Rendering of Facades

dc.contributor.authorRodriguez, Simonen_US
dc.contributor.authorBousseau, Adrienen_US
dc.contributor.authorDurand, Fredoen_US
dc.contributor.authorDrettakis, Georgeen_US
dc.contributor.editorJakob, Wenzel and Hachisuka, Toshiyaen_US
dc.date.accessioned2018-07-01T07:23:07Z
dc.date.available2018-07-01T07:23:07Z
dc.date.issued2018
dc.description.abstractStreet-level imagery is now abundant but does not have sufficient capture density to be usable for Image-Based Rendering (IBR) of facades. We present a method that exploits repetitive elements in facades - such as windows - to perform data augmentation, in turn improving camera calibration, reconstructed geometry and overall rendering quality for IBR. The main intuition behind our approach is that a few views of several instances of an element provide similar information to many views of a single instance of that element. We first select similar instances of an element from 3-4 views of a facade and transform them into a common coordinate system, creating a ''platonic'' element. We use this common space to refine the camera calibration of each view of each instance and to reconstruct a 3D mesh of the element with multi-view stereo, that we regularize to obtain a piecewise-planar mesh aligned with dominant image contours. Observing the same element under multiple views also allows us to identify reflective areas - such as glass panels - which we use at rendering time to generate plausible reflections using an environment map. Our detailed 3D mesh, augmented set of views, and reflection mask enable image-based rendering of much higher quality than results obtained using the input images directly.en_US
dc.description.number4
dc.description.sectionheadersImage-based Techniques
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume37
dc.identifier.doi10.1111/cgf.13480
dc.identifier.issn1467-8659
dc.identifier.pages119-131
dc.identifier.urihttps://doi.org/10.1111/cgf.13480
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13480
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectComputing methodologies
dc.subjectComputer graphics
dc.subjectImage
dc.subjectbased rendering
dc.subjectReconstruction
dc.titleExploiting Repetitions for Image-Based Rendering of Facadesen_US
Files
Collections