2D-3D Lifting for Shape Reconstruction

dc.contributor.authorNan, Liangliangen_US
dc.contributor.authorSharf, Andreien_US
dc.contributor.authorChen, Baoquanen_US
dc.contributor.editorJ. Keyser, Y. J. Kim, and P. Wonkaen_US
dc.date.accessioned2015-03-03T12:54:01Z
dc.date.available2015-03-03T12:54:01Z
dc.date.issued2014en_US
dc.description.abstractWe present an algorithm for shape reconstruction from incomplete 3D scans by fusing together two acquisition modes: 2D photographs and 3D scans. The two modes exhibit complementary characteristics: scans have depth information, but are often sparse and incomplete; photographs, on the other hand, are dense and have high resolution, but lack important depth information. In this work we fuse the two modes, taking advantage of their complementary information, to enhance 3D shape reconstruction from an incomplete scan with a 2D photograph. We compute geometrical and topological shape properties in 2D photographs and use them to reconstruct a shape from an incomplete 3D scan in a principled manner. Our key observation is that shape properties such as boundaries, smooth patches and local connectivity, can be inferred with high confidence from 2D photographs. Thus, we register the 3D scan with the 2D photograph and use scanned points as 3D depth cues for lifting 2D shape structures into 3D. Our contribution is an algorithm which significantly regularizes and enhances the problem of 3D reconstruction from partial scans by lifting 2D shape structures into 3D. We evaluate our algorithm on various shapes which are loosely scanned and photographed from different views, and compare them with state-of-the-art reconstruction methods.en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.identifier.issn1467-8659en_US
dc.identifier.urihttps://doi.org/10.1111/cgf.12493en_US
dc.publisherThe Eurographics Association and John Wiley and Sons Ltd.en_US
dc.title2D-3D Lifting for Shape Reconstructionen_US
Files
Collections