Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry

Pintus, Ruggero; Gobbetti, Enrico; Combet, Roberto

Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry

Files

009-016.pdf (820.91 KB)

Date

2011

Authors

Pintus, Ruggero
Gobbetti, Enrico
Combet, Roberto

Publisher

The Eurographics Association

Abstract

We present a simple, fast and robust technique for semi-automatic 2D-3D registration capable to align a large set of unordered images to a massive point cloud with minimal human effort. Our method converts the hard to solve image-to-geometry registration problem in a Structure-from-Motion (SfM) plus a 3D-3D registration problem. We exploit a SfM framework that, starting just from the unordered image collection, computes an estimate of camera parameters and a sparse 3D geometry deriving from matched image features. We then coarsely register this model to the given 3D geometry by estimating a global scale and absolute orientation using minimal manual intervention. A specialized sparse bundle adjustment (SBA) step, exploiting the correspondence between the model deriving from image features and the fine input 3D geometry, is then used to refine intrinsic and extrinsic parameters of each camera. Output data is suitable for photo blending frameworks to produce seamless colored models. The effectiveness of the method is demonstrated on a series of real-world 3D/2D Cultural Heritage datasets.

        @inproceedings{:10.2312/VAST/VAST11/009-016
,
booktitle = {VAST: International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage
},
editor = {Franco Niccolucci and Matteo Dellepiane and Sebastian Pena Serna and Holly Rushmeier and Luc Van Gool
},
title = {{Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry
}},
author = {Pintus, Ruggero and 
Gobbetti, Enrico and 
Combet, Roberto
},
year = {2011
},
publisher = {The Eurographics Association
},
ISSN = {1811-864X
},
ISBN = {978-3-905674-34-7
},
DOI = {/10.2312/VAST/VAST11/009-016
}
}