AI Based Image Segmentation of Cultural Heritage Objects used for Multi-View Stereo 3D Reconstructions

No Thumbnail Available
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Image segmentation (or masking) finds a very useful use case within 3D reconstruction of cultural heritage objects. The 3D reconstructions can be accelerated, reconstructing the object without any background noise. Conventional segmentation methods can calculate erroneous masks for certain objects and environments, which can lead to errors within the reconstruction: Parts of the 3D reconstruction may be missing or are incorrectly reconstructed, which contradicts adequate archiving. The automated iterative Multi-View Stereo (MVS) scanning process makes it necessary to obtain masks that reconstruct the object in the best possible way, regardless of the environment, the stabilizing mount, the color of the background and the object. In addition, it should not be necessary to tweak the best possible parameters for conventional masking procedures and to create masks manually. State-of-the-art artificial intelligence (AI) segmentation networks will be trained and applied to the MVS scans to verify the behavior of the associated 3D reconstructions and the automated iterative scanning process. In addition, a comparison between different AI segmentation networks and a comparison between conventional masking methods and AI segmentation networks is performed.
Description

CCS Concepts: Computing methodologies → Image segmentation; Reconstruction; Hardware → Scanners

        
@inproceedings{
10.2312:gch.20231160
, booktitle = {
Eurographics Workshop on Graphics and Cultural Heritage
}, editor = {
Bucciero, Alberto
and
Fanini, Bruno
and
Graf, Holger
and
Pescarin, Sofia
and
Rizvic, Selma
}, title = {{
AI Based Image Segmentation of Cultural Heritage Objects used for Multi-View Stereo 3D Reconstructions
}}, author = {
Kutlu, Hasan
and
Brucker, Felix
and
Kallendrusch, Ben
and
Santos, Pedro
and
Fellner, Dieter W.
}, year = {
2023
}, publisher = {
The Eurographics Association
}, ISSN = {
2312-6124
}, ISBN = {
978-3-03868-217-2
}, DOI = {
10.2312/gch.20231160
} }
Citation