synScan - A Large-Scale Dataset for Instance Level Recognition on Partial Scan Data

Simple item page
dc.contributor.authorBookhahn, Marianen_US
dc.contributor.authorNeumann, Franken_US
dc.contributor.editorFugacci, Uldericoen_US
dc.contributor.editorLavoué, Guillaumeen_US
dc.contributor.editorVeltkamp, Remco C.en_US
dc.date.accessioned2023-08-30T05:51:33Z
dc.date.available2023-08-30T05:51:33Z
dc.date.issued2023
dc.description.abstractDevices supporting depth-sensing technologies become more and more available, making it easier to access geometry-data driven services like 3D model or scene reconstruction. Utilizing these depth sensors, very large datasets have been created to enable deep learning for object detection and depth upsampling. We want to tackle the task of instance level recognition (ILR), where 3D scans of objects can be searched against a database of CAD models based on embeddings of their geometry. The distinctive property of this retrieval task is the existence of only a single corresponding database shape for each query. To the best of our knowledge all the existing datasets either lack in providing the exact CAD model correspondences or lack in scale and a variety of object categories. Therefore, we introduce synScan, a large-scale dataset synthetically generated via physically plausible domain randomization (PPDR) of 3D scenes and object-centric scan trajectories with the goal to mimic real-world object scan scenarios with a variety of incomplete views and occlusions. We provide approximately 39,000 randomly sampled scenes, made from 9,400 different shapes with semantic per-point annotation. We train and test different ILR algorithms (e.g. PointNetVLAD, MinkLoc3Dv2) designed for place-recognition in self-driving cars on the dataset and validate our results on a smaller real-world dataset. Utilizing a rather simple data generation pipeline, we can show that deep learning methods trained on our synthetic dataset can successfully adapt to real-world scan data. In this manner, synScan helps to overcome the lack of labeled training data.en_US
dc.description.sectionheadersShort Papers
dc.description.seriesinformationEurographics Workshop on 3D Object Retrieval
dc.identifier.doi10.2312/3dor.20231149
dc.identifier.isbn978-3-03868-213-4
dc.identifier.issn1997-0471
dc.identifier.pages9-16
dc.identifier.pages8 pages
dc.identifier.urihttps://doi.org/10.2312/3dor.20231149
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/3dor20231149
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Instance-based learning
dc.subjectInstance based learning
dc.titlesynScan - A Large-Scale Dataset for Instance Level Recognition on Partial Scan Dataen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
009-016.pdf
Size:
8.07 MB
Format:
Adobe Portable Document Format
Download
Collections
3DOR 2023 - Short Papers