Rhijn, Arjen vanMulder, Jurriaan D.Erik Kjems and Roland Blach2014-01-272014-01-272005978-3-905674-06-41727-530Xhttps://doi.org/10.2312/EGVE/IPT_EGVE2005/041-050In this paper, a novel optical tracking and object calibration system is presented for the recognition and pose estimation of tangible interaction devices for virtual and augmented reality systems. The calibration system allows a user to automatically generate models of the relative positions of point-shaped markers attached to interaction devices, simply by moving them in front of the cameras. There are virtually no constraints on the shape of interaction devices. The tracking method takes the calibrated models as input, and recognizes devices by subgraph matching. Both the calibration and tracking methods can handle partial occlusion. Results show the proposed techniques are efficient, accurate, and robust.Categories and Subject Descriptors (according to ACM CCS): I.3.7 [Three-Dimensional Graphics and Realism]: Virtual reality I.4.8 [Image Processing and Computer Vision]: Stereo I.4.8 [Image Processing and Computer Vision]: Tracking