Haouchine, NazimDequidt, JérémieKerrien, ErwanBerger, Marie-OdileCotin, StéphaneJan Bender and Arjan Kuijper and Dieter W. Fellner and Eric Guerin2013-11-082013-11-082012978-3-905673-96-8https://doi.org/10.2312/PE/vriphys/vriphys12/031-038This paper introduces an original method to perform augmented or mixed reality on deformable objects. Compared to state-of-the-art techniques, our method is able to track deformations of volumetric objects and not only surfacic objects. A flexible framework that relies on the combination of a 3D motion estimation and a physicsbased deformable model used as a regularization and interpolation step allows to perform a non-rigid and robust registration. Results are exposed, based on computer-generated datasets and video sequences of real environments in order to assess the relevance of our approach.H.5.1 [Information Interfaces and Presentation]Multimedia Information SystemsArtificialaugmentedand virtual realitiesI.3.5 [Computer Graphics]Computational Geometry and Object ModelingPhysically based modeling