Deformed Reality
No Thumbnail Available
Date
2019
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We present Deformed Reality, a new way of interacting with an augmented reality environment by manipulating 3D objects in an intuitive and physically-consistent manner. Using the core principle of augmented reality to estimate rigid pose over time, our method makes it possible for the user to deform the targeted object while it is being rendered with its natural texture, giving the sense of a interactive scene editing. Our framework follows a computationally efficient pipeline that uses a proxy CAD model for both pose computation, physically-based manipulations and scene appearance estimation. The final composition is built upon a continuous image completion and re-texturing process to preserve visual consistency. The presented results show that our method can open new ways of using augmented reality by not only augmenting the environment but also interacting with objects intuitively.
Description
@inproceedings{10.2312:cgvc.20191255,
booktitle = {Computer Graphics and Visual Computing (CGVC)},
editor = {Vidal, Franck P. and Tam, Gary K. L. and Roberts, Jonathan C.},
title = {{Deformed Reality}},
author = {Petit, Antoine and Haouchine, Nazim and Roy, Frederick and Goldman, Daniel B. and Cotin, Stephane},
year = {2019},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-096-3},
DOI = {10.2312/cgvc.20191255}
}