Learning 3D Deformation of Animals from 2D Images

dc.contributor.authorKanazawa, Angjooen_US
dc.contributor.authorKovalsky, Shaharen_US
dc.contributor.authorBasri, Ronenen_US
dc.contributor.authorJacobs, Daviden_US
dc.contributor.editorJoaquim Jorge and Ming Linen_US
dc.date.accessioned2016-04-26T08:38:40Z
dc.date.available2016-04-26T08:38:40Z
dc.date.issued2016en_US
dc.description.abstractUnderstanding how an animal can deform and articulate is essential for a realistic modification of its 3D model. In this paper, we show that such information can be learned from user-clicked 2D images and a template 3D model of the target animal. We present a volumetric deformation framework that produces a set of new 3D models by deforming a template 3D model according to a set of user-clicked images. Our framework is based on a novel locally-bounded deformation energy, where every local region has its own stiffness value that bounds how much distortion is allowed at that location. We jointly learn the local stiffness bounds as we deform the template 3D mesh to match each user-clicked image. We show that this seemingly complex task can be solved as a sequence of convex optimization problems. We demonstrate the effectiveness of our approach on cats and horses, which are highly deformable and articulated animals. Our framework produces new 3D models of animals that are significantly more plausible than methods without learned stiffness.en_US
dc.description.number2en_US
dc.description.sectionheadersDeformable & Soft Objectsen_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume35en_US
dc.identifier.doi10.1111/cgf.12838en_US
dc.identifier.issn1467-8659en_US
dc.identifier.pages365-374en_US
dc.identifier.urihttps://doi.org/10.1111/cgf.12838en_US
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.3.5 [Computer Graphics]en_US
dc.subjectComputational Geometry and Object Modelingen_US
dc.subjectGeometric algorithmsen_US
dc.subjectlanguagesen_US
dc.subjectand systemsen_US
dc.titleLearning 3D Deformation of Animals from 2D Imagesen_US
Files