Learning Body Shape and Pose from Dense Correspondences
Loading...
Date
2020
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
In this paper, we address the problem of learning 3D human pose and body shape from 2D image dataset, without having to use 3D supervisions (body shape and pose) which are in practice difficult to obtain. The idea is to use dense correspondences between image points and a body surface, which can be annotated on in-the-wild 2D images, to extract, aggregate and learn 3D information such as body shape and pose from them. To do so, we propose a training strategy called "deform-and-learn" where we alternate deformable surface registration and training of deep convolutional neural networks (ConvNets). Experimental results showed that our method is comparable to previous semi-supervised techniques that use 3D supervision.
Description
@inproceedings{10.2312:egs.20201012,
booktitle = {Eurographics 2020 - Short Papers},
editor = {Wilkie, Alexander and Banterle, Francesco},
title = {{Learning Body Shape and Pose from Dense Correspondences}},
author = {Yoshiyasu, Yusuke and Gamez, Lucas},
year = {2020},
publisher = {The Eurographics Association},
ISSN = {1017-4656},
ISBN = {978-3-03868-101-4},
DOI = {10.2312/egs.20201012}
}