Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand

Kuno, Wakaba; Sugiura, Yuta; Asano, Nao; Kawai, Wataru; Sugimoto, Maki

Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand

Files

041-042.pdf (350.89 KB)

Date

2017

Authors

Kuno, Wakaba
Sugiura, Yuta
Asano, Nao
Kawai, Wataru
Sugimoto, Maki

Publisher

The Eurographics Association

Abstract

We propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. Our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photo-reflective sensors attached to the wearable device. By using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. In our demonstration, users can reflect his / her own finger posture in a virtual environment.

        @inproceedings{10.2312:egve.20171384
,
booktitle = {ICAT-EGVE 2017 - Posters and Demos
},
editor = {Tony Huang and Arindam Dey
},
title = {{Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand
}},
author = {Kuno, Wakaba and 
Sugiura, Yuta and 
Asano, Nao and 
Kawai, Wataru and 
Sugimoto, Maki
},
year = {2017
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-052-9
},
DOI = {10.2312/egve.20171384
}
}