A Mutual Motion Capture System for Face-to-face Collaboration

Nakamura, Atsuyuki; Kiyokawa, Kiyoshi; Ratsamee, Photchara; Mashita, Tomohiro; Uranishi, Yuki; Takemura, Haruo

A Mutual Motion Capture System for Face-to-face Collaboration

Files

009-016.pdf (1.64 MB)

a.nakamura_icat-egve2017_movie.mp4 (7.45 MB)

Date

2017

Authors

Nakamura, Atsuyuki
Kiyokawa, Kiyoshi
Ratsamee, Photchara
Mashita, Tomohiro
Uranishi, Yuki
Takemura, Haruo

Publisher

The Eurographics Association

Abstract

In recent years, motion capture technology to measure the movement of the body has been used in many fields. Moreover, motion capture targeting multiple people is becoming necessary in multi-user virtual reality (VR) and augmented reality (AR) environments. It is desirable that motion capture requires no wearable devices to capture natural motion easily. Some systems require no wearable devices using an RGB-D camera fixed in the environment, but the user has to stay in front of the fixed the RGB-D camera. Therefore, in this research, proposed is a motion capture technique for a multi-user VR / AR environment using head mounted displays (HMDs), that does not limit the working range of the user nor require any wearable devices. In the proposed technique, an RGB-D camera is attached to each HMD and motion capture is carried out mutually. The motion capture accuracy is improved by modifying the depth image. A prototype system has been implemented to evaluate the effectiveness of the proposed method and motion capture accuracy has been compared with two conditions, with and without depth information correction while rotating the RGB-D camera. As a result, it was confirmed that the proposed method could decrease the number of frames with erroneous motion capture by 49% to 100% in comparison with the case without depth image conversion.

        @inproceedings{10.2312:egve.20171332
,
booktitle = {ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
},
editor = {Robert W. Lindeman and Gerd Bruder and Daisuke Iwai
},
title = {{A Mutual Motion Capture System for Face-to-face Collaboration
}},
author = {Nakamura, Atsuyuki and 
Kiyokawa, Kiyoshi and 
Ratsamee, Photchara and 
Mashita, Tomohiro and 
Uranishi, Yuki and 
Takemura, Haruo
},
year = {2017
},
publisher = {The Eurographics Association
},
ISSN = {1727-530X
},
ISBN = {978-3-03868-038-3
},
DOI = {10.2312/egve.20171332
}
}