Too Stiff, Too Strong, Too Smart: Evaluating Fundamental Problems with Motion Control Policies
No Thumbnail Available
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
ACM Association for Computing Machinery
Abstract
Deep reinforcement learning (DRL) methods have demonstrated impressive results for skilled motion synthesis of physically based characters, and while these methods perform well in terms of tracking reference motions or achieving complex tasks, several concerns arise when evaluating the naturalness of the motion. In this paper, we conduct a preliminary study of specific quantitative metrics for measuring the naturalness of motion produced by DRL control policies beyond their visual appearance. Namely, we propose to study the stiffness of the control policy, in anticipation that it will influence how the character behaves in the presence of external perturbation. Second, we establish two baselines for strength that allow evaluating the use of joint torques in comparison to human performance. Third, we propose the study of variability to reveal the unnatural precision of control policies and how they compare to real human motion. In sum, we aim to establish repeatable measures to assess the naturalness of control policies produced by DRL methods, and we present a set of comparisons from state-of-the-art systems. Finally, we propose simple modifications to improve realism on these axes.
Description
@inproceedings{10.1145:3606935,
booktitle = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
editor = {Wang, Huamin and Ye, Yuting and Victor Zordan},
title = {{Too Stiff, Too Strong, Too Smart: Evaluating Fundamental Problems with Motion Control Policies}},
author = {Xie, Kaixiang and Xu, Pei and Andrews, Sheldon and Zordan, Victor B. and Kry, Paul G.},
year = {2023},
publisher = {ACM Association for Computing Machinery},
ISSN = {2577-6193},
ISBN = {},
DOI = {10.1145/3606935}
}