Augmenting Sampling Based Controllers with Machine Learning
Loading...
Date
2017
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
ACM
Abstract
E cient learning of 3D character control still remains an open problem despite of the remarkable recent advances in the field. We propose a new algorithm that combines planning by a samplingbased model-predictive controller and learning from the planned control, which is very noisy. We combine two methods of learning: 1) immediate but imprecise nearest-neighbor learning, and 2) slower but more precise neural network learning. The nearest neighbor learning allows to rapidly latch on to new experiences whilst the neural network learns more gradually and develops a stable representation of the data. Our experiments indicate that the learners augment each other, and allow rapid discovery and re nement of complex skills such as 3D bipedal locomotion. We demonstrate this in locomotion of 1-, 2- and 4-legged 3D characters under disturbances such as heavy projectile hits and abruptly changing target direction. When augmented with the learners, the sampling based model predictive controller can produce these stable gaits in under a minute on a 4-core CPU. During training the system runs real-time or at interactive frame rates depending on the character complexity.
Description
@inproceedings{10.1145:3099564.3099579,
booktitle = {Eurographics/ ACM SIGGRAPH Symposium on Computer Animation},
editor = {Bernhard Thomaszewski and KangKang Yin and Rahul Narain},
title = {{Augmenting Sampling Based Controllers with Machine Learning}},
author = {Rajamäki, Joose and Hämäläinen, Perttu},
year = {2017},
publisher = {ACM},
ISSN = {1727-5288},
ISBN = {978-1-4503-5091-4},
DOI = {10.1145/3099564.3099579}
}