ReLVis: Visual Analytics for Situational Awareness During Reinforcement Learning Experimentation
Loading...
Date
2019
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Reinforcement learning (RL) is a branch of machine learning where an agent learns to maximize reward through trial and error. RL is challenging and data/compute intensive leading practitioners to become overwhelmed and make poor modeling decisions. Our contribution is a Visual Analytics tool designed to help data scientists maintain situation awareness during RL experimentation. Our tool allows users to understand which hyper-parameter values lead to better or worse outcomes, what behaviors are associated with high and low reward, and how behaviors evolve throughout training. We evaluated our tool through three uses cases using state of the art deep RL models demonstrating how our tool leads to RL situation awareness.
Description
@inproceedings{10.2312:evs.20191168,
booktitle = {EuroVis 2019 - Short Papers},
editor = {Johansson, Jimmy and Sadlo, Filip and Marai, G. Elisabeta},
title = {{ReLVis: Visual Analytics for Situational Awareness During Reinforcement Learning Experimentation}},
author = {Saldanha, Emily and Praggastis, Brenda and Billow, Todd and Arendt, Dustin L.},
year = {2019},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-090-1},
DOI = {10.2312/evs.20191168}
}