Monte carlo bayesian hierarchical reinforcement learning
Lists
Only you see this
Abstract
In this paper, we propose to use hierarchical action decomposition to make Bayesian model-based reinforcement learning more efficient and feasible in practice. We formulate Bayesian hierarchical reinforcement learning as a partially observable semi-Markov decision process (POSMDP). The main POSMDP task is partitioned into a hierarchy of POSMDP subtasks; lower-level subtasks get solved first, then higher-level ones. We sample from a prior belief to build an approximate model for each POSMDP, then solve using Monte Carlo Value Iteration with Macro-Actions solver. Experimental results show that our algorithm performs significantly better than that of flat BRL in terms of both reward, and especially solving time, in at least one order of magnitude.
BibTeX
@inproceedings{vien2014monte,
author = {Ngo Anh Vien and Hung Quoc Ngo and Wolfgang Ertel},
title = {{Monte carlo bayesian hierarchical reinforcement learning}},
booktitle = {AAMAS},
year = {2014},
url = {https://openreview.net/forum?id=ZjdhiZPjTc},
}Loading related content...