A causal approach to hierarchical decomposition of factored MDPs
Lists
Only you see this
Abstract
We present Variable Influence Structure Analysis, an algorithm that dynamically performs hierarchical decomposition of factored Markov decision processes. Our algorithm determines causal relationships between state variables and introduces temporally-extended actions that cause the values of state variables to change. Each temporally-extended action corresponds to a subtask that is significantly easier to solve than the overall task. Results from experiments show great promise in scaling to larger tasks.
BibTeX
@inproceedings{jonsson2005causal,
author = {Anders Jonsson and Andrew G. Barto},
title = {{A causal approach to hierarchical decomposition of factored MDPs}},
booktitle = {International Conference on Machine Learning},
year = {2005},
doi = {10.1145/1102351.1102402},
}Loading related content...