Stochastic Decision Making in Learning Classifier Systems through a Natural Policy Gradient Method
Lists
Only you see this
Abstract
Learning classifier systems (LCSs) are rule-based machine learning technologies designed to learn optimal decision-making policies in the form of a compact set of maximally general and accurate rules. A study of the literature reveals that most of the existing LCSs focused primarily on learning deterministic policies. However a desirable policy may often be stochastic, in particular when the environment is partially observable. To fill this gap, based on XCS, which is one of the most successful accuracy-based LCSs, a new Michigan-style LCS called Natural XCS (i.e. NXCS) is proposed in this paper. NXCS enables direct learning of stochastic policies by utilizing a natural gradient learning technology under a policy gradient framework. Its effectiveness is experimentally compared with XCS and one of its variation known as XCS μ in this paper. Our results show that NXCS can achieve competitive performance in both deterministic and stochastic multi-step problems.
BibTeX
@inproceedings{chen2014stochastic,
author = {Gang Chen and Mengjie Zhang and Shaoning Pang and Colin Douch},
title = {{Stochastic Decision Making in Learning Classifier Systems through a Natural Policy Gradient Method}},
booktitle = {ICONIP},
year = {2014},
url = {https://openreview.net/forum?id=bNt_z_H9vbJ},
}Loading related content...