Stochastic Decision Making in Learning Classifier Systems through a Natural Policy Gradient Method

Gang Chen, Mengjie Zhang, Shaoning Pang, Colin DouchICONIP 2014 · OpenReview

Abstract

Learning classifier systems (LCSs) are rule-based machine learning technologies designed to learn optimal decision-making policies in the form of a compact set of maximally general and accurate rules. A study of the literature reveals that most of the existing LCSs focused primarily on learning deterministic policies. However a desirable policy may often be stochastic, in particular when the environment is partially observable. To fill this gap, based on XCS, which is one of the most successful accuracy-based LCSs, a new Michigan-style LCS called Natural XCS (i.e. NXCS) is proposed in this paper. NXCS enables direct learning of stochastic policies by utilizing a natural gradient learning technology under a policy gradient framework. Its effectiveness is experimentally compared with XCS and one of its variation known as XCS μ in this paper. Our results show that NXCS can achieve competitive performance in both deterministic and stochastic multi-step problems.
BibTeX
@inproceedings{chen2014stochastic,
  author = {Gang Chen and Mengjie Zhang and Shaoning Pang and Colin Douch},
  title = {{Stochastic Decision Making in Learning Classifier Systems through a Natural Policy Gradient Method}},
  booktitle = {ICONIP},
  year = {2014},
  url = {https://openreview.net/forum?id=bNt_z_H9vbJ},
}

Loading related content...

Figure