Comparing Multi-Armed Bandit Algorithms and Q-learning for Multiagent Action Selection: a Case Study in Route Choice

Thiago B. F. de Oliveira, Ana L. C. Bazzan, Bruno C. da Silva, Ricardo Grunitzki

Abstract

The multi-armed bandit (MAB) problem is concerned with an agent choosing which arm of a slot machine to play in order to optimize its reward. A family of reinforcement learning algorithms exists to tackle this problem, including a few variants that consider more than one agent (thus, characterizing a repeated game) and non-stationary variants. In this paper, we seek to evaluate the performance of some of these MAB algorithms and compare them with Q-learning when applied to a non-stationary repeated game, where commuter agents face the task of learning how to choose a route that minimizes their travel times.
BibTeX
@inproceedings{oliveira2018comparing,
  author = {Thiago B. F. de Oliveira and Ana L. C. Bazzan and Bruno C. da Silva and Ricardo Grunitzki},
  title = {{Comparing Multi-Armed Bandit Algorithms and Q-learning for Multiagent Action Selection: a Case Study in Route Choice}},
  booktitle = {IJCNN},
  year = {2018},
  doi = {10.1109/ijcnn.2018.8489655},
}

Loading related content...

Figure