Gittins index based control policy for a class of pursuit‐evasion problems

Cheng Tan, Changbao Xu, Lin Yang, Wing Shing WongIET 2017 · DOI

Abstract

In this study, the authors develop a novel approach to a class of pursuit‐evasion problems modelled in the form of discrete time feedback control systems, where the opposing parties have asymmetric capability. The authors assume the control policy of the evader, described as a random variable, is unknown to the pursuer. This pursuit‐evasion problem is formulated as a quadratic optimisation problem from the perspective of the pursuer. Due to the curse of dimensionality, this pursuit‐evasion problem cannot be practically solved by dynamic programming. In this study, the authors reformulate it as a multi‐armed bandit problem. A heuristic policy based on the Gittins index is proposed to solve this problem, which can be computed based on a forward induction. Simulation results show the proposed policy outperforms a random decision policy.
BibTeX
@inproceedings{tan2017gittins,
  author = {Cheng Tan and Changbao Xu and Lin Yang and Wing Shing Wong},
  title = {{Gittins index based control policy for a class of pursuit‐evasion problems}},
  booktitle = {IET},
  year = {2017},
  doi = {10.1049/iet-cta.2017.0398},
}

Loading related content...

Figure