Memory-Based Parameterized Skills Learning for Mapless Visual Navigation

Yuyang Liu, Yang Cong, Gan SunICIP 2019 · OpenReview

Abstract

The recently-proposed reinforcement learning for mapless visual navigation can generate an optimal policy for searching different targets. However, most state-of-the-art deep reinforcement learning (DRL) models depend on hard rewards to learn the optimal policy, which can lead to the lack of previous diverse experiences. Moreover, these pre-trained DRL models cannot generalize well to un-trained tasks. To overcome these problems above, in this paper, we propose a Memory-based Parameterized Skills Learning (MPSL) model for mapless visual navigation. The parameterized skills in our MPSL are learned to predict critic parameters for un-trained tasks in actor-critic reinforcement learning, which can be achieved by transferring memory sequence knowledge from long short term memory network. In order to generalize into un-trained tasks, MPSL aims to capture more discriminative features by using a scene-specific layer. Finally, experiment results on an indoor photographic simulation framework AI2THOR demonstrate the effectiveness of our proposed MPSL model, and the generalization ability to un-trained tasks.
BibTeX
@inproceedings{liu2019memory,
  author = {Yuyang Liu and Yang Cong and Gan Sun},
  title = {{Memory-Based Parameterized Skills Learning for Mapless Visual Navigation}},
  booktitle = {ICIP},
  year = {2019},
  url = {https://openreview.net/forum?id=f1U9vaJbsf},
}

Loading related content...

Figure