Joint Critics Mechanism: A Universal Framework for Multi-targets Visual Navigation
Lists
Only you see this
Abstract
Regarding to target-driven visual navigation problem, training a universal value function or policy function approximator is considered to be a fairly difficult task, because there may exits potential conflicts among different targets. When modeling navigation as a goal-conditional reinforcement learning problem, the algorithm can only support a relatively small number of goals, which limits the universality of the reinforcement learning based methods. In this work, we proposed a framework for multi-targets visual navigation, termed Joint Critics Mechanism, to better train the universal policy function approximator. Recognizing that target-specific network has better convergence, we use the target-specific value network to estimate the advantage of the target-universal policy network for better convergence. In this way, we avoid complexity of learning competitive targets and achieve a better convergence with a larger number of targets. For evaluation, we conduct experiments in realistic simulation environments and the results prove the rationality and effectiveness of our proposed framework.
BibTeX
@inproceedings{wang2021joint,
author = {Youzhuo Wang and Wenzhe Zhao and Tian Xia and Nanning Zheng and Pengju Ren},
title = {{Joint Critics Mechanism: A Universal Framework for Multi-targets Visual Navigation}},
booktitle = {IJCNN},
year = {2021},
doi = {10.1109/ijcnn52387.2021.9533723},
}Loading related content...