Cola-HRL: Continuous-Lattice Hierarchical Reinforcement Learning for Autonomous Driving
Lists
Only you see this
Abstract
Reinforcement learning (RL) has shown promising performance in autonomous driving applications in recent years. The early end-to-end RL method is usually unexplainable and fails to generate stable actions, while the hierarchical RL (HRL) method can tackle the above issues by dividing complex problems into multiple sub-tasks. Prior HRL works either select discrete driving behaviors with continuous control commands, or generate expected goals for the low-level controller. However, they typically have strong scenario dependence or fail to generate goals with good quality. To address the above challenges, we propose a Continuous-Lattice Hierarchical RL (Cola-HRL) method for autonomous driving tasks to make high-quality decisions in various scenarios. We utilize the continuous-lattice module to generate reasonable goals, ensuring temporal and spatial reachability. Then, we train and evaluate our method under different traffic scenarios based on real-world High Definition maps. Experimental results show our method can handle multiple scenarios. In addition, our method also demonstrates better performance and driving behaviors compared to existing RL methods.
BibTeX
@inproceedings{gao2022cola,
author = {Lingping Gao and Ziqing Gu and Cong Qiu and Lanxin Lei and Shengbo Eben Li and Sifa Zheng and Wei Jing and Junbo Chen},
title = {{Cola-HRL: Continuous-Lattice Hierarchical Reinforcement Learning for Autonomous Driving}},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2022},
doi = {10.1109/iros47612.2022.9982041},
}Loading related content...