Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking
Lists
Only you see this
Abstract
In the pursuit of autonomous spacecraft proximity maneuvers and docking(PMD), we introduce a novel Bayesian actor-critic reinforcement learning algorithm to learn a control policy with the stability guarantee. The PMD task is formulated as a Markov decision process that reflects the relative dynamic model, the docking cone and the cost function. Drawing from the principles of Lyapunov theory, we frame the temporal difference learning as a constrained Gaussian process regression problem. This innovative approach allows the state-value function to be expressed as a Lyapunov function, leveraging the Gaussian process and deep kernel learning. We develop a novel Bayesian quadrature policy optimization procedure to analytically compute the policy gradient while integrating Lyapunov-based stability constraints. This integration is pivotal in satisfying the rigorous safety demands of spaceflight missions. The proposed algorithm has been experimentally evaluated on a spacecraft air-bearing testbed and shows impressive and promising performance.
BibTeX
@misc{du2023deep,
author = {Desong Du and Naiming Qi and Yanfang Liu and Wei Pan},
title = {{Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking}},
year = {2023},
eprint = {2311.03680},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2311.03680},
}Loading related content...