arXiv Analytics

Sign in

arXiv:1903.00948 [cs.RO]AbstractReferencesReviewsResources

State-Continuity Approximation of Markov Decision Processes via Finite Element Analysis for Autonomous System Planning

Junhong Xu, Kai Yin, Lantao Liu

Published 2019-03-03Version 1

Motion planning under uncertainty for an autonomous system can be formulated as a Markov Decision Process. In this paper, we propose a solution to this decision theoretic planning problem using a continuous approximation of the underlying discrete value function and leveraging finite element methods. This approach allows us to obtain an accurate and continuous form of value function even with a small number of states from a very low resolution of state space. We achieve this by taking advantage of the second order Taylor expansion to approximate the value function, where the value function is modeled as a boundary-conditioned partial differential equation which can be naturally solved using a finite element method. We have validated our approach via extensive simulations, and the evaluations reveal that our solution provides continuous value functions, leading to better path results in terms of path smoothness, travel distance and time costs, even with a smaller state space.

Comments: 8 pages, 8 figures, submitted to IROS 2019
Categories: cs.RO
Related articles: Most relevant | Search more
arXiv:2304.12533 [cs.RO] (Published 2023-04-25)
Suboptimal Controller Synthesis for Cart-Poles and Quadrotors via Sums-of-Squares
arXiv:1806.06134 [cs.RO] (Published 2018-06-15)
Learning 6-DoF Grasping and Pick-Place Using Attention Focus
arXiv:1904.12738 [cs.RO] (Published 2019-04-26)
Self Training Autonomous Driving Agent