On Model-free Reinforcement Learning for Switched Linear Systems - A Subspace Clustering Approach.
Allerton(2018)
摘要
In this paper, we study optimal control of switched linear systems using reinforcement learning. Instead of directly applying existing model-free reinforcement learning algorithms, we propose a Q-learning-based algorithm designed specifically for discrete time switched linear systems. Inspired by the analytical results from optimal control literature, the Q function in our algorithm is approximated by a point-wise minimum form of a finite number of quadratic functions. An associated update scheme based on subspace clustering for such an approximation is also developed which preserves the desired structure during the training process. Numerical examples for both low-dimensional and high-dimensional switched linear systems are provided to demonstrate the performance of our algorithm.
更多查看译文
关键词
Switches,Optimal control,Reinforcement learning,Approximation algorithms,Linear systems,Heuristic algorithms,System dynamics
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络