Adaptive Critic Designs

D V Prokhorov,D C Wunsch

IEEE Transactions on Neural Networks and Learning Systems（1997）CCF BSCI 1区

Dept. of Electr. Eng.

被引用1201|浏览22

摘要

We discuss a variety of adaptive critic designs (ACDs) for neurocontrol. These are suitable for learning in noisy, nonlinear, and nonstationary environments. They have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Our discussion of these origins leads to an explanation of three design families: heuristic dynamic programming, dual heuristic programming, and globalized dual heuristic programming (GDHP). The main emphasis is on DHP and GDHP as advanced ACDs. We suggest two new modifications of the original GDHP design that are currently the only working implementations of GDHP. They promise to be useful for many engineering applications in the areas of optimization and optimal control. Based on one of these modifications, we present a unified approach to all ACDs. This leads to a generalized training procedure for ACDs.

更多

查看译文

关键词

adaptive critic design (ACD),backpropagation,control,DHP,dynamic programming,GDHP,HDP,heuristic dynamic programming,neural network,neurocontrol,reinforcement learning