Journal ArticleDOI
A novel adaptive dynamic programming based on tracking error for nonlinear discrete-time systems
Reads0
Chats0
TLDR
In this article, a novel formulation of the value function is presented for the optimal tracking problem (TP) of nonlinear discrete-time systems, and the optimal control policy can be deduced without considering the reference control input.About:
This article is published in Automatica.The article was published on 2021-07-01. It has received 29 citations till now. The article focuses on the topics: Optimal control & Tracking error.read more
Citations
More filters
Journal ArticleDOI
Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control
TL;DR: In this article , a new cost function is introduced to develop the value-iteration-based adaptive critic framework to solve the tracking control problem, and a novel stability analysis method is developed to guarantee that the tracking error converges to zero.
Journal ArticleDOI
Adaptive-critic-based hybrid intelligent optimal tracking for a class of nonlinear discrete-time systems
TL;DR: In this article, a hybrid intelligent tracking control approach is developed to address optimal tracking problems for a class of nonlinear discrete-time systems, where the generalized value iteration algorithm is utilized to attain the admissible tracking control with off-line training, while the on-line near-optimal control method is established to enhance the control performance.
Journal ArticleDOI
Reinforcement Learning Based Optimal Control of Linear Singularly Perturbed Systems
TL;DR: In this article , an offline model-based algorithm on the basis of Kleinman algorithm to solve the underlying algebraic Riccati equation with singular perturbation parameter and its convergence is proven.
Journal ArticleDOI
Neurodynamic Programming and Tracking Control for Nonlinear Stochastic Systems by PI Algorithm
TL;DR: For nonlinear stochastic systems, the optimal tracking control problem (OTCP) is solved by adaptive dynamic programming (ADP) techniques and by using Lyapunov method, the ultimate uniform boundedness (UUB) of the tracking system is proved.
Journal ArticleDOI
Data-Driven Adaptive Dynamic Programming for Optimal Control of Continuous-Time Multicontroller Systems With Unknown Dynamics
TL;DR: In this article , the optimal control of continuous-time multi-controller systems with completely unknown dynamics using data-driven adaptive dynamic programming (DD-ADP) is investigated, where all controllers take actions together as a team, and they have precisely the same cost function, which is actually a fully cooperative game.
References
More filters
Book
Optimal Control
TL;DR: Reading optimal control frank l lewis solution manual ebook pdf 2019 is extremely useful because you could get enough detailed information in the book technology has.
Journal ArticleDOI
Reinforcement learning and adaptive dynamic programming for feedback control
Frank L. Lewis,Draguna Vrabie +1 more
TL;DR: This work describes mathematical formulations for reinforcement learning and a practical implementation method known as adaptive dynamic programming that give insight into the design of controllers for man-made engineered systems that both learn and exhibit optimal behavior.
Journal ArticleDOI
Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
TL;DR: An online algorithm based on policy iteration for learning the continuous-time optimal control solution with infinite horizon cost for nonlinear systems with known dynamics, which finds in real-time suitable approximations of both the optimal cost and the optimal control policy, while also guaranteeing closed-loop stability.
Journal ArticleDOI
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
TL;DR: It is shown that HDP converges to the optimal control and the optimal value function that solves the Hamilton-Jacobi-Bellman equation appearing in infinite-horizon discrete-time (DT) nonlinear optimal control.
Journal ArticleDOI
Adaptive Dynamic Programming: An Introduction
TL;DR: Some recent research trends within the field of adaptive/approximate dynamic programming (ADP), including the variations on the structure of ADP schemes, the development of ADPs algorithms and applications, and many recent papers have provided convergence analysis associated with the algorithms developed.
Related Papers (5)
Optimal fixed-point tracking control for discrete-time nonlinear systems via ADP
Ruizhuo Song,Liao Zhu +1 more
Linear quadratic tracking control of unknown discrete-time systems using value iteration algorithm
Xiaofeng Li,Lei Xue,Changyin Sun +2 more
An Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines
Tao Sun,Xi-Ming Sun +1 more