Abstract
In this paper, direct dynamic programming techniques are utilized to solve the Hamilton Jacobi-Bellman equation forward-in-time for the optimal tracking control of general affine nonlinear discrete-time systems using online approximators (OLA's). the proposed approach, referred as adaptive dynamic programming (ADP), is utilized to solve the infinite horizon optimal tracking control of affine nonlinear discrete-time systems in the presence of unknown internal dynamics and a known control coefficient matrix. the design is implemented using OLA's to realize the optimal feedback control signal and the associated cost function. the feedforward portion of the control input is derived and approximated using an additional OLA for steady state conditions. Novel tuning laws for the OLA's are derived, and all parameters are tuned online. Lyapunov techniques are used to show that all signals are uniformly ultimately bounded (UUB) and that the approximated control signal approaches the optimal control input with small, bounded error. in the ideal case when there are no approximation errors, the approximated control converges to the optimal value asymptotically. Simulation results are included to show the effectiveness of the approach. ©2009 IEEE.
Recommended Citation
T. Dierks and S. Jagannathan, "Optimal Tracking Control of Affine Nonlinear Discrete-time Systems with Unknown Internal Dynamics," Proceedings of the IEEE Conference on Decision and Control, pp. 6750 - 6755, article no. 5399697, Institute of Electrical and Electronics Engineers, Jan 2009.
The definitive version is available at https://doi.org/10.1109/CDC.2009.5399697
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
Keywords and Phrases
Hamilton jacobi-bellman; Online approximators; Online nolinear optimal tracking control
International Standard Book Number (ISBN)
978-142443871-6
International Standard Serial Number (ISSN)
2576-2370; 0743-1546
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2024 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
01 Jan 2009