Abstract
Solving the Hamilton-Jacobi-Isaacs (HJI) equation, commonly used in ℋ∞ optimal control, is often referred to as a two-player differential game where one player tries to minimize the cost function while the other tries to maximize it. in this paper, the HJI equation is formulated online and forward-in-time using a novel single online approximator (SOLA)-Based scheme to achieve optimal regulation and tracking control of affine nonlinear continuous-time systems. the SOLA-Based adaptive approach is designed to learn the infinite horizon HJI equation, the corresponding optimal control input, and the worst-case disturbance. a novel parameter tuning algorithm is derived which not only achieves the optimal cost function, control input, and the disturbance, but also ensures the system states remain bounded during the online learning. Lyapunov methods are used to show that all signals are uniformly ultimately bounded (UUB) while ensuring the approximated signals approach their optimal values with small, bounded error. in the absence of OLA reconstruction errors, asymptotic convergence to the optimal signals is demonstrated, and simulation results illustrate the effectiveness of the approach. ©2010 IEEE.
Recommended Citation
T. Dierks and S. Jagannathan, "Optimal Control of Affine Nonlinear Continuous-time Systems using an Online Hamilton-Jacobi-Isaacs Formulation," Proceedings of the IEEE Conference on Decision and Control, pp. 3048 - 3053, article no. 5717676, Institute of Electrical and Electronics Engineers, Jan 2010.
The definitive version is available at https://doi.org/10.1109/CDC.2010.5717676
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
International Standard Book Number (ISBN)
978-142447745-6
International Standard Serial Number (ISSN)
2576-2370; 0743-1546
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2024 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
01 Jan 2010