Abstract

In this paper, direct dynamic programming techniques are utilized to solve the Hamilton Jacobi-Bellman equation forward-in-time for the optimal tracking control of general affine nonlinear discrete-time systems using online approximators (OLA's). the proposed approach, referred as adaptive dynamic programming (ADP), is utilized to solve the infinite horizon optimal tracking control of affine nonlinear discrete-time systems in the presence of unknown internal dynamics and a known control coefficient matrix. the design is implemented using OLA's to realize the optimal feedback control signal and the associated cost function. the feedforward portion of the control input is derived and approximated using an additional OLA for steady state conditions. Novel tuning laws for the OLA's are derived, and all parameters are tuned online. Lyapunov techniques are used to show that all signals are uniformly ultimately bounded (UUB) and that the approximated control signal approaches the optimal control input with small, bounded error. in the ideal case when there are no approximation errors, the approximated control converges to the optimal value asymptotically. Simulation results are included to show the effectiveness of the approach. ©2009 IEEE.

Department(s)

Electrical and Computer Engineering

Second Department

Computer Science

Keywords and Phrases

Hamilton jacobi-bellman; Online approximators; Online nolinear optimal tracking control

International Standard Book Number (ISBN)

978-142443871-6

International Standard Serial Number (ISSN)

2576-2370; 0743-1546

Document Type

Article - Conference proceedings

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2024 Institute of Electrical and Electronics Engineers, All rights reserved.

Publication Date

01 Jan 2009

Download

Full Text Link

Share

 
COinS