Abstract
In this paper, a novel online reinforcement learning neural network (NN)-based optimal output feedback controller, referred to as adaptive critic controller, is proposed for affine nonlinear discrete-time systems, to deliver a desired tracking performance. The adaptive critic design consist of three entities, an observer to estimate the system states, an action network that produces optimal control input and a critic that evaluates the performance of the action network. The critic is termed adaptive as it adapts itself to output the optimal cost-to-go function which is based on the standard Bellman equation. By using the Lyapunov approach, the uniformly ultimate boundedness (UUB) of the estimation and tracking errors and weight estimates is demonstrated. The effectiveness of the controller is evaluated for the task of nanomanipulation in a simulation environment.
Recommended Citation
Q. Yang and J. Sarangapani, "Near Optimal Neural Network-Based Output Feedback Control of Affine Nonlinear Discrete-Time Systems," Proceedings of the IEEE 22nd International Symposium on Intelligent Control (2007, Singapore), Institute of Electrical and Electronics Engineers (IEEE), Jan 2007.
The definitive version is available at https://doi.org/10.1109/ISIC.2007.4450950
Meeting Name
IEEE 22nd International Symposium on Intelligent Control (2007: Oct. 1-3, Singapore)
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
Sponsor(s)
National Science Foundation (U.S.)
Keywords and Phrases
Control System Synthesis; Lyapunov Methods; Neurocontrollers; Nonlinear Control Systems; Learning Systems
Document Type
Article - Conference proceedings
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2007 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Jan 2007
