Abstract
Neuro dynamic programming (NDP) techniques for optimal control of nonlinear network control system (NNCS) are not addressed in the literature. Therefore, in this paper, a novel NNCS representation incorporating the unknown system uncertainties and network imperfections is introduced first by using input and output measurements. Then, an online neural network (NN) identifier is introduced to estimate the control coefficient matrix. Subsequently, the critic NN and action NN are employed along with the NN identifier to determine the forward-in-time, time-Based stochastic optimal control of NNCS without using value and policy iterations. Instead, value function and control inputs are updated at every sampling instant. Lyapunov theory is used to show that all the closed-loop signals and NN weights are uniformly ultimately bounded (UUB) while the approximated control input converges close to its target value with time. © 2011 IEEE.
Recommended Citation
H. Xu and S. Jagannathan, "Stochastic Optimal Control Design for Nonlinear Networked Control System Via Neuro Dynamic Programming using Input-output Measurements," Proceedings of the IEEE Conference on Decision and Control, pp. 136 - 141, article no. 6160522, Institute of Electrical and Electronics Engineers, Jan 2011.
The definitive version is available at https://doi.org/10.1109/CDC.2011.6160522
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
International Standard Book Number (ISBN)
978-161284800-6
International Standard Serial Number (ISSN)
2576-2370; 0743-1546
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2024 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
01 Jan 2011
