Approximate Optimal Distributed Control of Uncertain Nonlinear Interconnected Systems with Event-Sampled Feedback
Abstract
In this paper, a novel approximate optimal distributed controller for a class of uncertain nonlinear interconnected system with event-sampled state vector is presented by using approximate dynamic programming (ADP). The event-sampled function approximation property of the neural network (NN) is utilized to generate a solution to the Hamilton-Jacobi-Bellman (HJB) equation and subsequently to obtain an optimal control policy of each subsystem in a forward-in-time manner. To relax the accurate knowledge of subsystem and interconnection dynamics, and input gain matrix, a novel NN identifier with event sampled state vector is designed at each subsystem. An adaptive event sampling condition and novel weight tuning rules for the NN identifier and NN controller using the Lyapunov stability theory are derived. To attain optimality faster, an iterative learning scheme is embedded within the inter-event part of the sampling interval along with time-driven learning at the event sampled instants. Further, the benefit of incorporating exploration in this event sampled framework to improve optimality is discussed along with the challenges involved. The state vector of the interconnected system and the weight estimation errors of the NN identifier and controller are demonstrated to be locally uniformly ultimately bounded (UUB). Finally, the analytical design is verified via simulation.
Recommended Citation
V. Narayanan and J. Sarangapani, "Approximate Optimal Distributed Control of Uncertain Nonlinear Interconnected Systems with Event-Sampled Feedback," Proceedings of the 2016 IEEE 55th Conference on Decision and Control (2016, Las Vegas, NV), pp. 5827 - 5832, Institute of Electrical and Electronics Engineers (IEEE), Dec 2016.
The definitive version is available at https://doi.org/10.1109/CDC.2016.7799165
Meeting Name
2016 IEEE 55th Conference on Decision and Control, CDC (2016: Dec. 12-14, Las Vegas, NV)
Department(s)
Electrical and Computer Engineering
Research Center/Lab(s)
Intelligent Systems Center
International Standard Book Number (ISBN)
978-1-5090-1837-6
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2016 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Dec 2016
Comments
This research supported in part by NSF grants ECCS #1128281 and #1406533 and Intelligent Systems Center, at the Missouri University of Science and Technology, Rolla.