Stochastic Optimal Regulation of Nonlinear Networked Control Systems by using Event-Driven Adaptive Dynamic Programming
In this paper, an event-driven stochastic adaptive dynamic programming (ADP)-based technique is introduced for nonlinear systems with a communication network within its feedback loop. A near optimal control policy is designed using an actor-critic framework and ADP with event sampled state vector. First, the system dynamics are approximated by using a novel neural network (NN) identifier with event sampled state vector. The optimal control policy is generated via an actor NN by using the NN identifier and value function approximated by a critic NN through ADP. The stochastic NN identifier, actor, and critic NN weights are tuned at the event sampled instants leading to aperiodic weight tuning laws. Above all, an adaptive event sampling condition based on estimated NN weights is designed by using the Lyapunov technique to ensure ultimate boundedness of all the closed-loop signals along with the approximation accuracy. The net result is event-driven stochastic ADP technique that can significantly reduce the computation and network transmissions. Finally, the analytical design is substantiated with simulation results.
A. Sahoo and J. Sarangapani, "Stochastic Optimal Regulation of Nonlinear Networked Control Systems by using Event-Driven Adaptive Dynamic Programming," IEEE Transactions on Cybernetics, vol. 47, no. 2, pp. 425-438, Institute of Electrical and Electronics Engineers (IEEE), Feb 2017.
The definitive version is available at https://doi.org/10.1109/TCYB.2016.2519445
Electrical and Computer Engineering
Keywords and Phrases
Adaptive control systems; Networked control systems; Neural networks; Nonlinear feedback; Stochastic systems; Telecommunication networks; Adaptive dynamic programming (ADP); Approximation accuracy; Near-optimal control; Network transmission; Nonlinear networked control systems; Novel neural network; Optimal control policy; Ultimate boundedness; Dynamic programming; Event sampled control; Neural networks (NNs); Optimal control
International Standard Serial Number (ISSN)
Article - Journal
© 2017 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.