Stochastic Optimal Controller Design for Unknown Networked Control System under TCP
Abstract
In this paper, stochastic optimal control design has been considered for linear networked control system (NCS) in the presence of network imperfections such as packet losses and random delays. for evaluating the impact of network reliability on controller performance, Transmission Control Protocol (TCP) is considered with NCS. with uncertain system dynamics and unknown network imperfections, proposed stochastic optimal approach, referred to as adaptive dynamics programming (ADP), uses a novel observer and value function estimator to solve the state estimation and infinite horizon optimal regulation of NCS with the TCP protocol. Update laws for tuning the unknown parameters of novel observer and estimator are derived. Stability region of the linear NCS with and without the adaptive observer is given. Lyapunov theory is used to show that all signals are asymptotically stable (AS) in the mean and the estimated control and observed state signals converge to optimal control inputs and actual states of NCS respectively. Simulation results are included to show the effectiveness of the proposed scheme. © 2012 AACC American Automatic Control Council).
Recommended Citation
H. Xu and S. Jagannathan, "Stochastic Optimal Controller Design for Unknown Networked Control System under TCP," Proceedings of the American Control Conference, pp. 6503 - 6508, article no. 6315009, Institute of Electrical and Electronics Engineers, Nov 2012.
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
International Standard Book Number (ISBN)
978-145771095-7
International Standard Serial Number (ISSN)
0743-1619
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2024 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
26 Nov 2012