Output Feedback-Based Boundary Control of Uncertain Coupled Semilinear Parabolic PDE using Neurodynamic Programming
In this paper, neurodynamic programming-based output feedback boundary control of distributed parameter systems governed by uncertain coupled semilinear parabolic partial differential equations (PDEs) under Neumann or Dirichlet boundary control conditions is introduced. First, Hamilton-Jacobi-Bellman (HJB) equation is formulated in the original PDE domain and the optimal control policy is derived using the value functional as the solution of the HJB equation. Subsequently, a novel observer is developed to estimate the system states given the uncertain nonlinearity in PDE dynamics and measured outputs. Consequently, the suboptimal boundary control policy is obtained by forward-in-time estimation of the value functional using a neural network (NN)-based online approximator and estimated state vector obtained from the NN observer. Novel adaptive tuning laws in continuous time are proposed for learning the value functional online to satisfy the HJB equation along system trajectories while ensuring the closed-loop stability. Local uniformly ultimate boundedness of the closed-loop system is verified by using Lyapunov theory. The performance of the proposed controller is verified via simulation on an unstable coupled diffusion reaction process.
B. Talaei et al., "Output Feedback-Based Boundary Control of Uncertain Coupled Semilinear Parabolic PDE using Neurodynamic Programming," IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 4, pp. 1263-1274, Institute of Electrical and Electronics Engineers (IEEE), Apr 2018.
The definitive version is available at https://doi.org/10.1109/TNNLS.2017.2669941
Electrical and Computer Engineering
Mathematics and Statistics
Intelligent Systems Center
Keywords and Phrases
Closed loop systems; Continuous time systems; Control nonlinearities; Distributed computer systems; Distributed parameter control systems; Uncertainty analysis; Dirichlet boundary controls; Distributed parameter systems; Hamilton-Jacobi-Bellman equations; Neuro dynamic programming; Optimal control policy; Semi-linear parabolic PDE; Semilinear parabolic partial differential equations; Uniformly ultimate boundedness; Feedback; Distributed parameter systems; Dynamic programming; Output feedback; Partial differential equations
International Standard Serial Number (ISSN)
Article - Journal
© 2018 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.