Boundary Control of Linear One-Dimensional Parabolic PDE using Neuro-Dynamic Programming
This paper develops a neuro-dynamic programming (NDP) based near optimal boundary control of distributed parameter systems (DPS) governed by linear one-dimensional parabolic partial differential equations (PDE) under Dirichlet boundary control condition. The structure of the optimal cost functional is defined as an extension of its definition from lumped parameter systems (LPS) but for the infinite dimensional state space. Subsequently, the Hamilton-Jacobi-Bellman (HJB) equation is formulated in the infinite dimensional domain without using any model reduction. Since solving the HJB equation for the exact optimal value functional is burdensome, a radial basis function network (RBF) is subsequently proposed to achieve a computationally feasible solution online and in a forward-in time manner. The optimal value functional is tuned by using conventional adaptive laws such that the HJB equation error is minimized and accordingly the optimal control policy is derived. Ultimate boundedness (UB) of the closed-loop system is verified by using the Lyapunov theory. The performance of proposed controller is successfully verified on an unstable diffusion reaction process.
B. Talaei et al., "Boundary Control of Linear One-Dimensional Parabolic PDE using Neuro-Dynamic Programming," Proceedings of the 2015 IEEE Conference on Control and Applications (2015, Sydney, Australia), Institute of Electrical and Electronics Engineers (IEEE), Sep 2015.
The definitive version is available at http://dx.doi.org/10.1109/CCA.2015.7320691
IEEE Conference on Control and Applications (2015: Sep. 21-23, Sydney, Australia)
Electrical and Computer Engineering
Mathematics and Statistics
Center for High Performance Computing Research
Keywords and Phrases
Closed Loop Systems; Distributed Computer Systems; Distributed Parameter Control Systems; Optimal Systems; Radial Basis Function Networks; Structural Optimization; Diffusion-Reaction Process; Dirichlet Boundary Controls; Distributed Parameter Systems; Hamilton-Jacobi-Bellman Equations; Lumped Parameter Systems; Neuro-Dynamic Programming; Optimal Control Policy; Parabolic Partial Differential Equations; Dynamic Programming
Article - Conference proceedings
© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.