Boundary Control of Linear One-Dimensional Parabolic PDE using Neuro-Dynamic Programming

Abstract

This paper develops a neuro-dynamic programming (NDP) based near optimal boundary control of distributed parameter systems (DPS) governed by linear one-dimensional parabolic partial differential equations (PDE) under Dirichlet boundary control condition. The structure of the optimal cost functional is defined as an extension of its definition from lumped parameter systems (LPS) but for the infinite dimensional state space. Subsequently, the Hamilton-Jacobi-Bellman (HJB) equation is formulated in the infinite dimensional domain without using any model reduction. Since solving the HJB equation for the exact optimal value functional is burdensome, a radial basis function network (RBF) is subsequently proposed to achieve a computationally feasible solution online and in a forward-in time manner. The optimal value functional is tuned by using conventional adaptive laws such that the HJB equation error is minimized and accordingly the optimal control policy is derived. Ultimate boundedness (UB) of the closed-loop system is verified by using the Lyapunov theory. The performance of proposed controller is successfully verified on an unstable diffusion reaction process.

Meeting Name

IEEE Conference on Control and Applications (2015: Sep. 21-23, Sydney, Australia)

Department(s)

Electrical and Computer Engineering

Second Department

Mathematics and Statistics

Research Center/Lab(s)

Center for High Performance Computing Research

Keywords and Phrases

Closed Loop Systems; Distributed Computer Systems; Distributed Parameter Control Systems; Optimal Systems; Radial Basis Function Networks; Structural Optimization; Diffusion-Reaction Process; Dirichlet Boundary Controls; Distributed Parameter Systems; Hamilton-Jacobi-Bellman Equations; Lumped Parameter Systems; Neuro-Dynamic Programming; Optimal Control Policy; Parabolic Partial Differential Equations; Dynamic Programming

Document Type

Article - Conference proceedings

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

01 Sep 2015

Link to Full Text

Share

 
COinS