Optimal Control of Uncertain Quantized Linear Discrete-Time Systems

Abstract

In this paper, the adaptive optimal regulator design for unknown quantized linear discrete-time control systems over fixed finite time is introduced. First, to mitigate the quantization error from input and state quantization, dynamic quantizer with time-varying step-size is utilized wherein it is shown that the quantization error will decrease overtime thus overcoming the drawback of the traditional uniform quantizer. Next, to relax the knowledge of system dynamics and achieve optimality, the adaptive dynamic programming methodology is adopted under Bellman's principle by using quantized state and input vector. Because of the time-dependency nature of finite horizon, an adaptive online estimator, which learns a newly defined time-varying action-dependent value function, is updated at each time step so that policy and/or value iterations are not needed. Further, an additional error term corresponding to the terminal constraint is defined and minimized along the system trajectory. The proposed design scheme yields a forward-in-time and online scheme, which enjoys great practical merits. Lyapunov analysis is used to show the boundedness of the closed-loop system; whereas when the time horizon is stretched to infinity as in the case of infinite horizon, asymptotic stability of the closed-loop system is demonstrated. Simulation results on a benchmarking batch reactor system are included to verify the theoretical claims. The net result is the design of the optimal adaptive controller for uncertain quantized linear discrete-time systems in a forward-in-time manner.

Department(s)

Electrical and Computer Engineering

Comments

This work was supported in part by ECCS-1128281 and Intelligent Systems Center.

Keywords and Phrases

Adaptive control systems; Asymptotic stability; Batch reactors; Closed loop systems; Control system synthesis; Design; Digital control systems; Dynamic programming; Linear systems; Social networking (online); Adaptive controllers; Adaptive dynamic programming; Adaptive estimators; Batch reactor systems; Finite horizons; Linear discrete-time systems; Optimal controls; Quantization; Discrete time control systems

International Standard Serial Number (ISSN)

0890-6327; 1099-1115

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2015 John Wiley & Sons, All rights reserved.

Publication Date

01 Mar 2015

Link to Full Text

Share

 
COinS