A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. A Lyapunov function proves the uniformly ultimate boundedness (UUB) of the closed-loop tracking error, weight, and observer estimation. Separation principle and certainty equivalence principles are relaxed; persistency of excitation condition and linear in the unknown parameter assumption is not needed. The performance of this controller is evaluated on a spark ignition (SI) engine operating with high exhaust gas recirculation (EGR) levels and experimental results are demonstrated.
P. Shih et al., "Near Optimal Output-Feedback Control of Nonlinear Discrete-Time Systems in Nonstrict Feedback Form with Application to Engines," Proceedings of the International Joint Conference on Neural Networks (2007, Orlando, FL), Institute of Electrical and Electronics Engineers (IEEE), Jan 2007.
The definitive version is available at http://dx.doi.org/10.1109/IJCNN.2007.4370989
2007 International Joint Conference on Neural Networks (2007: Aug. 12-17, Orlando, FL)
Electrical and Computer Engineering
Mechanical and Aerospace Engineering
National Science Foundation (U.S.)
Keywords and Phrases
Lyapunov Methods; Discrete Time Systems; Nonlinear Control Systems; Optimal Control
Article - Conference proceedings
© 2007 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Aerospace Engineering Commons, Computer Sciences Commons, Electrical and Computer Engineering Commons, Mechanical Engineering Commons, Operations Research, Systems Engineering and Industrial Engineering Commons