Abstract
A novel reinforcement-learning-based dual-control methodology adaptive neural network (NN) controller is developed to deliver a desired tracking performance for a class of complex feedback nonlinear discrete-time systems, which consists of a second-order nonlinear discrete-time system in nonstrict feedback form and an affine nonlinear discrete-time system, in the presence of bounded and unknown disturbances. For example, the exhaust gas recirculation (EGR) operation of a spark ignition (SI) engine is modeled by using such a complex nonlinear discrete-time system. A dual-controller approach is undertaken where primary adaptive critic NN controller is designed for the nonstrict feedback nonlinear discrete-time system whereas the secondary one for the affine nonlinear discrete-time system but the controllers together offer the desired performance. The primary adaptive critic NN controller includes an NN observer for estimating the states and output, an NN critic, and two action NNs for generating virtual control and actual control inputs for the nonstrict feedback nonlinear discrete-time system, whereas an additional critic NN and an action NN are included for the affine nonlinear discrete-time system by assuming the state availability. All NN weights adapt online towards minimization of a certain performance index, utilizing gradient-descent-based rule. Using Lyapunov theory, the uniformly ultimate boundedness (UUB) of the closed-loop tracking error, weight estimates, and observer estimates are shown. The adaptive critic NN controller performance is evaluated on an SI engine operating with high EGR levels where the controller objective is to reduce cyclic dispersion in heat release while minimizing fuel intake. Simulation and experimental results indicate that engine out emissions drop significantly at 20% EGR due to reduction in dispersion in heat release thus verifying the dual-control approach.
Recommended Citation
P. Shih et al., "Reinforcement Learning Based Dual-Control Methodology for Complex Nonlinear Discrete-Time Systems with Application to Spark Engine EGR Operation," IEEE Transactions on Neural Networks, Institute of Electrical and Electronics Engineers (IEEE), Aug 2008.
The definitive version is available at https://doi.org/10.1109/TNN.2008.2000452
Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
Third Department
Mechanical and Aerospace Engineering
Sponsor(s)
National Science Foundation (U.S.)
Keywords and Phrases
Lyapunov Theory; Adaptive Critic Design; Cyclic Dispersion; Exhaust Gas Recirculation; Feedback Control; Learning (Artificial Intelligence); Near-Optimal Control; Nonstrict Feedback Nonlinear Discrete-Time System; Separation Principle; Uniformly Ultimate Boundedness
International Standard Serial Number (ISSN)
1045-9227
Document Type
Article - Journal
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2008 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Aug 2008
Included in
Aerospace Engineering Commons, Electrical and Computer Engineering Commons, Mechanical Engineering Commons, Operations Research, Systems Engineering and Industrial Engineering Commons
