Neural Network-Based Finite-Horizon Optimal Control of Uncertain Affine Nonlinear Discrete-Time Systems
Abstract
In this paper, the finite-horizon optimal control design for nonlinear discrete-time systems in affine form is presented. In contrast with the traditional approximate dynamic programming methodology, which requires at least partial knowledge of the system dynamics, in this paper, the complete system dynamics are relaxed utilizing a neural network (NN)-based identifier to learn the control coefficient matrix. The identifier is then used together with the actor-critic-based scheme to learn the time-varying solution, referred to as the value function, of the Hamilton-Jacobi-Bellman (HJB) equation in an online and forward-in-time manner. Since the solution of HJB is time-varying, NNs with constant weights and time-varying activation functions are considered. To properly satisfy the terminal constraint, an additional error term is incorporated in the novel update law such that the terminal constraint error is also minimized over time. Policy and/or value iterations are not needed and the NN weights are updated once a sampling instant. The uniform ultimate boundedness of the closed-loop system is verified by standard Lyapunov stability theory under nonautonomous analysis. Numerical examples are provided to illustrate the effectiveness of the proposed method.
Recommended Citation
Q. Zhao et al., "Neural Network-Based Finite-Horizon Optimal Control of Uncertain Affine Nonlinear Discrete-Time Systems," IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 3, pp. 486 - 499, Institute of Electrical and Electronics Engineers (IEEE), Mar 2015.
The definitive version is available at https://doi.org/10.1109/TNNLS.2014.2315646
Department(s)
Electrical and Computer Engineering
Keywords and Phrases
Closed loop systems; Digital control systems; Dynamic programming; Numerical methods; System theory; Approximate dynamic programming; Finite horizon optimal control; Finite horizons; Hamilton-Jacobi-Bellman (HJB) equations; Neural network (NN); Nonlinear discrete-time systems; Optimal controls; Uniform ultimate Boundedness; Discrete time control systems; Artificial neural network; Nonlinear system; Time; Uncertainty; Neural Networks (Computer); Nonlinear Dynamics; Time Factors; Uncertainty; Finite-horizon
International Standard Serial Number (ISSN)
2162-237X; 2162-2388
Document Type
Article - Journal
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Mar 2015
