Abstract
This article intends to address an online optimal adaptive regulation of nonlinear discrete-time systems in affine form and with partially uncertain dynamics using a multilayer neural network (MNN). The actor-critic framework estimates both the optimal control input and value function. Instantaneous control input error and temporal difference are used to tune the weights of the critic and actor networks, respectively. The selection of the basis functions and their derivatives are not required in the proposed approach. The state vector, critic, and actor NN weights are proven to be bounded using the Lyapunov method. Our approach can be extended to neural networks with an arbitrary number of hidden layers. We have demonstrated our approach via a simulation example.
Recommended Citation
R. Moghadam et al., "Online Optimal Adaptive Control of Partially Uncertain Nonlinear Discrete-Time Systems using Multilayer Neural Networks," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 9, pp. 4840 - 4850, Institute of Electrical and Electronics Engineers, Sep 2022.
The definitive version is available at https://doi.org/10.1109/TNNLS.2021.3061414
Department(s)
Electrical and Computer Engineering
Keywords and Phrases
Multilayer neural network (MNN); optimal adaptive control (OAC); temporal difference error (TDE)
International Standard Serial Number (ISSN)
2162-2388; 2162-237X
Document Type
Article - Journal
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
01 Sep 2022
PubMed ID
33710960
