A Recursive Least Squares Training Algorithm for Multilayer Recurrent Neural Networks

Qun Xu
K. Krishnamurthy, Missouri University of Science and Technology
Bruce M. McMillin, Missouri University of Science and Technology
Wen F. Lu

This document has been relocated to http://scholarsmine.mst.edu/mec_aereng_facwork/3343

There were 51 downloads as of 27 Jun 2016.


Recurrent neural networks have the potential to perform significantly better than the commonly used feedforward neural networks due to their dynamical nature. However, they have received less attention because training algorithms/architectures have not been well developed. In this study, a recursive least squares algorithm to train recurrent neural networks with an arbitrary number of hidden layers is developed. The training algorithm is developed as an extension of the standard recursive estimation problem. Simulated results obtained for identification of the dynamics of a nonlinear dynamical system show promising results.