The General Approximation Theorem

Donald C. Wunsch, Missouri University of Science and Technology
Alexander N. Gorban

This document has been relocated to http://scholarsmine.mst.edu/ele_comeng_facwork/1909

There were 8 downloads as of 28 Jun 2016.

Abstract

A general approximation theorem is proved. It uniformly envelopes both the classical Stone theorem and approximation of functions of several variables by means of superpositions and linear combinations of functions of one variable. This theorem is interpreted as a statement on universal approximating possibilities ("approximating omnipotence") of arbitrary nonlinearity. For the neural networks, our result states that the function of neuron activation must be nonlinear, and nothing else