Geodesic
Generalized approximation theorem and computational capabilities of neural networks
Sibirskij žurnal vyčislitelʹnoj matematiki, Tome 1 (1998) no. 1, pp. 11-24

Voir la notice de l'article provenant de la source Math-Net.Ru

Computational capabilities of artificial neural networks are studied. In this connection comes up the classical problem on representation of function of several variables by means of superpositions and sums of functions of one variable, and appears a new edition of this problem (using only one arbitrarily chosen nonlinear function of one variable). It has been shown that it is possible to obtain arbitrarily exact approximation of any continuous function of several variables using operations of summation and multiplication by number, superposition of functions, linear functions and one arbitrary continuous nonlinear function of one variable. For polynomials an algebraic variant of the theorem is proved. For neural networks the obtained results mean that the only requirement for activation function of neuron is nonlinearity – and nothing else. 
@article{SJVM_1998_1_1_a2,
     author = {A. N. Gorban'},
     title = {Generalized approximation theorem and computational capabilities of neural networks},
     journal = {Sibirskij \v{z}urnal vy\v{c}islitelʹnoj matematiki},
     pages = {11--24},
     publisher = {mathdoc},
     volume = {1},
     number = {1},
     year = {1998},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/SJVM_1998_1_1_a2/}
}
TY  - JOUR
AU  - A. N. Gorban'
TI  - Generalized approximation theorem and computational capabilities of neural networks
JO  - Sibirskij žurnal vyčislitelʹnoj matematiki
PY  - 1998
SP  - 11
EP  - 24
VL  - 1
IS  - 1
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/SJVM_1998_1_1_a2/
LA  - ru
ID  - SJVM_1998_1_1_a2
ER  - 
%0 Journal Article
%A A. N. Gorban'
%T Generalized approximation theorem and computational capabilities of neural networks
%J Sibirskij žurnal vyčislitelʹnoj matematiki
%D 1998
%P 11-24
%V 1
%N 1
%I mathdoc
%U http://geodesic.mathdoc.fr/item/SJVM_1998_1_1_a2/
%G ru
%F SJVM_1998_1_1_a2
A. N. Gorban'. Generalized approximation theorem and computational capabilities of neural networks. Sibirskij žurnal vyčislitelʹnoj matematiki, Tome 1 (1998) no. 1, pp. 11-24. http://geodesic.mathdoc.fr/item/SJVM_1998_1_1_a2/