Geodesic
Noise Impact on a Recurrent Neural Network with
Russian journal of nonlinear dynamics, Tome 19 (2023) no. 2, pp. 281-293

Voir la notice de l'article provenant de la source Math-Net.Ru

In recent years, more and more researchers in the field of artificial neural networks have been interested in creating hardware implementations where neurons and the connection between them are realized physically. Such networks solve the problem of scaling and increase the speed of obtaining and processing information, but they can be affected by internal noise. In this paper we analyze an echo state neural network (ESN) in the presence of uncorrelated additive and multiplicative white Gaussian noise. Here we consider the case where artificial neurons have a linear activation function with different slope coefficients. We consider the influence of the input signal, memory and connection matrices on the accumulation of noise. We have found that the general view of variance and the signal-to-noise ratio of the ESN output signal is similar to only one neuron. The noise is less accumulated in ESN with a diagonal reservoir connection matrix with a large “blurring” coefficient. This is especially true of uncorrelated multiplicative noise.
Keywords: artificial neural networks, recurrent neural network, echo state network, statistic, white gaussian noise.
Mots-clés : noise, dispersion 
@article{ND_2023_19_2_a8,
     author = {V. M. Moskvitin and N. I. Semenova},
     title = {Noise {Impact} on a {Recurrent} {Neural} {Network} with},
     journal = {Russian journal of nonlinear dynamics},
     pages = {281--293},
     publisher = {mathdoc},
     volume = {19},
     number = {2},
     year = {2023},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/ND_2023_19_2_a8/}
}
TY  - JOUR
AU  - V. M. Moskvitin
AU  - N. I. Semenova
TI  - Noise Impact on a Recurrent Neural Network with
JO  - Russian journal of nonlinear dynamics
PY  - 2023
SP  - 281
EP  - 293
VL  - 19
IS  - 2
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/ND_2023_19_2_a8/
LA  - en
ID  - ND_2023_19_2_a8
ER  - 
%0 Journal Article
%A V. M. Moskvitin
%A N. I. Semenova
%T Noise Impact on a Recurrent Neural Network with
%J Russian journal of nonlinear dynamics
%D 2023
%P 281-293
%V 19
%N 2
%I mathdoc
%U http://geodesic.mathdoc.fr/item/ND_2023_19_2_a8/
%G en
%F ND_2023_19_2_a8
V. M. Moskvitin; N. I. Semenova. Noise Impact on a Recurrent Neural Network with. Russian journal of nonlinear dynamics, Tome 19 (2023) no. 2, pp. 281-293. http://geodesic.mathdoc.fr/item/ND_2023_19_2_a8/