Superior Performance of Using Hyperbolic Sine Activation Functions in ZNN Illustrated via Time-Varying Matrix Square Roots Finding
Computer Science and Information Systems, Tome 9 (2012) no. 4.

Voir la notice de l'article provenant de la source Computer Science and Information Systems website

A special class of recurrent neural network (RNN), termed Zhang neural network (ZNN) depicted in the implicit dynamics, has recently been proposed for online solution of time-varying matrix square roots. Such a ZNNmodel can be constructed by using monotonically-increasing odd activation functions to obtain the theoretical time-varying matrix square roots in an error-free manner. Different choices of activation function arrays may lead to different performance of the ZNN model. Generally speaking, ZNN model using hyperbolic sine activation functions may achieve better performance, as compared with those using other activation functions. In this paper, to pursue the superior convergence and robustness properties, hyperbolic sine activation functions are applied to the ZNN model for online solution of time-varying matrix square roots. Theoretical analysis and computer-simulation results further demonstrate the superior performance of the ZNN model using hyperbolic sine activation functions in the context of large model-implementation errors, in comparison with that using linear activation functions.
Keywords: Zhang neural network, global exponential convergence, hyperbolic sine activation functions, time-varying matrix square roots, implementation errors
@article{CSIS_2012_9_4_a12,
     author = {Yunong Zhang and Long Jin and Zhende Ke},
     title = {Superior {Performance} of {Using} {Hyperbolic} {Sine} {Activation} {Functions} in {ZNN} {Illustrated} via {Time-Varying} {Matrix} {Square} {Roots} {Finding}},
     journal = {Computer Science and Information Systems},
     publisher = {mathdoc},
     volume = {9},
     number = {4},
     year = {2012},
     url = {http://geodesic.mathdoc.fr/item/CSIS_2012_9_4_a12/}
}
TY  - JOUR
AU  - Yunong Zhang
AU  - Long Jin
AU  - Zhende Ke
TI  - Superior Performance of Using Hyperbolic Sine Activation Functions in ZNN Illustrated via Time-Varying Matrix Square Roots Finding
JO  - Computer Science and Information Systems
PY  - 2012
VL  - 9
IS  - 4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/CSIS_2012_9_4_a12/
ID  - CSIS_2012_9_4_a12
ER  - 
%0 Journal Article
%A Yunong Zhang
%A Long Jin
%A Zhende Ke
%T Superior Performance of Using Hyperbolic Sine Activation Functions in ZNN Illustrated via Time-Varying Matrix Square Roots Finding
%J Computer Science and Information Systems
%D 2012
%V 9
%N 4
%I mathdoc
%U http://geodesic.mathdoc.fr/item/CSIS_2012_9_4_a12/
%F CSIS_2012_9_4_a12
Yunong Zhang; Long Jin; Zhende Ke. Superior Performance of Using Hyperbolic Sine Activation Functions in ZNN Illustrated via Time-Varying Matrix Square Roots Finding. Computer Science and Information Systems, Tome 9 (2012) no. 4. http://geodesic.mathdoc.fr/item/CSIS_2012_9_4_a12/