On endomorphisms of the additive monoid of subnets of a two-layer neural network

Andrey V. Litavrin

The Bulletin of Irkutsk State University. Series Mathematics, Tome 39 (2022), pp. 111-126

Résumé

Previously, for each multilayer neural network of direct signal propagation (hereinafter, simply a neural network), finite commutative groupoids were introduced, which were called additive subnet groupoids. These groupoids are closely related to the subnets of the neural network over which they are built. A grupoid is a monoid if and only if it is built over a two-layer neural network. Earlier, endomorphisms and their properties were studied for these groupoids. Some endomorphisms were constructed, but an exhaustive element-by-element description was not received. It was shown that every finite monoid is isomorphic to some submonoid of the monoid of all endomorphisms of a suitable additive subnet groupoid for some suitable neural network. In this paper, we study endomorphisms of additive groupoids of subnets of two-layer neural networks. The main result of the work is an element-wise description of the monoid of all endomorphisms of additive monoids of subnets built over a two-layer neural network. The item-by-item description is obtained by constructing a general form of endomorphism. The general view of an endomorphism is parameterized by the endomorphisms of suitable booleans with respect to the union operation. Therefore, endomorphisms of these Booleans were studied in this work. In particular, the semirings of endomorphisms of these Booleans with respect to the union were studied. In addition, to describe the general form of the endomorphism of the additive monoid of subnets, homomorphisms of one Boalean into another (with respect to union) were used.

Détail

Keywords: feedforward multilayer neural network, multilayer neural network subnet.
Mots-clés : groupoid endomorphism

Bibliographie

[1] Glushkov V. M., “Abstract theory of automata”, UMN, 16:5 (1961), 3–62 (in Russian)

[2] Golovko V. A., Krasnoproshin V. V., Neural network technologies for data processing, Publ. house Belarus State University, Minsk, 2017, 263 pp. (in Russian)

[3] Gorban' A.N., “Generalized approximation theorem and computational capabilities of neural networks”, Sib. zhurn. calculated mathematics, 1:1 (1998), 11–24 (in Russian)

[4] Litavrin A. V., “Endomorphisms of finite commutative groupoids related with multilayer feedforward neural networks”, Trudy IMM UrO RAN, 27, no. 1, 2021, 130–145 (in Russian) | DOI

[5] Litinskii L. B., “On the Problem of Decomposition of a Neural Network into Several Subnets”, Mat. modeling, 8:11 (1996), 119–127 (in Russian)

[6] Plotkin B. I., Greenglaz L.Ya., Gvaramia A. A., Elements of the algebraic theory of automata, Higher School Publ, Moscow, 1994, 192 pp. (in Russian)

[7] Slepovichev I. I., “Algebraic properties of abstract neural networks”, Izvestiya Saratov Univ. New series. Series Mathematics. Mechanics. Informatics, 16:1 (2016), 96–103 (in Russian) | DOI

[8] Kravtsova O. V., “Elementary Abelian 2-subgroups in an Autotopism Group of a Semifield Projective Plane”, The Bulletin of Irkutsk State University. Series Mathematics, 32 (2020), 49–63 | DOI

[9] Litavrin A. V., “Endomorphisms of some groupoids of order $k + k^2$”, The Bulletin of the Irkutsk State University. Series Mathematics, 32 (2020), 64–78 | DOI

[10] McCCulloh W., Pitts W., “A logical calculus of the ideas immanent in nervous activity”, Bulletin Math. Biophysics, 1943, no. 5, 115–133

[11] Tsarkov O. I., “Endomorphisms of the semigroup $G_2(r)$ over partially ordered commutative rings without zero divisors and with 1/2”, J. Math. Sc., 201:4 (2014), 534–551

[12] Zhuchok Yu.V., “Endomorphism semigroups of some free products”, J. Math. Sci., 187:2 (2012), 146–152