Learning mechanism for a collective classifier based on competition driven by training examples

A. A. Sutyagin ; O. I. Kanakov

Izvestiya VUZ. Applied Nonlinear Dynamics, Tome 32 (2024) no. 2, pp. 160-179.

Résumé

The purpose of this work is to modify the learning mechanism of a collective classifier in order to provide learning by population dynamics alone, without requiring an external sorting device. A collective classifier is an ensemble of non-identical simple elements, which do not have any intrinsic dynamics neither variable parameters; the classifier admits learning by adjusting the composition of the ensemble, which was provided in the preceding literature by selecting the ensemble elements using a sorting device. Methods. The population dynamics model of a collective classifier is extended by adding a "learning subsystem", which is controlled by a sequence of training examples and, in turn, controls the strength of intraspecific competition in the population dynamics. The learning subsystem dynamics is reduced to a linear mapping with random parameters expressed via training examples. The solution to the mapping is an asymptotically stationary Markovian random process, for which we analytically find asymptotic expectation and show its variance to vanish in the limit under the specified assumptions, thus allowing an approximate deterministic description of the coupled population dynamics based on available results from the preceding literature. Results. We show analytically and illustrate it by numerical simulation that the decision rule of our classifier in the course of learning converges to the Bayesian rule under assumptions which are essentially in line with available literature on collective classifiers. The implementation of the required competitive dynamics does not require an external sorting device. Conclusion. We propose a conceptual model for a collective classifier, whose learning is fully provided by its own population dynamics. We expect that our classifier, similarly to the approaches taken in the preceding literature, can be implemented as an ensemble of living cells equipped with synthetic genetic circuits, when a mechanism of population dynamics with synthetically controlled intraspecific competition becomes available.

Détail

Keywords: competition, machine learning, classifier, Lotka-Volterra model

Bibliographie

[1] Aivazyan S. A., Bukhshtaber V. M., Enyukov I. S., Meshalkin L. D., Prikladnaya statistika: Klassifikatsiya i snizhenie razmernosti, Finansy i statistika, M., 1989, 608 pp. | MR

[2] Alpaydin E., Introduction to Machine Learning, MIT Press, Fourth Edition Cambridge, Massachusetts, 2020, 683 pp. | MR

[3] Sutyagin A. A., Kanakov O. I., “Metod obucheniya kollektivnogo klassifikatora na osnove konkurentsii v rezhime sosuschestvovaniya”, Izvestiya vuzov. PND, 29:2 (2021), 220–239 | DOI | MR

[4] Didovyk A., Kanakov O. I., Ivanchenko M. V., Hasty J., Huerta R., Tsimring L., “Distributed classifier based on genetically engineered bacterial cell cultures”, ACS Synthetic Biology, 4:1 (2015), 72–82 | DOI

[5] Kanakov O., Kotelnikov R., Alsaedi A., Tsimring L., Huerta R., Zaikin A., Ivanchenko M., “Multi-input distributed classifiers for synthetic genetic circuits”, PLoS ONE, 10:5 (2015), e0125144 | DOI

[6] Goh B. S., “Global stability in many-species systems”, The American Naturalist, 111:977 (1977), 135–143 | DOI | MR

[7] Gnedenko B. V., Kurs teorii veroyatnostei, LENAND, M., 2022, 456 pp. | MR