The Boltzmann distribution in the problem of rational choice by population of a patch under an imperfect information about its resources

A. N. Kirillov ; I. V. Danilova

Modelirovanie i analiz informacionnyh sistem, Tome 30 (2023) no. 3, pp. 234-245.

Résumé

The problem of rational choice by the population of a patch containing energy (nutritive) resources is considered. This problem belongs to the theory of optimal foraging, which, in turn of, studies issues related to the behavior of the population when it leaves the patch or chooses the most suitable one. In order to define the optimal patch choice for population, a variational approach, based on the idea of the Boltzmann distribution is proposed. To construct the probability distribution the utility functions are used, that take into account factors that can influence the patch choice of a population: available information about the quality of patches, the energy utility of patches, the cost of moving to the patch, the cost of information about the quality of patches. The main goal of the paper is to investigate the influence of available information about the amount of resources, contained in patches, on a decision-making process generated by the foragers while a suitable patch choosing. The optimal rationality is determined in the cases taking into account the information cost, the average energy utility of all patches, the rationality depending on the patch. The conditions under which the population, with the lack of information, select the “poor” patch, in sense of its resources, are obtained. The latter provides a theoretical justification of experimental observations, according to which a population can choose a patch with worse quality. The obtained results have a general character and may be used not only in behavioral ecology but when constructing any decision making processes.

Détail

Keywords: Boltzmann distribution, rationality of choice, measure of awareness, information cost, utility function.

Bibliographie

[1] R. B. Aumann, “Rationality and bounded rationality”, Games and econimic behavior, 21:1 (1997), 2-14 | DOI | MR | Zbl

[2] P. A. Ortega, D. A. Braun, J. Dyer, K. Kim, N. Tishby, Information-theoretic bounded rationality, 2015, arXiv: 1512.06789

[3] D. A. Braun, P. A. Ortego, “Information-theoretic bounded rationality and $\varepsilon$-optimality”, Entropy, 16 (2014), 4662-4676 | DOI | MR | Zbl

[4] M. D. Breed, J. Moore, Encyclopedia of animal behavior, Elsevier Ltd., 2019, 889 pp.

[5] E. Kagan, I. Ben-Gal, Search and foraging individual motion and swarm dynamics, Taylor and Francis Group, LLC, 2015, 268 pp. | MR

[6] B. Y. Hayden, M. E. Walton, “Neuroscience of foraging”, Frontiers in Neuroscience, 8 (2014), 81 | DOI

[7] D. L. Barack, S. W. C. Chang, M. L. Platt, “Posterior cingulate neurons dynamically signal decisions to disengage during foraging”, Neuron, 96:2 (2017), 339-347 | DOI

[8] J. S. Greene, M. Brown, M. Dobosiewicz, I. G. Ishida, E. Z. Macosko, X. Zhang, R. A. Butcher, D. J. Cline, P. T. McGrath, C. I. Bargmann, “Balancing selection shapes density-dependent foraging behaviour”, Nature, 539 (2016), 254-258 | DOI

[9] R. Cressman, V. Krivan, “The ideal free distribution as an evolutionarily stable state in density-dependent population games”, Oikos, 119:8 (2010), 1231-1242 | DOI

[10] R. Cressman, V. Krivan, “Two-patch population models with adaptive dispersal: the effects of varying dispersal speeds”, Mathematical Biology, 67 (2013), 329-358 | DOI | MR | Zbl

[11] M. Shuichi, R. Arlinghaus, U. Dieckmann, “Foraging”, Oikos, 119:9 (2010), 1469-1483 | DOI

[12] L. D. Landau, E. M. Lifshitz, Statistical physics, Nauka, 1976, 584 pp. | MR

[13] I. P. Kornfeld, Y. G. Sinai, S. V. Fomin, Ergodic theory, Nauka, 1980, 384 pp. | MR | Zbl

[14] R. Bowen, Methods of symbolic dynamics, Mir, 1979, 244 pp.

[15] C. J. C. H. Watkins, P. Dayan, “Technical note Q-Learning”, Machine Learning, 8:3 (1992), 279-292 | MR | Zbl

[16] A. Kianercy, A. Galstyan, “Dynamics of Boltzmann Q learning in two-player two-action games”, Physical review, 85:4 (2012), 041145

[17] P. A. Ortega, D. A. Braun, “Thermodynamics as a theory of decision-making with information-processing costs”, Proceedings of the Royal Society, 469:2153 (2013), 20120683 | MR | Zbl

[18] S. K. Mitter, N. J. Newton, “Information and entropy flow in the Kalman-Bucy filter”, Journal of Statistical Physics, 118 (2005), 145-176 | DOI | MR | Zbl

[19] P. Pirolli, Information foraging theory, Oxford university press, 2007, 221 pp.

[20] K. Lerman, A. Galstyan, “Mathematical model of foraging in a group of robots: effect of interference”, Autonomous robots, 13 (2002), 127-141 | DOI | Zbl

[21] A. N. Kirillov, I. V. Danilova, “Dynamics of population patch distribution”, Modeling and Analysis of Information Systems, 25:3 (2018), 268-275 (in Russian) | DOI | MR

[22] A. N. Kirillov, I. V. Danilova, “Utility function in the foraging problem with imperfect information”, Information and Control Systems, 105:2 (2020), 71-77

[23] I. V. Danilova, A. N. Kirillov, A. A. Krizhanovsky, “Boltzmann distribution in relation to the problem of population migration”, Proceedings of Voronezh State University. Series: Systems Analysis and Information Technologies, 2020, no. 2, 92-102 (in Russian)