Integrated information and its application for analysis of brain neuron activity

I. A. Nazhestkin ; O. E. Svarnik

Izvestiya VUZ. Applied Nonlinear Dynamics, Tome 31 (2023) no. 2, pp. 180-201.

Résumé

Purpose of this review is to consider the possibility to apply the integrated information theory to investigate the brain neural activity. Earlier was shown that the integrated information amount Ф quantifies a degree of a dynamic complexity of a system and able to predict a level of its success defined by classic observable benchmarks. For this reason, a question arises about the application of the integrated information theory to analyse changes in brain spiking activity due the acquisition of new experience. Conclusion. The bases of the integrated information theory and its possible application in neurobiology to investigate the process of new experience acquisition were reviewed. It was shown that the amount of integrated information Ф is a metric which is able to quantify the dynamic complexity of brain neural networks increasing when the new experience is acquired. Methods, enabling the practical calculation of Ф for spiking data, were proposed.

Détail

Keywords: Brain, information, learning, integrated information theory, complexity.

Bibliographie

[1] Tononi G., “An information integration theory of consciousness”, BMC Neuroscience, 5 (2004), 42 | DOI

[2] Tononi G., “Consciousness as integrated information: a provisional manifesto”, The Biological Bulletin, 215:3 (2008), 216–242 | DOI

[3] Balduzzi D., Tononi G., “Integrated information in discrete dynamical systems: motivation and theoretical framework”, PLoS Comput. Biol., 4:6 (2008), e1000091 | DOI | MR

[4] Oizumi M., Albantakis L., Tononi G., “From the phenomenology to the mechanisms of consciousness: Integrated information theory 3.0”, PLoS Comput. Biol., 10:5 (2014), e1003588 | DOI

[5] Tononi G., Koch C., “Consciousness: here, there and everywhere?”, Phil. Trans. R. Soc. B, 370:1668 (2015), 20140167 | DOI

[6] Massimini M., Ferrarelli F., Huber R., Esser S. K., Singh H., Tononi G., “Breakdown of cortical effective connectivity during sleep”, Science, 309:5744 (2005), 2228–2232 | DOI

[7] Alkire M. T., Hudetz A. G., Tononi G., “Consciousness and anesthesia”, Science, 322:5903 (2008), 876–880 | DOI

[8] Gosseries O., Di H., Laureys S., Boly M., “Measuring consciousness in severely damaged brains”, Annual Review of Neuroscience, 37 (2014), 457–478 | DOI

[9] Casali A. G., Olivia Gosseries O., Rosanova M., Boly M., Sarasso S., Casali K. R., Casarotto S., Bruno M.-A., Laureys S., Tononi G., Massimini M., “A theoretically based index of consciousness independent of sensory processing and behavior”, Science Translational Medicine, 5:198 (2013), 198ra105 | DOI

[10] King J. R., Sitt J. D., Faugeras F., Rohaut B., Karoui I. E., Cohen L., Naccache L., Dehaene S., “Information sharing in the brain indexes consciousness in noncommunicative patients”, Current Biology, 23:19 (2013), 1914–1919 | DOI

[11] Searle J. R., Can information theory explain consciousness?, The New York Review of Books, , 10 January 2013 https://www.nybooks.com/articles/2013/01/10/can-information-theory-explain-consciousness/

[12] Barrett A. B., Mediano P. A. M., “The Phi measure of integrated information is not well-defined for general physical systems”, Journal of Consciousness Studies, 26:1–2 (2019), 11–20

[13] Edlund J. A., Chaumont N., Hintze A., Koch C., Tononi G., Adami C., “Integrated information increases with fitness in the evolution of animats”, PLoS Comput. Biol., 7:10 (2011), e1002236 | DOI | MR

[14] Engel D., Malone T. W., “Integrated information as a metric for group interaction”, PLoS ONE, 13:10 (2018), e0205335 | DOI

[15] Albantakis L., Tononi G., “The intrinsic cause-effect power of discrete dynamical systems–from elementary cellular automata to adapting animats”, Entropy, 17:8 (2015), 5472–5502 | DOI

[16] Niizato T., Sakamoto K., Mototake Y.-I., Murakami H., Tomaru T., Hoshika T., Fukushima T., “Finding continuity and discontinuity in fish schools via integrated information theory”, PLoS ONE, 15:2 (2020), e0229573 | DOI

[17] Fujii K., Kanazawa H., Kuniyoshi Y. “Spike timing dependent plasticity enhances integrated information at the EEG level: A large-scale brain simulation experiment”, 2019 Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics, ICDL-EpiRob (Oslo, Norway, 19–22 August 2019), IEEE, New York, 2019, 137–142 | DOI

[18] Niessing J., Friedrich R. W., “Olfactory pattern classification by discrete neuronal network states”, Nature, 465:7294 (2010), 47–52 | DOI

[19] Mazzucato L., Fontanini A., La Camera G., “Dynamics of multistable states during ongoing and evoked cortical activity”, Journal of Neuroscience, 35:21 (2015), 8214–8231 | DOI

[20] Isler J. R., Stark R. I., Grieve P. G., Welch M. G., Myers M. M., “Integrated information in the EEG of preterm infants increases with family nurture intervention, age, and conscious state”, PLoS ONE, 13:10 (2018), e0206237 | DOI

[21] Nazhestkin I., Svarnik O., “Different approximation methods for calculation of integrated information coefficient in the brain during instrumental learning”, Brain Sciences, 12:5 (2022), 596 | DOI

[22] Nazhestkin I. A., Svarnik O. E., “Integrated information coefficient estimated from neuronal activity in hippocampus-amygdala complex of rats as a measure of learning success”, Journal of Integrative Neuroscience, 21:5 (2022), 128 | DOI

[23] Sporns O., “Network attributes for segregation and integration in the human brain”, Current Opinion in Neurobiology, 23:2 (2013), 162–171 | DOI

[24] Brodmann K., Vergleichende Lokalisationslehre der Grosshirnrinde in ihren Prinzipien dargestellt auf Grund des Zellenbaues, Barth, Leipzig, 1909, 324 pp.

[25] Vogt C., Vogt O. Allgemeine ergebnisse unserer hirnforschung, v. 25, JA Barth, 1919, 190 pp.

[26] Sporns O., Chialvo D. R., Kaiser M., Hilgetag C. C., “Organization, development and function of complex brain networks”, Trends in Cognitive Sciences, 8:9 (2004), 418–425 | DOI

[27] Hilgetag C.-C., Burns G. A. P. S., O'Neill M. A., Scannell J. W., Young M. P., “Anatomical connectivity defines the organization of clusters of cortical areas in the macaque monkey and the cat”, Phil. Trans. R. Soc. Lond. B, 355:1393 (2000), 91–110 | DOI

[28] Sporns O., Zwi J. D., “The small world of the cerebral cortex”, Neuroinformatics, 2:2 (2004), 145–162 | DOI

[29] Barabási A.-L., Albert R., “Emergence of scaling in random networks”, Science, 286:5439 (1999), 509–512 | DOI | MR | Zbl

[30] Bassett D. S., Bullmore E. D., “Small-world brain networks”, The Neuroscientist, 12:6 (2006), 512–523 | DOI

[31] Muldoon S. F., Bridgeford E. W., Bassett D. S., “Small-world propensity and weighted brain networks”, Scientific Reports, 6:1 (2016), 22057 | DOI

[32] Bassett D. S., Bullmore E. T., “Small-world brain networks revisited”, The Neuroscientist, 23:5 (2017), 499–516 | DOI

[33] Liao X., Vasilakos A. V., He Y., “Small-world human brain networks: Perspectives and challenges”, Neuroscience Biobehavioral Reviews, 77 (2017), 286–300 | DOI

[34] Milgram S., “The small-world problem”, Psychology Today, 1:1 (1967), 61–67

[35] Watts D. J., Strogatz S. H., “Collective dynamics of ‘small-world’ networks”, Nature, 393:6684 (1998), 440–442 | DOI | MR | Zbl

[36] Latora V., Marchiori M., “Efficient behavior of small-world networks”, Phys. Rev. Lett., 87:19 (2001), 198701 | DOI

[37] Latora V., Marchiori M., “Economic small-world behavior in weighted networks”, The European Physical Journal B - Condensed Matter and Complex Systems, 32:2 (2003), 249–263 | DOI

[38] Simard D., Nadeau L., Kröger H., “Fastest learning in small-world neural networks”, Physics Letters A, 336:1 (2005), 8–15 | DOI | Zbl

[39] Lynn C. W., Bassett D. S., “The physics of brain network structure, function and control”, Nature Reviews Physics, 1:5 (2019), 318–332 | DOI

[40] Anokhin K. V., “Kognitom: v poiskakh fundamentalnoi neironauchnoi teorii soznaniya”, Zhurnal vysshei nervnoi deyatelnosti im. I. P. Pavlova, 71:1 (2021), 39–71 | DOI | MR

[41] Rulkov N. F., Sushchik M. M., Tsimring L. S., Abarbanel H. D. I., “Generalized synchronization of chaos in directionally coupled chaotic systems”, Phys. Rev. E, 51:2 (1995), 980–994 | DOI | MR

[42] Aertsen A. M., Gerstein G. L., Habib M. K., Palm G., “Dynamics of neuronal firing correlation: modulation of “effective connectivity””, Journal of Neurophysiology, 61:5 (1989), 900–917 | DOI

[43] Boccaletti S., Kurths J., Osipov G., Valladares D. L., Zhou C. S., “The synchronization of chaotic systems”, Phys. Rep., no. 1–2, 1–101 | Zbl

[44] Rosenblum M., Pikovsky A., “Synchronization: From pendulum clocks to chaotic lasers and chemical oscillators”, Contemporary Physics, 44:5 (2003), 401–416 | DOI | MR

[45] Malliaros F. D., Vazirgiannis M., “Clustering and community detection in directed networks: A survey”, Physics Reports, 533:4 (2013), 95–142 | DOI | MR | Zbl

[46] Garcia J. O., Ashourvan A., Muldoon S., Vettel J. M., Bassett D. S., “Applications of community detection techniques to brain graphs: Algorithmic considerations and implications for neural function”, Proceedings of the IEEE, 106:5 (2018), 846–867 | DOI

[47] van den Heuvel M. P., Hulshoff Pol H. E., “Exploring the brain network: A review on resting-state fMRI functional connectivity”, European Neuropsychopharmacology, 20:8 (2010), 519–534 | DOI

[48] Liao W., Ding J., Marinazzo D., Xu Q., Wang Z., Yuan C., Zhang Z., Lu G., Chen H., “Small-world directed networks in the human brain: Multivariate Granger causality analysis of resting-state fMRI”, NeuroImage, 54:4 (2011), 2683–2694 | DOI

[49] Stam C. J., van Straaten E. C. W., “The organization of physiological brain networks”, Clinical Neurophysiology, 123:6 (2012), 1067–1087 | DOI

[50] Kahnt T., Chang L. J., Park S. Q., Heinzle J., Haynes J.-D., “Connectivity-based parcellation of the human orbitofrontal cortex”, Journal of Neuroscience, 32:18 (2012), 6240–6250 | DOI

[51] Yu C., Zhou Y., Liu Y., Jiang T., Dong H., Zhang Y., Walter M., “Functional segregation of the human cingulate cortex is confirmed by functional connectivity based neuroanatomical parcellation”, NeuroImage, 54:4 (2011), 2571–2581 | DOI

[52] Kashtan N., Alon U., “Spontaneous evolution of modularity and network motifs”, Proc. Natl. Acad. Sci. U.S.A, 102:39 (2005), 13773–13778 | DOI

[53] Lipson H., Pollack J. B., Suh N. P., “On the origin of modular variation”, Evolution, 56:8 (2002), 1549–1556 | DOI

[54] Rota G.-C., “The number of partitions of a set”, The American Mathematical Monthly, 71:5 (1964), 498–504 | DOI | MR | Zbl

[55] Berend D., Tassa T., “Improved bounds on Bell numbers and on moments of sums of random variables”, Probability and Mathematical Statistics, 30:2 (2010), 185–205 | MR | Zbl

[56] Graham R. L., Knuth D. E., Patashnik O., Concrete Mathematics: A Foundation for Computer Science, Addison–Wesley, Reading, MA, USA, 1994, 657 pp. | MR | Zbl

[57] Toker D., Sommer F. T., “Information integration in large brain networks”, PLoS Comput. Biol., 15:2 (2019), e1006807 | DOI

[58] Mediano P. A. M., Seth A. K., Barrett A. B., “Measuring integrated information: Comparison of candidate measures in theory and simulation”, Entropy, 21:1 (2019), 17 | DOI

[59] Blondel V. D., Guillaume J.-L., Lambiotte R., Lefebvre E., “Fast unfolding of communities in large networks”, Journal of Statistical Mechanics: Theory and Experiment, 2008:10 (2008), P10008 | DOI | Zbl

[60] Ng A., Jordan M., Weiss Y., “On Spectral Clustering: Analysis and an algorithm”, Advances in Neural Information Processing Systems 14. NIPS

[61] Faskowitz J., Yan X., Zuo X.-N., Sporns O., “Weighted stochastic block models of the human connectome across the life span”, Scientific Reports, 8:1 (2018), 12997 | DOI

[62] Barrett A. B., Seth A. K., “Practical measures of integrated information for time-series data”, PLoS Comput. Biol., 7:1 (2011), e1001052 | DOI | MR

[63] Tononi G., “Integrated information theory of consciousness: an updated account”, Archives Italiennes de Biologie, 150:2–3 (2012), 56–90 | DOI

[64] Griffith V., A principled infotheoretic $\phi$-like measure, 18 pp., arXiv: 1401.0978 | DOI

[65] Oizumi M., Tsuchiya N., Amari S., “Unified framework for information integration based on information geometry”, Proc. Natl. Acad. Sci. U.S.A, 113:51 (2016), 14817–14822 | DOI | MR | Zbl

[66] Oizumi M., Amari S., Yanagawa T., Fujii N., Tsuchiya N., “Measuring integrated information from the decoding perspective”, PLoS Comput. Biol., 12:1 (2016), e1004654 | DOI

[67] VanRullen R., “Perceptual cycles”, Trends in Cognitive Sciences, 20:10 (2016), 723–735 | DOI

[68] Fiebelkorn I. C., Pinsk M. A., Kastner S., “A dynamic interplay within the frontoparietal network underlies rhythmic spatial attention”, Neuron, 99:4 (2018), 842–853 | DOI

[69] Helfrich R. F., Fiebelkorn I. C., Szczepanski S. M., Lin J. J., Parvizi J., Knight R. T., Kastner S., “Neural mechanisms of sustained attention are rhythmic”, Neuron, 99:4 (2018), 854–865 | DOI