Geodesic
Renyi entropy as a statistical entropy for complex systems
Teoretičeskaâ i matematičeskaâ fizika, Tome 149 (2006) no. 2, pp. 299-317 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice de l'article

To describe a complex system, we propose using the Renyi entropy depending on the parameter $q$ $(0 and passing into the Gibbs–Shannon entropy at $q=1$. The maximum principle for the Renyi entropy yields a Renyi distribution that passes into the Gibbs canonical distribution at $q=1$. The thermodynamic entropy of the complex system is defined as the Renyi entropy for the Renyi distribution. In contrast to the usual entropy based on the Gibbs–Shannon entropy, the Renyi entropy increases as the distribution deviates from the Gibbs distribution {(}the deviation is estimated by the parameter $\eta=1$ – $q)$ and reaches its maximum at the maximum possible value $\eta_{\max}$. As this occurs, the Renyi distribution becomes a power-law distribution. The parameter $\eta$ can be regarded as an order parameter. At $\eta=0$, the derivative of the thermodynamic entropy with respect to $\eta$ exhibits a jump, which indicates a kind of phase transition into a more ordered state. The evolution of the system toward further order in this phase state is accompanied by an entropy gain. This means that in accordance with the second law of thermodynamics, a natural evolution in the direction of self-organization is preferable.
Keywords: Renyi entropy, complex system, self-organization, power-law Zipf–Pareto distribution, second law of thermodynamics
Mots-clés : phase transition, direction of evolution. 
@article{TMF_2006_149_2_a9,
     author = {A. G. Bashkirov},
     title = {Renyi entropy as a~statistical entropy for complex systems},
     journal = {Teoreti\v{c}eska\^a i matemati\v{c}eska\^a fizika},
     pages = {299--317},
     year = {2006},
     volume = {149},
     number = {2},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/TMF_2006_149_2_a9/}
}
TY  - JOUR
AU  - A. G. Bashkirov
TI  - Renyi entropy as a statistical entropy for complex systems
JO  - Teoretičeskaâ i matematičeskaâ fizika
PY  - 2006
SP  - 299
EP  - 317
VL  - 149
IS  - 2
UR  - http://geodesic.mathdoc.fr/item/TMF_2006_149_2_a9/
LA  - ru
ID  - TMF_2006_149_2_a9
ER  - 
%0 Journal Article
%A A. G. Bashkirov
%T Renyi entropy as a statistical entropy for complex systems
%J Teoretičeskaâ i matematičeskaâ fizika
%D 2006
%P 299-317
%V 149
%N 2
%U http://geodesic.mathdoc.fr/item/TMF_2006_149_2_a9/
%G ru
%F TMF_2006_149_2_a9
A. G. Bashkirov. Renyi entropy as a statistical entropy for complex systems. Teoretičeskaâ i matematičeskaâ fizika, Tome 149 (2006) no. 2, pp. 299-317. http://geodesic.mathdoc.fr/item/TMF_2006_149_2_a9/

[1] E. T. Jaynes, Phys. Rev., 106 (1957), 620 | DOI | MR | Zbl

[2] D. N. Zubarev, Neravnovesnaya statisticheskaya termodinamika, Nauka, M., 1972; Д. Н. Зубарев, В. Г. Морозов, Г. Репке, Статистическая механика неравновесных процессов, Физматлит, М., 2002 | MR | Zbl

[3] A. Renyi, Probability theory, North-Holland, Amsterdam, 1970 | MR | Zbl

[4] Selected papers by Alfred Renyi, v. 2, ed. P. Turan, Akademiai Kiado, Budapest, 1976 | MR | Zbl

[5] J. H. Havrda, F. Charvat, Kybernetika, 3 (1967), 30 | MR | Zbl

[6] C. Tsallis, J. Stat. Phys., 52 (1988), 479 | DOI | MR | Zbl

[7] A. Bialas, W. Czyz, Phys. Rev. D, 61 (2000), 074021 | DOI

[8] C. Essex, C. Schultszky, A. Franz, K. H. Hoffmann, Physica A, 284 (2000), 299 | DOI | MR

[9] T. C. Halsey, M. H. Jensen, L. P. Kadanoff et al., Phys. Rev. A, 33 (1986), 1141 | DOI | MR | Zbl

[10] T. Arimitsu, N. Arimitsu, Physica A, 305 (2002), 218 | DOI | MR | Zbl

[11] M. B. Geilikman, T. V. Golubeva, V. F. Pisarenko, Earth Planet. Sci. Lett., 99 (1990), 127 | DOI

[12] G. Khaken, Informatsiya i samoorganizatsiya, Mir, M., 1991 | MR

[13] Dzh. Nikolis, Dinamika ierarkhicheskikh sistem, Mir, M., 1989 | MR | Zbl

[14] P. Bak, How Nature Works. The Science of Self-Organized Criticality, Springer, Berlin, 1996 | MR | Zbl

[15] E. W. Montroll, M. F. Shlesinger, J. Stat. Phys., 32 (1983), 209 | DOI | MR

[16] R. Balesku, Ravnovesnaya i neravnovesnaya statisticheskaya mekhanika, t. 1, Mir, M., 1978 | MR

[17] B. B. Kadomtsev, Dinamika i informatsiya, Redaktsiya UFN, M., 1997 | MR

[18] A. N. Kolmogorov, Atti Accad. Naz. Lincei. Rend., 12 (1930), 388

[19] C. Beck, F. Schlögl, Thermodynamics of Chaotic Systems, Cambridge Univ. Press, Cambridge, 1993 | MR

[20] Yu. L. Klimontovich, Statisticheskaya teoriya otkrytykh sistem, TOO “Yanus”, M., 1995 | MR | Zbl

[21] http://tsallis.cat.cbrf.br/biblio.htm

[22] C. E. Shannon, Bell Syst. Techn. J., 27 (1948), 379, 623 | DOI | MR | Zbl

[23] A. I. Khinchin, UMN, 8:3 (1953), 3 ; A. I. Khinchin, Mathematical Foundations of Information Theory, Dover, N. Y., 1957 | MR | Zbl | MR | Zbl

[24] S. Abe, Phys. Lett. A, 271 (2000), 74 | DOI | MR | Zbl

[25] P. Jizba, T. Arimitsu, AIP Conf. Proc., 597 (2001), 341 ; cond-mat/0108184 | DOI

[26] J. E. Shore, R. W. Johnson, IEEE Trans. Inform. Theory, IT-26 (1980), 26 | DOI | MR | Zbl

[27] J. Uffink, Stud. Hist. Philos. Mod. Phys. B, 26 (1995), 223 | DOI | MR | Zbl

[28] A. G. Bashkirov, Physica A, 340 (2004), 153 | DOI | MR

[29] C. Tsallis, R. S. Mendes, A. R. Plastino, Physica A, 261 (1998), 534 | DOI | MR | Zbl

[30] D. N. Zubarev, V. G. Morozov, O. V. Troshkin, TMF, 92 (1992), 293 | MR | Zbl

[31] G. Wilk, Z. Wlodarczyk, Phys. Rev. Lett., 84 (2000), 2770 | DOI

[32] A. G. Bashkirov, A. D. Sukhanov, ZhETF, 122 (2002), 513

[33] C. Beck, Phys. Rev. Lett., 87 (2001), 180601 ; C. Beck, E. G. D. Cohen, Physica A, 322 (2003), 267 | DOI | MR | DOI | MR | Zbl

[34] A. G. Bashkirov, A. V. Vityazev, Planet. Space Sci., 44 (1996), 909 | DOI

[35] A. Fujiwara, G. Kamimoto, A. Tsukamoto, Icarus, 31 (1977), 277 | DOI

[36] M. Rybczyski, Z. Wlodarczyk, G. Wilk, Nucl. Phys. B (Proc. Suppl.), 97 (2001), 81 | DOI

[37] L. A. Adamic, B. A. Hubermann, Glottometrics, 3 (2002), 143

[38] G. Wilk, Z. Wlodarczyk, Acta Phys. Polon. B, 35 (2004), 871 ; cond-mat/0212056