Geodesic
On typical encodings of multivariate ergodic sources
Kybernetika, Tome 56 (2020) no. 6, pp. 1090-1110.

Voir la notice de l'article provenant de la source Czech Digital Mathematics Library

We show that the typical coordinate-wise encoding of multivariate ergodic source into prescribed alphabets has the entropy profile close to the convolution of the entropy profile of the source and the modular polymatroid that is determined by the cardinalities of the output alphabets. We show that the proportion of the exceptional encodings that are not close to the convolution goes to zero doubly exponentially. The result holds for a class of multivariate sources that satisfy asymptotic equipartition property described via the mean fluctuation of the information functions. This class covers asymptotically mean stationary processes with ergodic mean, ergodic processes, irreducible Markov chains with an arbitrary initial distribution. We also proved that typical encodings yield the asymptotic equipartition property for the output variables. These asymptotic results are based on an explicit lower bound of the proportion of encodings that transform a multivariate random variable into a variable with the entropy profile close to the suitable convolution.
DOI : 10.14736/kyb-2020-6-1090
Classification : 94A24, 94A29
Keywords: entropy; entropy rate; multivariate source; ergodic source; a.e.p. property 
@article{10_14736_kyb_2020_6_1090,
     author = {Kupsa, Michal},
     title = {On typical encodings of multivariate ergodic sources},
     journal = {Kybernetika},
     pages = {1090--1110},
     publisher = {mathdoc},
     volume = {56},
     number = {6},
     year = {2020},
     doi = {10.14736/kyb-2020-6-1090},
     mrnumber = {4199905},
     language = {en},
     url = {http://geodesic.mathdoc.fr/articles/10.14736/kyb-2020-6-1090/}
}
TY  - JOUR
AU  - Kupsa, Michal
TI  - On typical encodings of multivariate ergodic sources
JO  - Kybernetika
PY  - 2020
SP  - 1090
EP  - 1110
VL  - 56
IS  - 6
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/articles/10.14736/kyb-2020-6-1090/
DO  - 10.14736/kyb-2020-6-1090
LA  - en
ID  - 10_14736_kyb_2020_6_1090
ER  - 
%0 Journal Article
%A Kupsa, Michal
%T On typical encodings of multivariate ergodic sources
%J Kybernetika
%D 2020
%P 1090-1110
%V 56
%N 6
%I mathdoc
%U http://geodesic.mathdoc.fr/articles/10.14736/kyb-2020-6-1090/
%R 10.14736/kyb-2020-6-1090
%G en
%F 10_14736_kyb_2020_6_1090
Kupsa, Michal. On typical encodings of multivariate ergodic sources. Kybernetika, Tome 56 (2020) no. 6, pp. 1090-1110. doi : 10.14736/kyb-2020-6-1090. http://geodesic.mathdoc.fr/articles/10.14736/kyb-2020-6-1090/

Cité par Sources :