Orlicz Addition for Measures and an Optimization Problem for the $f$-divergence
Canadian journal of mathematics, Tome 72 (2020) no. 2, pp. 455-479

Voir la notice de l'article provenant de la source Cambridge University Press

This paper provides a functional analogue of the recently initiated dual Orlicz–Brunn–Minkowski theory for star bodies. We first propose the Orlicz addition of measures, and establish the dual functional Orlicz–Brunn–Minkowski inequality. Based on a family of linear Orlicz additions of two measures, we provide an interpretation for the famous $f$-divergence. Jensen’s inequality for integrals is also proved to be equivalent to the newly established dual functional Orlicz–Brunn–Minkowski inequality. An optimization problem for the $f$-divergence is proposed, and related functional affine isoperimetric inequalities are established.
DOI : 10.4153/S0008414X19000117
Mots-clés : affine isoperimetric inequality, dual Brunn–Minkowski theory, f-divergence, optimization problem for the f-divergence
Hou, Shaoxiong; Ye, Deping. Orlicz Addition for Measures and an Optimization Problem for the $f$-divergence. Canadian journal of mathematics, Tome 72 (2020) no. 2, pp. 455-479. doi: 10.4153/S0008414X19000117
@article{10_4153_S0008414X19000117,
     author = {Hou, Shaoxiong and Ye, Deping},
     title = {Orlicz {Addition} for {Measures} and an {Optimization} {Problem} for the $f$-divergence},
     journal = {Canadian journal of mathematics},
     pages = {455--479},
     year = {2020},
     volume = {72},
     number = {2},
     doi = {10.4153/S0008414X19000117},
     url = {http://geodesic.mathdoc.fr/articles/10.4153/S0008414X19000117/}
}
TY  - JOUR
AU  - Hou, Shaoxiong
AU  - Ye, Deping
TI  - Orlicz Addition for Measures and an Optimization Problem for the $f$-divergence
JO  - Canadian journal of mathematics
PY  - 2020
SP  - 455
EP  - 479
VL  - 72
IS  - 2
UR  - http://geodesic.mathdoc.fr/articles/10.4153/S0008414X19000117/
DO  - 10.4153/S0008414X19000117
ID  - 10_4153_S0008414X19000117
ER  - 
%0 Journal Article
%A Hou, Shaoxiong
%A Ye, Deping
%T Orlicz Addition for Measures and an Optimization Problem for the $f$-divergence
%J Canadian journal of mathematics
%D 2020
%P 455-479
%V 72
%N 2
%U http://geodesic.mathdoc.fr/articles/10.4153/S0008414X19000117/
%R 10.4153/S0008414X19000117
%F 10_4153_S0008414X19000117

[1] Ali, M. and Silvey, D., A general class of coefficients of divergence of one distribution from another. J. R. Statist. Soc. Ser. B 28(1966), 131–142. Google Scholar

[2] Artstein-Avidan, S., Klartag, B., and Milman, V., The Santaló point of a function, and a functional form of the Santaló inequality. Mathematika 51(2004), 33–48. https://doi.org/10.1112/S0025579300015497 Google Scholar

[3] Artstein-Avidan, S., Klartag, B., Schütt, C., and Werner, E., Functional affine-isoperimetry and an inverse logarithmic Sobolev inequality. J. Funct. Anal. 262(2012), 4181–4204. https://doi.org/10.1016/j.jfa.2012.02.014 Google Scholar

[4] Barron, A., Györfi, L., and Van Der Meulen, E., Distribution estimates consistent in total variation and two types of information divergence. IEEE Trans. Inform. Theory 38(1990), 1437–1454. Google Scholar

[5] Bhattacharyya, A., On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35(1943), 99–109. Google Scholar

[6] Blaschke, W., Vorlesungen über Differentialgeometrie II. In: Affine Differentialgeometrie. Springer-Verlag, Berlin, 1923. Google Scholar

[7] Caglar, U., Fradelizi, M., Guedon, O., Lehec, J., Schuett, C., and Werner, E., Functional versions of L -affine surface area and entropy inequalities. Int. Math. Res. Not. IMRN 2016(2016), 1223–1250. Google Scholar

[8] Caglar, U. and Werner, E., Divergence for s-concave and log concave functions. Adv. Math. 257(2014), 219–247. https://doi.org/10.1016/j.aim.2014.02.013 Google Scholar

[9] Caglar, U. and Ye, D., Affine isoperimetric inequalities in the functional Orlicz–Brunn–Minkowski theory. Adv. Appl. Math. 81(2016), 78–114. https://doi.org/10.1016/j.aam.2016.06.007 Google Scholar

[10] Cover, T. and Thomas, J., Elements of information theory. Second ed., Wiley-Interscience, Hoboken, NJ, 2006. Google Scholar

[11] Csiszár, I., Eine informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität von Markoffschen Ketten. Publ. Math. Inst. Hungar. Acad. Sci. Ser. A 8(1963), 84–108. Google Scholar

[12] Csiszár, I., I-divergence geometry of probability distributions and minimization problems. Ann. Probab. 3(1975), 146–158. https://doi.org/10.1214/aop/1176996454 Google Scholar

[13] Fradelizi, M. and Meyer, M., Some functional forms of Blaschke–Santaló inequality. Math. Z. 256(2007), 379–395. https://doi.org/10.1007/s00209-006-0078-z Google Scholar

[14] Frank, N. and Nock, R., On the Chi square and higher-order Chi distances for approximating f-Divergences. IEEE Signal Process. Lett. 21(2014), 10–13. Google Scholar

[15] Gardner, R., A positive answer to the Busemann–Petty problem in three dimensions. Ann. of Math. 140(1994), 435–447. https://doi.org/10.2307/2118606 Google Scholar

[16] Gardner, R., The Brunn–Minkowski inequality. Bull. Amer. Math. Soc. 39(2002), 355–405. https://doi.org/10.1090/S0273-0979-02-00941-2 Google Scholar

[17] Gardner, R., Hug, D., and Weil, W., The Orlicz–Brunn–Minkowski theory: A general framework, additions, and inequalities. J. Differential Geom. 97(2014), 427–476. Google Scholar

[18] Gardner, R., Hug, D., Weil, W., and Ye, D., The dual Orlicz–Brunn–Minkowski theory. J. Math. Anal. Appl. 430(2015), 810–829. https://doi.org/10.1016/j.jmaa.2015.05.016 Google Scholar

[19] Gardner, R. and Kiderlen, M., Operations between functions. Comm. Anal. Geom. 26(2018), 787–855. https://doi.org/10.4310/CAG.2018.v26.n4.a5 Google Scholar

[20] Gardner, R., Koldobski, A., and Schlumprecht, T., An analytic solution to the Busemann–Petty problem on sections of convex bodies. Ann. of Math. 149(1999), 691–703. https://doi.org/10.2307/120978 Google Scholar

[21] Good, I., Maximum entropy for hypothesis formulation, especially for multidimensional contingency tables. Ann. Math. Statist. 34(1963), 911–934. https://doi.org/10.1214/aoms/1177704014 Google Scholar

[22] Haberl, C. and Parapatits, L., The centro-affine Hadwiger theorem. J. Amer. Math. Soc. 27(2014), 685–705. https://doi.org/10.1090/S0894-0347-2014-00781-5 Google Scholar

[23] Harremoes, P. and Topsoe, F., Inequalities between entropy and the index of coincidence derived from information diagrams. IEEE Trans. Inform. Theory 47(2001), 2944–2960. https://doi.org/10.1109/18.959272 Google Scholar

[24] Ireland, C. and Kullback, S., Contingency tables with given marginals. Biometrika 55(1968), 179–188. https://doi.org/10.1093/biomet/55.1.179 Google Scholar

[25] Jaynes, E., Information theory and statistical mechanics. Phys. Rev. 106(1957), 620–630. Google Scholar

[26] Kullback, S. and Leibler, R., On information and sufficiency. Ann. Math. Statist. 22(1951), 79–86. https://doi.org/10.1214/aoms/1177729694 Google Scholar

[27] Lehec, J., Partitions and functional Santaló inequalities. Arch. Math. (Basel) 92(2009), 89–94. Google Scholar

[28] Liese, F. and Vajda, I., On divergences and information in statistics and information theory. IEEE Trans. Inform. Theory 52(2006), 4394–4412. https://doi.org/10.1109/TIT.2006.881731 Google Scholar

[29] Ludwig, M., General affine surface areas. Adv. Math. 224(2010), 2346–2360. https://doi.org/10.1016/j.aim.2010.02.004 Google Scholar

[30] Ludwig, M. and Reitzner, M., A characterization of affine surface area. Adv. Math. 147(1999), 138–172. https://doi.org/10.1006/aima.1999.1832 Google Scholar

[31] Ludwig, M. and Reitzner, M., A classification of SL (n) invariant valuations. Ann. of Math. 172(2010), 1219–1267. https://doi.org/10.4007/annals.2010.172.1223 Google Scholar

[32] Lutwak, E., Intersection bodies and dual mixed volume. Adv. Math. 71(1988), 232–261. https://doi.org/10.1016/0001-8708(88)90077-1 Google Scholar

[33] Lutwak, E., The Brunn–Minkowski–Firey theory. II. Affine and geominimal surface areas. Adv. Math. 118(1996), 244–294. https://doi.org/10.1006/aima.1996.0022 Google Scholar

[34] Morimoto, T., Markov processes and the H-theorem. J. Phys. Soc. Japan 18(1963), 328–331. https://doi.org/10.1143/JPSJ.18.328 Google Scholar

[35] Österreicher, F. and Vajda, I., A new class of metric divergences on probability spaces and its applicability in statistics. Ann. Inst. Statist. Math. 55(2003), 639–653. https://doi.org/10.1007/BF02517812 Google Scholar

[36] Petty, C. M., Geominimal surface area. Geom. Dedicata 3(1974), 77–97. https://doi.org/10.1007/BF00181363 Google Scholar

[37] Rényi, A., On measures of entropy and information. Proc. 4th Berkeley Sympos. Math. Statist. and Prob., 1, Univ. California Press, Berkeley, CA, 1961, pp. 547–561. Google Scholar

[38] Sanov, I., On the probability of large deviations of random magnitudes. (Russian), Mat. Sbornik 42(1957), 11–44. Google Scholar

[39] Schütt, C. and Werner, E., Surface bodies and p-affine surface area. Adv. Math. 187(2004), 98–145. https://doi.org/10.1016/j.aim.2003.07.018 Google Scholar

[40] Werner, E., Rényi divergence and L -affine surface area for convex bodies. Adv. Math. 230(2012), 1040–1059. https://doi.org/10.1016/j.aim.2012.03.015 Google Scholar

[41] Xi, D., Jin, H., and Leng, G., The Orlicz Brunn–Minkowski inequality. Adv. Math. 260(2014), 350–374. https://doi.org/10.1016/j.aim.2014.02.036 Google Scholar

[42] Ye, D., New Orlicz affine isoperimetric inequalities. J. Math. Anal. Appl. 427(2015), 905–929. https://doi.org/10.1016/j.jmaa.2015.02.084 Google Scholar

[43] Ye, D., L Geominimal surface areas and their inequalities. Int. Math. Res. Not. IMRN 2015(2015), 2465–2498. https://doi.org/10.1093/imrn/rnu009 Google Scholar

[44] Ye, D., Dual Orlicz–Brunn–Minkowski theory: dual Orlicz L affine and geominimal surface areas. J. Math. Anal. Appl. 443(2016), 352–371. https://doi.org/10.1016/j.jmaa.2016.05.027 Google Scholar

[45] Zhang, G., A positive answer to the Busemann–Petty problem in four dimensions. Ann. of Math. 149(1999), 535–543. https://doi.org/10.2307/120974 Google Scholar

[46] Zhu, B., Xing, S., and Ye, D., The dual Orlicz–Minkowski problem. J. Geom. Anal. 28(2018), 3829–3855. https://doi.org/10.1007/s12220-018-0002-x Google Scholar

[47] Zhu, B., Zhou, J., and Xu, W., Dual Orlicz–Brunn–Minkowski theory. Adv. Math. 264(2014), 700–725. https://doi.org/10.1016/j.aim.2014.07.019 Google Scholar

Cité par Sources :