On the singularities of the information matrix and multipath changepoint problems

M. Asgharian

Teoriâ veroâtnostej i ee primeneniâ, Tome 58 (2013) no. 4, pp. 711-729

Bibliographie

[1] Abraham R., Marsden J. E., Ratiu T., Manifolds, Tensors Analysis, and Applications, Springer-Verlag, New York, 1988, 654 pp.

[2] Aitchison J., Silvey S. D., “Maximum-likelihood estimation of parameters subject to restraints”, Ann. Math. Statist., 29 (1958), 813–828 | DOI | Zbl

[3] Aldrich J., “How likelihood and identification went Bayesian”, Inter. Statist. Review, 70:1 (2002), 79–98 | Zbl

[4] Asgharian M., Modeling Covariates in Multipath Change-Point Problems, Ph. D. Thesis, Department of Mathematics and Statistics, McGill University, Montreal, 1998

[5] Asgharian M., Wolfson D. B., “Covariates in multipath change-point problems: Modeling and consistency of the MLE”, Canad. J. Statist., 29:4 (2001), 515–528 | DOI | Zbl

[6] Bergeron P.-J., Asgharian M., Wolfson D. B., “Covariate bias induced by length-biased sampling of failuretimes”, J. Amer. Statist. Assoc., 103:482 (2008), 737–742 | DOI | Zbl

[7] Bickel P., Klaassen C. A. J., Ritov Y., Wellner J. A., Efficient and Adaptive Estimation for Semiparametric Models, The Johns Hopkins University Press, Baltimore, USA, 1993, 560 pp.

[8] Bochner S., Martin W. T., Several Complex Variables, Princeton University Press, Princeton, 1948, 216 pp. | Zbl

[9] Bottai M., “Confidence regions when the Fisher information is zero”, Biometrika, 90:1 (2003), 73–84 | DOI | Zbl

[10] Bowden R., “The theory of parametric identification”, Econometrica, 41:6 (1973), 1069–1074 | DOI | Zbl

[11] Brown A. B., “Functional dependence”, Trans. Amer. Math. Soc., 38:2 (1935), 379–394 | DOI

[12] Chesher A., “Identification in nonseparable models”, Econometrica, 71:5 (2003), 1405–1441 | DOI | Zbl

[13] Coury J. E., “On the measure of zero sets of coordinate functions”, Proc. Amer. Math. Soc., 25:1 (1970), 16–20 | DOI | Zbl

[14] Cox D., Principles of Statistical Inference, Cambridge Univ. Press, Cambridge, 2006, 219 pp. | Zbl

[15] Crowder M. J., Hand D. J., Analysis of Repeated Measures, Chapman and Hall/CRC, London, 1990, 257 pp. | Zbl

[16] Crowder M. J., “On constrained maximum likelihood estimation with non-i.i.d. observations”, Ann. Inst. Statist. Math., 36:2 (1984), 239–249 | DOI | Zbl

[17] Dacunha-Castelle D., “Points singuliers des modèles statistiques”, Festschrift for Lucien Le Cam, Springer, New York, 1997, 135–141 | DOI | Zbl

[18] Dacunha-Castelle D., Gassiat E., “Testing the order of a model using locally conic parametrization: population mixtures and stationary ARMA processes”, Ann. Statist., 27:4 (1999), 1178–1209 | DOI | Zbl

[19] Dacunha-Castelle D., Gassiat E., “Testing in locally conic models, and application to mixture models”, ESAIM Probab. Statist., 1 (1997), 285–317 | DOI | Zbl

[20] Drton M., “Likelihood ratio tests and singularities”, Ann. Statist., 37:2 (2009), 979–1012 | DOI | Zbl

[21] Dugundji J., Topology, Allen and Bacon, New York, 1966, 447 pp. | Zbl

[22] Dufour J.-M., “Identification, weak instruments and statistical inference in econometrics”, Canadian J. Econometrics, 36:4 (2003), 767–808

[23] Fisher F. M., “Generalization of the rank and order conditions for identifiability”, Econometrica, 27:3 (1959), 431–447 | DOI | Zbl

[24] Fisher F. M., “Identifiability criteria in nonlinear systems”, Econometrica, 29:4 (1961), 574–590 | DOI | Zbl

[25] Fisher F. M., “Identifiability criteria in nonlinear systems: A further note”, Econometrica, 33:1 (1965), 197–205 | DOI | Zbl

[26] Fisher F. M., The Identification Problem in Economics, McGraw-Hill, New York, 1966, 203 pp.

[27] Forchini G., Hillier G. H., Ill-Posed Problems and Instruments' Weakness, Unpublished manuscript, 2004

[28] Forchini G., Hillier G. H., “Conditional inference for possibly unidentified structural equations”, Econometric Theory, 19:5 (2004), 707–743

[29] Fukumizu K., “Likelihood ratio of unidentifiable models and multilayer neural networks”, Ann. Statist., 31:3 (2003), 833–851 | DOI | Zbl

[30] Fukumizu K., “A regularity condition of the information matrix of a multilayer perception network”, Neural Networks, 9:5 (1996), 871–879 | DOI

[31] Gunning R., Rossi H., Analytic Functions of Several Complex Variables, Prentice-Hall, Englewood Cliffs, N.J., 1965, 317 pp. | Zbl

[32] Hille E., Phillips R., Functional Analysis And Semi-Groups, Amer. Math. Soc., Providence, R.I., 1957, 808 pp. | Zbl

[33] Ibragimov I. A., Khasminskii R. Z., Asimptoticheskaya teoriya otsenivaniya, Nauka, M., 1979

[34] Jacobs R. A., Jordan M. I., Nowlan S. J., Hinton G. E., “Adaptive mixture of local experts”, Neural Computation, 3:1 (1991), 79–87 | DOI

[35] Jiang W., Tanner M. A., “Hierarchical mixtures-of-experts for exponential family regression models: approximation and maximum likelihood estimation”, Ann. Statist., 27:3 (1999), 987–1011 | DOI | Zbl

[36] Joseph L., Wolfson D. B., “Maximum likelihood estimation in the multi-path change-point problem”, Ann. Instit. Statist. Math., 45:3 (1993), 511–530 | DOI | Zbl

[37] Joseph L., Wolfson D. B., du Berger R., Lyle R. M., “Change-point analysis of a randomized trial on the effects of calcium supplementation on blood pressure”, Bayesian Biostatistics, eds. D. A. Berry, D. K. Stangle, Marcel Dekker, New York, 1996, 617–649 pp.

[38] Joseph L., Vandal A. C., Wolfson D. B., “Estimation in multi-path change-point problem for correlated data”, Canad. J. Statist., 24:1 (1996), 37–53 | DOI | Zbl

[39] Joseph L., Wolfson D. B., du Berger R., Lyle R. M., “Analysis of panel data with change-points”, Statistica Sinica, 7 (1997), 687–703 | Zbl

[40] Klaassen C. A. J., Lenstra A. J., “Vanishing fisher information”, Acta Appl. Math., 78:1–3 (2003), 193–200 | DOI | Zbl

[41] Klaassen C. A. J., Lenstra A. J., Zero information in the two-sample mixed proportional hazards model, Unpublished manuscript, 2000

[42] Koopmans T. C., “Identification problems in economic model construction”, Econometrica, 17:2 (1949), 125–144 | DOI | Zbl

[43] Koopmans T. C., Reiersol O., “The identification of structural characteristics”, Ann. Math. Statist., 21 (1950), 165–181 | DOI | Zbl

[44] Koopmans T. C., Rubin H., Leipnik R. B., Measuring the Equation Systems of Dynamic Economics, John Wiley, New York, 1950 | Zbl

[45] Krantz S. G., Function Theory of Several Complex Variables, AMS Chelsea Publishing, Providence, R.I., 2001, 564 pp. | Zbl

[46] Liu X., Shao Y., “Asymptotics for the likelihood ratio tests in a two-component normal mixture model”, J. Statist. Plann. Inference, 123 (2004), 61–81 | DOI | Zbl

[47] Liu X., Shao Y., “Asymptotics for likelihood ratio tests under loss of identifiability”, Ann. Statist., 31:3 (2003), 807–832 | DOI | Zbl

[48] Mandel M., Ritov Y., “The accelerated failure time model under biased sampling”, Biometrics, 66:4 (2010), 1306–1308 | DOI | Zbl

[49] McCullagh P., “Sampling bias and logistic models”, J. R. Statist. Soc., Ser. B, 70:4 (2008), 643–677 | DOI | Zbl

[50] McLachlan G., Peel D., Finite mixture models, Wiley-Interscience, New York, 2000, 419 pp. | Zbl

[51] McLeod I. A., “Necessary and sufficient condition for nonsingular Fisher information matrix in ARMA and fractional ARIMA models”, Amer. Statist., 53:1 (1999), 71–72

[52] Mukerjee R., Sutradhar B. C., “On the positive definiteness of the information matrix under the binary and Poisson mixed models”, Ann. Inst. Statist. Math., 54:2 (2002), 355–366 | DOI | Zbl

[53] Norets A., “Approximation of conditional densities by smooth mixtures of regressions”, Ann. Statist., 38:3 (2010), 1733–1766 | DOI | Zbl

[54] Oxtoby J., Ulam S., “On the equivalence of any set of first category to a set of measure zero”, Fund. Math., 31 (1938), 201–206

[55] Pauler D. K., Laird N. M., “A mixture model for longitudinal data with application to assessment of noncompliance”, Biometrics, 56 (2000), 464–472 | DOI | Zbl

[56] Rothenberg T. J., “Incredible structure inference”, Identification and Inference for Econometric Models, eds. D. W. K. Andrews, J. H. Stock, Cambdrige University Press, Cambdrige, 2010

[57] Rothenberg T. J., “Identification in parametric models”, Econometrica, 39:3 (1971), 577–591 | DOI | Zbl

[58] Rotnitzky A., Cox D. R., Bottai M., Robins J., “Likelihood-based inference with singular information matrix”, Bernoulli, 6:2 (2000), 285–302 | DOI

[59] Sard A., “The measure of the critical values of differentiable maps”, Bull. Amer. Math. Soc., 48 (1942), 883–890 | DOI | Zbl

[60] Sargan J. D., “Identification and lack of identification”, Econometrica, 51:6 (1983), 1605–1633 | DOI | Zbl

[61] Silvey S. D., Statistical Inference, Chapman and Hall, London, 1975, 192 pp. | Zbl

[62] Silvey S. D., “The Lagrangian multiplier test”, Ann. Math. Statist., 30 (1959), 389–407 | DOI | Zbl

[63] Stoica P., Marzetta T. L., “Parameter estimation problems with singular information matrices”, IEEE Trans. Signal Process., 49:1 (2001), 87–90 | DOI

[64] Stoica P., Söderström T., “On non-singular information matrices and local identifiability”, Internat. J. Control, 36:2 (1982), 323–329 | DOI | Zbl

[65] Telksnys L., Detection of Changes in Random Processes, Optimization Software, New York, 1986 | Zbl

[66] Wald A., “Note on the identification of economic relations”, Statistical Inference in Dynamic Economic Models, John Wiley, New York, 1950, 238–244

[67] Wang X., “Nonsingularity of Fisher information for autoregressive moving-average processes”, J. Time Ser. Anal., 14:5 (1993), 547–548 | DOI | Zbl

[68] White H., “Maximum likelihood estimation of misspecified models”, Econometrica, 50:1 (1982), 1–25 | DOI | Zbl

[69] Yakir B., “Optimal detection of a change in distribution when the observations form a Markov chain with a finite state space”, Change-point Problems, IMS Lecture Notes-Monograph Series, 23, Inst. Math. Statist., Hayward, CA, 1994, 346–358 | DOI | Zbl