Scaling limits in computational Bayesian inversion

Schillings, Claudia¹ ; Schwab, Christoph²

¹ Mathematics Institute, University of Warwick, Coventry CV4 7AL, England.
² Seminar for Applied Mathematics, ETH, CH-8092 Zurich, Switzerland.

ESAIM: Mathematical Modelling and Numerical Analysis , Tome 50 (2016) no. 6, pp. 1825-1856

Résumé

Computational Bayesian inversion of operator equations with distributed uncertain input parameters is based on an infinite-dimensional version of Bayes’ formula established in M. Dashti and A.M. Stuart [Handbook of Uncertainty Quantification, edited by R. Ghanem, D. Higdon and H. Owhadi. Springer (2015).] and its numerical realization in C. Schillings and Ch. Schwab [Inverse Problems 29 (2013) 065011; Inverse Problems 30 (2014) 065007.] Based on the sparsity of the posterior density shown in C. Schillings and Ch. Schwab [Inverse Problems 29 (2013) 065011; Inverse Problems 30 (2014) 065007.]; C. Schwab and A.M. Stuart [Inverse Problems 28 (2012) 045003.], dimension-adaptive Smolyak quadratures can afford higher convergence rates than MCMC in terms of the number $M$ of solutions of the forward (parametric operator) equation in C. Schillings and Ch. Schwab [Inverse Problems 29 (2013) 065011; Inverse Problems 30 (2014) 065007.]. The error bounds and convergence rates obtained in C. Schillings and Ch. Schwab [Inverse Problems 29 (2013) 065011; Inverse Problems 30 (2014) 065007.] are independent of the parameter dimension (in particular free from the curse of dimensionality) but depend on the (co)variance $\Gamma >0$ of the additive, Gaussian observation noise as $exp\left(b\Gamma {}^{-1}\right)$ for some constant $b>0$. It is proved that the Bayesian estimates admit asymptotic expansions as $\Gamma \downarrow 0$. Sufficient (nondegeneracy) conditions for the existence of finite limits as $\Gamma \downarrow 0$ are presented. For Gaussian priors, these limits are shown to be related to MAP estimators obtained from Tikhonov regularized least-squares functionals. Quasi-Newton (QN) methods with symmetric rank-1 updates are shown to identify the concentration points in a non-intrusive way, and to obtain second order information of the posterior density at these points. Based on the theory, two novel computational Bayesian estimation algorithms for Bayesian estimation at small observation noise covariance $\Gamma >0$ with performance independent of $\Gamma \downarrow 0$ are proposed: first, dimension-adaptive Smolyak quadrature from C. Schillings and Ch. Schwab [Inverse Problems 29 (2013) 065011; Inverse Problems 30 (2014) 065007.] combined with a reparametrization of the parametric Bayesian posterior density near the MAP point (assumed unique) and, second, generalized Richardson extrapolation to the limit of vanishing observation noise variance. Numerical experiments are presented which confirm $\Gamma$-independent convergence of the curvature-rescaled, adaptive Smolyak algorithm. Dimension truncation of the posterior density is justified by a general compactness result for the posterior’s Hessian at the MAP point.

Détail

Reçu le : 2014-10-16
Accepté le : 2016-01-20
DOI : 10.1051/m2an/2016005

Classification : 65M32, 65N35, 65K10
Keywords: Bayesian inverse problems, parametric operator equations, smolyak quadrature, sparsity, non-Gaussian prior, quasi-Newton methods, SR1 update, posterior reparametrization, richardson extrapolation