Hamilton-Jacobi-Bellman equations for the optimal control of a state equation with memory

Carlier, Guillaume  ; Tahraoui, Rabah 

ESAIM: Control, Optimisation and Calculus of Variations, Tome 16 (2010) no. 3, pp. 744-763

Résumé

This article is devoted to the optimal control of state equations with memory of the form: $\dot{x}\left(t\right)=F(x\left(t\right),u\left(t\right),{\int }_0^{+\infty }A\left(s\right)x(t-s)\mathrm{d}s),t>0,$ with initial conditions $x\left(0\right)=x,x(-s)=z\left(s\right),s>0$. Denoting by $y_{x,z,u}$ the solution of the previous Cauchy problem and: $v(x,z):={inf}_{u\in V}\left\{{\int }_0^{+\infty }{\mathrm{e}}^{-\lambda s}L(y_{x,z,u}\left(s\right),u\left(s\right))\mathrm{d}s\right\}$ where V is a class of admissible controls, we prove that v is the only viscosity solution of an Hamilton-Jacobi-Bellman equation of the form: $\lambda v(x,z)+H(x,z,{\nabla }_{x}v(x,z))+\langle D_{z}v(x,z),\dot{z}\rangle =0$ in the sense of the theory of viscosity solutions in infinite-dimensions of Crandall and Lions.

Détail

DOI : 10.1051/cocv/2009024

Classification : 49L20, 49L25
Keywords: dynamic programming, state equations with memory, viscosity solutions, Hamilton-Jacobi-Bellman equations in infinite dimensions