A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
ESAIM: Control, Optimisation and Calculus of Variations, Tome 24 (2018) no. 2, pp. 639-676.

In this paper, we investigate a class of infinite-horizon optimal control problems for stochastic differential equations with delays for which the associated second order Hamilton−Jacobi−Bellman (HJB) equation is a nonlinear partial differential equation with delays. We propose a new concept for the viscosity solution including time t and identify the value function of the optimal control problems as a unique viscosity solution to the associated second order HJB equation.

DOI : 10.1051/cocv/2017042
Classification : 93E20, 60H30, 49L20, 49L25
Mots clés : Second order Hamilton−Jacobi−Bellman equation, viscosity solution, infinite-horizon optimal control, stochastic differential equations with delays, existence and uniqueness
Zhou, Jianjun 1

1
@article{COCV_2018__24_2_639_0,
     author = {Zhou, Jianjun},
     title = {A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated {HJB} equation},
     journal = {ESAIM: Control, Optimisation and Calculus of Variations},
     pages = {639--676},
     publisher = {EDP-Sciences},
     volume = {24},
     number = {2},
     year = {2018},
     doi = {10.1051/cocv/2017042},
     mrnumber = {3816408},
     zbl = {1401.93234},
     language = {en},
     url = {http://archive.numdam.org/articles/10.1051/cocv/2017042/}
}
TY  - JOUR
AU  - Zhou, Jianjun
TI  - A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
JO  - ESAIM: Control, Optimisation and Calculus of Variations
PY  - 2018
SP  - 639
EP  - 676
VL  - 24
IS  - 2
PB  - EDP-Sciences
UR  - http://archive.numdam.org/articles/10.1051/cocv/2017042/
DO  - 10.1051/cocv/2017042
LA  - en
ID  - COCV_2018__24_2_639_0
ER  - 
%0 Journal Article
%A Zhou, Jianjun
%T A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
%J ESAIM: Control, Optimisation and Calculus of Variations
%D 2018
%P 639-676
%V 24
%N 2
%I EDP-Sciences
%U http://archive.numdam.org/articles/10.1051/cocv/2017042/
%R 10.1051/cocv/2017042
%G en
%F COCV_2018__24_2_639_0
Zhou, Jianjun. A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation. ESAIM: Control, Optimisation and Calculus of Variations, Tome 24 (2018) no. 2, pp. 639-676. doi : 10.1051/cocv/2017042. http://archive.numdam.org/articles/10.1051/cocv/2017042/

[1] N. Agram, S. Øhaadem, B. Ksendal and F. Proske, A maximum principle for infinite horizon delay equations. SIAM J. Math. Anal. 45 (2013) 2499–2522 | DOI | MR | Zbl

[2] A. Bátkai and S. Piazzera, Semigroups for Delay Equations, in vol. 10 of Res. Notes Math., edited by A.K. Peters, Ltd., Wellesley, MA (2005) | MR | Zbl

[3] A. Bensoussan, G. Da Prato, M. Delfour and S. Mitter, Representation and control of infinite dimensional systems, Birkhauser, Boston (1993) | DOI | MR | Zbl

[4] L. Breiman, Probability, Classics in Applied Mathematics. SIAM (1992) | MR | Zbl

[5] G. Carlier and R. Tahraoui, Hamilton–Jacobi–Bellman equations for the optimal control of a state equation with memory. ESAIM: COCV 16 (2010) 744–763 | Numdam | MR | Zbl

[6] M. Chang, T. Pang and Y. Yang, A stochastic portfolio optimization model with bounded memory. Math. Operat. Res. 36 (2011) 604–619 | DOI | MR | Zbl

[7] L. Chen and Z. Wu, Maximum principle for the stochastic optimal control problem with delay and application.Automatica 46 (2010) 1074–1080 | DOI | MR | Zbl

[8] M.G. Crandall, H. Ishii and P.L. Lions, Users guide to viscosity solutions of second order partial differential equations. Bull. Amer. Math. Soc. 27 (1992) 1–67 | DOI | MR | Zbl

[9] I. Elsanousi, B. Øksendal and A. Sulem, Some solvable stochastic control problems with delay. Stochastics Stochastics Rep. 71 (2000) 69–89 | DOI | MR | Zbl

[10] S. Federico, B. Goldys and F. Gozzi, HJB equations for the optimal control of differential equations with delays and state constraints, I: regularity of viscosity solutions. SIAM J. Control Optimiz. 48 (2010) 4910–4937 | DOI | MR | Zbl

[11] S. Federico, A stochastic control problem with delay arising in a pension fund model. Finance and Stochastics 15 (2011) 421–459 | DOI | MR | Zbl

[12] M. Fuhrman and G. Tessitore, Infinite horizon backward stochasticdifferential equations and elliptic equations in Hilbert spaces. Ann. Probab. 32 (2004) 607–660 | DOI | MR | Zbl

[13] M. Fuhrman, F. Masiero and G. Tessitore, Stochastic equations with delay: optimal control via BSDEs and regular solutions of Hamilton–Jacobi–Bellman equations. SIAM J. Control Optimiz. 48 (2010) 4624–4651 | DOI | MR | Zbl

[14] D. Gabay and M. Grasselli, Fair demographic risk sharing in defined contribution pension systems. J. Econ. Dynamics Control 36 (2012) 657–669 | DOI | MR | Zbl

[15] F. Gozzi and C. Marinelli, Stochastic optimal control of delay equations arising in advertising models, Stochastic partial differential equations and applications, edited by G. Da Prato and L. Tubaro. Marcel Dekker (2005) | MR | Zbl

[16] F. Gozzi and C. Marinelli, Stochastic Optimal Control of Delay Equations arising in Advertising Models, SPDE and Applications, edited by G. Da Prato and L. Tubaro (2006) 133–148 | MR | Zbl

[17] F. Gozzi, C. Marinelli and S. Savin, On controlled linear diffusions with delay in a model of optimal advertising under uncertainty with memory effects. J. Optimiz. Theory Appl. 142 (2009) 291–321 | DOI | MR | Zbl

[18] F. Gozzi, E. Rouy and A. Świȩch, Second order Hamilton-Jacobi equations in Hilbert spaces andstochastic boundary control. SIAM J. Control Optim.38 (2000) 400–430 | DOI | MR | Zbl

[19] V.B. Kolmanovskii and L.E. Shaikhet, Control of systems with aftereffect, American Mathematical Society, Translations of Math. Monograph 157 (1996) | MR | Zbl

[20] P.L. Lions, Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I. The case of bounded stochastic evolutions. Acta Math. 161 (1988) 243–78 | DOI | MR | Zbl

[21] P.L. Lions, Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. II. Optimal control of Zakai’s equation. in: Stochastic partial differential equations and applications, II, edited by G. Da Prato, L. Tubaro. Lect. Notes Math. In vol. 1390. Springer (1989) 147–170 | DOI | MR | Zbl

[22] P.L. Lions, Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III. Uniqueness of viscosity solutions for general second-order equations. J. Funct. Anal. 86 (1989) 1–18 | DOI | MR | Zbl

[23] S.E.A. Mohammed, Stochastic Functional Differential Equations. Res. Notes Math. Pitman, Boston, MA 99 (1984) | MR | Zbl

[24] E.J. Noh, J.H. Kim, An optimal portfolio model with stochastic volatility and stochastic interest rate. J. Math. Anal. Appl. 375 (2011) 510–522 | DOI | MR | Zbl

[25] B. Øksendal and A. Sulem, A maximum principle for optimal control of stochastic systems with delay with applications to finance, Optimal Control and PDE, Essays in Honour of Alain Bensoussan, edited by J.L. Menaldi, E. Rofman and A. Sulem IOS Press, Amsterdam (2001) 64–79 | MR | Zbl

[26] B. Øksendal, A. Sulem and T. Zhang, Optimal control of stochastic delay equations and time advanced backward stochastic differential equations. Adv. Appl. Probab. 43 (2011) 572–596 | DOI | MR | Zbl

[27] T. Pang, Portfolio optimization models on infinite time horizon. J. Optimiz. Theory and Appl. 122 (2004) 573–597 | DOI | MR | Zbl

[28] T. Pang, Stochastic portfolio optimization with log utility. Int. J. Theor. Appl. Finance 9 (2006) 869–887 | DOI | MR | Zbl

[29] T. Pang and A. Hussain, An application of functional Its formula to stochastic portfolio optimization with bounded memory, Proceedingsof 2015 SIAM Conference on Control and Its Applications (CT15) 8–10, Paris, France 159–166 (2015) | DOI

[30] T. Pang and K. Varga, Optimal investment and consumption for a portfolio with stochastic dividends, www4.ncsu.edu

[31] G.D. Prato and J. Zabczyk, Stochastic Equations in Infinite Dimensions, vol. 44 of Encyclopedia of Mathematics and its Applications. Cambridge University Press, Cambridge (1992) | MR | Zbl

[32] A. Świȩch, “Unbounded” second order partial differential equations in infinite-dimensional Hilbertspaces. Commun. Partial Differ. Equ. 19 (1994) 11–12, 1999–2036 | MR | Zbl

[33] J. Yan, Measure theory handouts, Science Press, Beijing (2004)

[34] J. Zhou and Z. Zhang, Optimal control problems for stochastic delay evolution equations in Banach spaces. Inter. J. Control 84 (2011) 1295–1309 | DOI | MR | Zbl

[35] J. Zhou and B. Liu, The existence and uniqueness of the solution for nonlinear Kolmogorov equations. J. Differ. Equ. 253 (2012) 2873–2915 | DOI | MR | Zbl

[36] J. Zhou, A Class of Delay Optimal Control Problems and ViscositySolutions toAssociatedHamilton−Jacobi−Bellman Equations, preprint available at: | arXiv

Cité par Sources :