The partially observed optimal control problem is considered for forward-backward doubly stochastic systems with controls entering into the diffusion and the observation. The maximum principle is proven for the partially observable optimal control problems. A probabilistic approach is used, and the adjoint processes are characterized as solutions of related forward-backward doubly stochastic differential equations in finite-dimensional spaces. Then, our theoretical result is applied to study a partially-observed linear-quadratic optimal control problem for a fully coupled forward-backward doubly stochastic system.
Mots-clés : forward-backward doubly stochastic system, partially observed optimal control, maximum principle, adjoint equation
@article{COCV_2013__19_3_828_0, author = {Shi, Yufeng and Zhu, Qingfeng}, title = {Partially observed optimal controls of forward-backward doubly stochastic systems}, journal = {ESAIM: Control, Optimisation and Calculus of Variations}, pages = {828--843}, publisher = {EDP-Sciences}, volume = {19}, number = {3}, year = {2013}, doi = {10.1051/cocv/2012035}, mrnumber = {3092364}, zbl = {1269.93138}, language = {en}, url = {http://archive.numdam.org/articles/10.1051/cocv/2012035/} }
TY - JOUR AU - Shi, Yufeng AU - Zhu, Qingfeng TI - Partially observed optimal controls of forward-backward doubly stochastic systems JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2013 SP - 828 EP - 843 VL - 19 IS - 3 PB - EDP-Sciences UR - http://archive.numdam.org/articles/10.1051/cocv/2012035/ DO - 10.1051/cocv/2012035 LA - en ID - COCV_2013__19_3_828_0 ER -
%0 Journal Article %A Shi, Yufeng %A Zhu, Qingfeng %T Partially observed optimal controls of forward-backward doubly stochastic systems %J ESAIM: Control, Optimisation and Calculus of Variations %D 2013 %P 828-843 %V 19 %N 3 %I EDP-Sciences %U http://archive.numdam.org/articles/10.1051/cocv/2012035/ %R 10.1051/cocv/2012035 %G en %F COCV_2013__19_3_828_0
Shi, Yufeng; Zhu, Qingfeng. Partially observed optimal controls of forward-backward doubly stochastic systems. ESAIM: Control, Optimisation and Calculus of Variations, Tome 19 (2013) no. 3, pp. 828-843. doi : 10.1051/cocv/2012035. http://archive.numdam.org/articles/10.1051/cocv/2012035/
[1] A maximum principle for stochastic control with partial information. Stoch. Anal. Appl. 25 (2007) 705-717. | MR | Zbl
and ,[2] Optimality conditions of controlled backward doubly stochastic differential equations. Random Oper. Stoch. Equ. 18 (2010) 247-265. | MR | Zbl
and ,[3] Weak solutions of stochastic PDEs and backward doubly stochastic differential equations. J. Theoret. Probab. 14 (2001) 125-164. | MR | Zbl
and ,[4] The partially-observed stochastic minimum principle. SIAM J. Control Optim. 27 (1989) 1279-1292. | MR | Zbl
, and ,[5] Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions. Stochastics 9 (1983) 169-222. | MR | Zbl
,[6] An introductory approach to duality in optimal stochastic control. SIAM J. Control Optim. 20 (1978) 62-78. | MR | Zbl
,[7] Maximum principle for backward doubly stochastic control systems with applications. SIAM J. Control Optim. 48 (2010) 4224-4241. | MR | Zbl
, and ,[8] The maximum principle for optimal control of diffusions with partial information. SIAM J. Control Optim. 25 (1987) 341-361. | MR | Zbl
,[9] Stochastic PDIEs with nonlinear Neumann boundary conditions and generalized backward doubly stochastic differential equations driven by Lévy processes. J. Comput. Appl. Math. 229 (2009) 230-239. | MR | Zbl
and ,[10] A maximum principle for partial information backward stochastic control problems with applications. SIAM J. Control Optim. 48 (2009) 2106-2117. | MR | Zbl
, and ,[11] Necessary conditions for continuous parameter stochastic optimization problems. SIAM J. Control Optim. 10 (1972) 550-565. | MR | Zbl
,[12] General necessary conditions for partially-observed optimal stochastic controls. J. Appl. Probab. 32 (1995) 1118-1137. | MR | Zbl
and ,[13] A maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information. Sci. China Ser. A 52 (2009) 1579-1588. | MR | Zbl
,[14] Necessary and sufficient conditions for optimal control of stochastic systems associated with Lévy processes. Sci. China Ser. F 52 (2009) 1982-1992. | MR | Zbl
and ,[15] Backward doubly stochastic differential equations and systems of quasilinear parabolic SPDE's. Probab. Theory Related Fields 98 (1994) 209-227. | MR | Zbl
and ,[16] A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28 (1990) 966-979. | MR | Zbl
,[17] A type of time-symmetric forward-backward stochastic differential equations. C. R. Acad. Sci. Paris, Ser. I 336 (2003) 773-778. | MR | Zbl
and ,[18] The Mathematical Theory of Optimal Control Processe. Interscience, John Wiley, New York (1962).
, , and ,[19] Stochastic PDIEs and backward doubly stochastic differential equations driven by Lévy processes. J. Comput. Appl. Math. 223 (2009) 901-907. | MR | Zbl
, and ,[20] Comparison theorems of backward doubly stochastic differential equations and applications. Stoch. Anal. Appl. 23 (2005) 97-110. | MR | Zbl
, and ,[21] The maximum principle for fully coupled forward backward stochastic control system. Acta Automat. Sinica 32 (2006) 161-169. | MR
and ,[22] Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems. J. Optim. Theory Appl. 145 (2010) 543-578. | MR | Zbl
and ,[23] The maximum principle for partially observed optimal control of stochastic differential equations. SIAM J. Control Optim. 36 (1998) 1596-1617. | MR | Zbl
,[24] The maximum principle for stochastic recursive optimal control problems under partial information. IEEE Trans. Autom. Control 54 (2009) 1230-1242. | MR
and ,[25] Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems. Syst. Sci. Math. Sci. 11 (1998) 249-259. | MR | Zbl
,[26] A maximum principle for partially observed optimal control of forward-backward stochastic control systems. Sci. China Ser. F 53 (2010) 2205-2214. | MR | Zbl
,[27] Stochastic maximum principle for optimal control problem of forward and backward system. J. Aust. Math. Soc. 37 (1995) 172-185. | MR | Zbl
,[28] Maximum principle for forward-backward doubly stochastic control systems and applications. ESAIM: COCV 17 (2011) 1174-1197. | Numdam | MR | Zbl
and ,[29] Optimal Control of Stochastic Partial Differential Equations (2010) arXiv:1009.6061v2.
and ,[30] Pathwise stationary solutions of stochastic partial differential equations and backward doubly stochastic differential equations on infinite horizon. J. Funct. Anal. 252 (2007) 171-219. | MR | Zbl
and ,[31] Stationary solutions of SPDEs and infinite horizon BDSDEs under non-Lipschitz coefficients. J. Differ. Equations 248 (2010) 953-991. | MR | Zbl
and ,[32] Maximum principle for partially observed optimal control of backward doubly stochastic systems, in Proc. of the 30th Chinese Control Conference (2011) 1383-1388.
, and ,Cité par Sources :