A deterministic affine-quadratic optimal control problem is considered. Due to the nature of the problem, optimal controls exist under some very mild conditions. Further, it is shown that under some assumptions, the optimal control is unique which leads to the differentiability of the value function. Therefore, the value function satisfies the corresponding Hamilton-Jacobi-Bellman equation in the classical sense, and the optimal control admits a state feedback representation. Under some additional conditions, it is shown that the value function is actually twice differentiable and the so-called quasi-Riccati equation is derived, whose solution can be used to construct the state feedback representation for the optimal control.
Mots clés : affine quadratic optimal control, dynamic programming, Hamilton-Jacobi-Bellman equation, quasi-Riccati equation, state feedback representation
@article{COCV_2014__20_3_633_0,
author = {Wang, Yuanchang and Yong, Jiongmin},
title = {A deterministic affine-quadratic optimal control problem},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
pages = {633--661},
publisher = {EDP-Sciences},
volume = {20},
number = {3},
year = {2014},
doi = {10.1051/cocv/2013078},
mrnumber = {3270127},
zbl = {1293.49004},
language = {en},
url = {http://archive.numdam.org/articles/10.1051/cocv/2013078/}
}
TY - JOUR AU - Wang, Yuanchang AU - Yong, Jiongmin TI - A deterministic affine-quadratic optimal control problem JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2014 SP - 633 EP - 661 VL - 20 IS - 3 PB - EDP-Sciences UR - http://archive.numdam.org/articles/10.1051/cocv/2013078/ DO - 10.1051/cocv/2013078 LA - en ID - COCV_2014__20_3_633_0 ER -
%0 Journal Article %A Wang, Yuanchang %A Yong, Jiongmin %T A deterministic affine-quadratic optimal control problem %J ESAIM: Control, Optimisation and Calculus of Variations %D 2014 %P 633-661 %V 20 %N 3 %I EDP-Sciences %U http://archive.numdam.org/articles/10.1051/cocv/2013078/ %R 10.1051/cocv/2013078 %G en %F COCV_2014__20_3_633_0
Wang, Yuanchang; Yong, Jiongmin. A deterministic affine-quadratic optimal control problem. ESAIM: Control, Optimisation and Calculus of Variations, Tome 20 (2014) no. 3, pp. 633-661. doi : 10.1051/cocv/2013078. http://archive.numdam.org/articles/10.1051/cocv/2013078/
[1] and , Global optimal feedback control for general nonlinear systems with nonquadratic performance criteria. System Control Lett. 53 (2004) 327-346. | MR | Zbl
[2] and , Optimal control of nonlinear systems, Optimization and Control with Applications. In vol. 96 of Appl. Optim. Springer, New York (2005) 353-367. | MR | Zbl
[3] , and , Nonlinear feedback controllers and compensators: a state-dependent Riccati equation approach. Comput. Optim. Appl. 37 (2007) 177-218. | MR | Zbl
[4] and , Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. Birkhäuser, Boston (1997). | MR | Zbl
[5] and , On the Bellman equation for some unbounded control problems. Nonlinear Differ. Eqs. Appl. 4 (1997) 491-510. | MR | Zbl
[6] and , On the differentiability of the value function in dynamic models of economics. Econometrica 47 (1979) 727-732. | MR | Zbl
[7] , Optimal Control Theory. Springer-Verlag, New York (1974). | MR | Zbl
[8] and , Perturbation Analysis of Optimization Problems. Springer, New York (2000). | MR | Zbl
[9] and , Some characterizatins of optimal trajecotries in control theory. SIAM J. Control Optim. 29 (1991) 1322-1347. | MR | Zbl
[10] , State-dependent Riccati equation (SDRE) control: a survey. Proc. 17th World Congress IFAC (2008) 3761-3775.
[11] , Value Function in Optimal Control, Mathematical Control Theory, Part 1, 2 (2001) 516-653. | MR | Zbl
[12] and , Implicit functions and their differentials in general analysis. Trans. Amer. Math. Soc. 29 (1927) 127-153. | JFM | MR
[13] and , Solution of forward-backward stochastic differential equations. Probab. Theory Rel. Fields 103 (1995) 273-283. | MR | Zbl
[14] , Contributions to the theory of optimal control. Bol. Soc. Mat. Mexicana 5 (1960) 102-119. | MR | Zbl
[15] and , Forward-Backward Stochastic Differential Equations and Their Applications. Vol. 1702 of Lect. Notes Math. Springer-Verlag (1999). | MR | Zbl
[16] and , Hamilton-Jacobi equations and two-person zero-sum differential games with unbounded controls. ESAIM: COCV 19 (2013) 404-437. | Numdam | MR | Zbl
[17] and , Differentiability of the value function in continuous-time economic models. J. Math. Anal. Appl. 394 (2012) 305-323. | MR | Zbl
[18] , Finding adapted solutions of forward-backward stochastic differential equations - method of continuation, Probab. Theory Rel. Fields 107 (1997) 537-572. | MR | Zbl
[19] , Stochastic optimal control and forward-backward stochastic differential equations. Comput. Appl. Math. 21 (2002) 369-403. | MR | Zbl
[20] , Forward backward stochastic differential equations with mixed initial and terminal conditions. Trans. AMS 362 (2010) 1047-1096. | MR | Zbl
[21] and , Stochastic Control: Hamiltonian Systems and HJB Equations. Springer-Verlag (1999). | MR | Zbl
[22] , A nonquadratic Bolza problem and a quasi-Riccati equation for distributed parameter systems. SIAM J. Control Optim. 25 (1987) 905-920. | MR | Zbl
[23] , Synthesis of time-variant optimal control with nonquadratic criteria. J. Math. Anal. Appl. 209 (1997) 662-682. | MR | Zbl
[24] , Nonlinear Functional Analysis and Its Applications, I: Fixed-Point Theorems. Springer-Verlag, New York (1986) 150-151. | MR | Zbl
[25] , Nonlinear Functional Analysis and Its Applications, II/B: Nonlinear Monotone Operators. Springer-Verlag, New York (1990). | MR | Zbl
Cité par Sources :
