A Bellman approach for two-domains optimal control problems in ℝN
ESAIM: Control, Optimisation and Calculus of Variations, Tome 19 (2013) no. 3, pp. 710-739.

This article is the starting point of a series of works whose aim is the study of deterministic control problems where the dynamic and the running cost can be completely different in two (or more) complementary domains of the space ℝN. As a consequence, the dynamic and running cost present discontinuities at the boundary of these domains and this is the main difficulty of this type of problems. We address these questions by using a Bellman approach: our aim is to investigate how to define properly the value function(s), to deduce what is (are) the right Bellman Equation(s) associated to this problem (in particular what are the conditions on the set where the dynamic and running cost are discontinuous) and to study the uniqueness properties for this Bellman equation. In this work, we provide rather complete answers to these questions in the case of a simple geometry, namely when we only consider two different domains which are half spaces: we properly define the control problem, identify the different conditions on the hyperplane where the dynamic and the running cost are discontinuous and discuss the uniqueness properties of the Bellman problem by either providing explicitly the minimal and maximal solution or by giving explicit conditions to have uniqueness.

DOI : 10.1051/cocv/2012030
Classification : 49L20, 49L25, 35F21
Mots-clés : optimal control, discontinuous dynamic, Bellman equation, viscosity solutions 
@article{COCV_2013__19_3_710_0,
     author = {Barles, G. and Briani, A. and Chasseigne, E.},
     title = {A {Bellman} approach for two-domains optimal control problems in $\mathbb {R}^N$},
     journal = {ESAIM: Control, Optimisation and Calculus of Variations},
     pages = {710--739},
     publisher = {EDP-Sciences},
     volume = {19},
     number = {3},
     year = {2013},
     doi = {10.1051/cocv/2012030},
     zbl = {1287.49028},
     language = {en},
     url = {https://www.numdam.org/articles/10.1051/cocv/2012030/}
}
TY  - JOUR
AU  - Barles, G.
AU  - Briani, A.
AU  - Chasseigne, E.
TI  - A Bellman approach for two-domains optimal control problems in $\mathbb {R}^N$
JO  - ESAIM: Control, Optimisation and Calculus of Variations
PY  - 2013
SP  - 710
EP  - 739
VL  - 19
IS  - 3
PB  - EDP-Sciences
UR  - https://www.numdam.org/articles/10.1051/cocv/2012030/
DO  - 10.1051/cocv/2012030
LA  - en
ID  - COCV_2013__19_3_710_0
ER  - 
%0 Journal Article
%A Barles, G.
%A Briani, A.
%A Chasseigne, E.
%T A Bellman approach for two-domains optimal control problems in $\mathbb {R}^N$
%J ESAIM: Control, Optimisation and Calculus of Variations
%D 2013
%P 710-739
%V 19
%N 3
%I EDP-Sciences
%U https://www.numdam.org/articles/10.1051/cocv/2012030/
%R 10.1051/cocv/2012030
%G en
%F COCV_2013__19_3_710_0
Barles, G.; Briani, A.; Chasseigne, E. A Bellman approach for two-domains optimal control problems in $\mathbb {R}^N$. ESAIM: Control, Optimisation and Calculus of Variations, Tome 19 (2013) no. 3, pp. 710-739. doi : 10.1051/cocv/2012030. https://www.numdam.org/articles/10.1051/cocv/2012030/

[1] J.-P. Aubin and H. Frankowska, Set-valued analysis. Systems AND Control: Foundations and Applications, vol. 2. Birkhuser Boston, Inc. Boston, MA (1990). | MR | Zbl

[2] Y. Achdou, F. Camilli, A. Cutri and N. Tchou, Hamilton-Jacobi equations constrained on networks, NDEA Nonlinear Differential Equation and Application, to appear (2012). | MR | Zbl

[3] A.S. Mishra and G.D. Veerappa Gowda, Explicit Hopf-Lax type formulas for Hamilton-Jacobi equations and conservation laws with discontinuous coefficients. J. Diff. Eq. 241 (2007) 1-31. | MR | Zbl

[4] M. Bardi and I. Capuzzo Dolcetta, Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations, Systems and Control: Foundations & Applications. Birkhauser Boston Inc., Boston, MA (1997). | MR | Zbl

[5] G. Barles, Solutions de viscosité des équations de Hamilton-Jacobi, Springer-Verlag, Paris (1994). | MR | Zbl

[6] G. Barles and E.R. Jakobsen, On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman equations. ESAIM: M2AN 36 (2002) 33-54. | Numdam | MR | Zbl

[7] G. Barles and B. Perthame, Exit time problems in optimal control and vanishing viscosity method. SIAM J. Control Optim. 26 (1988) 1133-1148. | MR | Zbl

[8] G. Barles and B. Perthame, Comparison principle for Dirichlet type Hamilton-Jacobi Equations and singular perturbations of degenerated elliptic equations. Appl. Math. Optim. 21 (1990) 21-44. | MR | Zbl

[9] A.-P. Blanc, Deterministic exit time control problems with discontinuous exit costs. SIAM J. Control Optim. 35 (1997) 399-434. | MR | Zbl

[10] A-P. Blanc, Comparison principle for the Cauchy problem for Hamilton-Jacobi equations with discontinuous data. Nonlinear Anal. Ser. A Theory Methods 45 (2001) 1015-1037. | MR | Zbl

[11] A. Bressan and Y. Hong, Optimal control problems on stratified domains. Netw. Heterog. Media 2 (2007) 313-331 (electronic). | MR | Zbl

[12] F Camilli and A. Siconolfi, Time-dependent measurable Hamilton-Jacobi equations. Comm. Partial Differ. Equ. 30 (2005) 813-847. | MR | Zbl

[13] G. Coclite and N. Risebro, Viscosity solutions of Hamilton-Jacobi equations with discontinuous coefficients. J. Hyperbolic Differ. Equ. 4 (2007) 771-795. | MR | Zbl

[14] C. De Zan and P. Soravia, Cauchy problems for noncoercive Hamilton-Jacobi-Isaacs equations with discontinuous coefficients. Interfaces Free Bound 12 (2010) 347-368. | MR | Zbl

[15] K. Deckelnick and C. Elliott, Uniqueness and error analysis for Hamilton-Jacobi equations with discontinuities. Interfaces Free Bound 6 (2004) 329-349. | MR | Zbl

[16] P. Dupuis, A numerical method for a calculus of variations problem with discontinuous integrand. Applied stochastic analysis, New Brunswick, NJ 1991. Lect. Notes Control Inform. Sci., vol. 177. Springer, Berlin (1992) 90-107. | MR

[17] A.F. Filippov, Differential equations with discontinuous right-hand side. Matematicheskii Sbornik 51 (1960) 99-128. Amer. Math. Soc. Transl. 42 (1964) 199-231 (English translation Series 2). | MR | Zbl

[18] M. Garavello and P. Soravia, Optimality principles and uniqueness for Bellman equations of unbounded control problems with discontinuous running cost. NoDEA Nonlinear Differ. Equ. Appl. 11 (2004) 271-298. | MR | Zbl

[19] M. Garavello and P. Soravia, Representation formulas for solutions of the HJI equations with discontinuous coefficients and existence of value in differential games. J. Optim. Theory Appl. 130 (2006) 209-229. | MR | Zbl

[20] Y. Giga, P. Gòrka and P. Rybka, A comparison principle for Hamilton-Jacobi equations with discontinuous Hamiltonians. Proc. Amer. Math. Soc. 139 (2011) 1777-1785. | MR | Zbl

[21] D. Gilbarg and N.S. Trudinger, Elliptic Partial Differential Equations of Second-Order. Springer, New-York (1983). | MR | Zbl

[22] Lions P.L. Generalized Solutions of Hamilton-Jacobi Equations, Res. Notes Math., vol. 69. Pitman, Boston (1982). | MR | Zbl

[23] R.T. Rockafellar, Convex analysis, Princeton Mathematical Series, 28, Princeton University Press, Princeton, N.J. (1970). | MR | Zbl

[24] C. Imbert, R. Monneau and H. Zidani, A Hamilton-Jacobi approach to junction problems and applications to traffic flows, ESAIM: COCV 19 (2013) 1-316. | Numdam | MR | Zbl

[25] H.M. Soner, Optimal control with state-space constraint I. SIAM J. Control Optim. 24 (1986) 552-561. | MR | Zbl

[26] D. Schieborn and F. Camilli, Viscosity solutions of Eikonal equations on topological networks, to appear in Calc. Var. Partial Differential Equations. | MR | Zbl

[27] P. Soravia, Degenerate eikonal equations with discontinuous refraction index. ESAIM: COCV 12 (2006). | Numdam | MR | Zbl

[28] T. Wasewski, Systèmes de commande et équation au contingent. Bull. Acad. Pol. Sci. 9 (1961) 151-155. | Zbl

  • Ohavi, Isaac Comparison principle for Walsh's spider HJB equations with non linear local-time Kirchhoff's boundary condition, Journal of Mathematical Analysis and Applications, Volume 547 (2025) no. 2, p. 129300 | DOI:10.1016/j.jmaa.2025.129300
  • Chenevat, Ruben; Cheviron, Bruno; Roux, Sébastien; Rapaport, Alain, 2024 IEEE 63rd Conference on Decision and Control (CDC) (2024), p. 1004 | DOI:10.1109/cdc56724.2024.10886617
  • El Khatib, N.; Zaydan, M. Regularity results for discontinuous Hamilton-Jacobi equation with a moving in time domain, Applicable Analysis (2024), p. 1 | DOI:10.1080/00036811.2024.2441233
  • Cardaliaguet, P.; Forcadel, N. Microscopic Derivation of a Traffic Flow Model with a Bifurcation, Archive for Rational Mechanics and Analysis, Volume 248 (2024) no. 1 | DOI:10.1007/s00205-023-01948-8
  • Chang-Lara, Héctor A. Well-posedness for a transmission problem connecting first and second-order operators, ESAIM: Control, Optimisation and Calculus of Variations, Volume 30 (2024), p. 58 | DOI:10.1051/cocv/2024047
  • Forcadel, Nicolas; Imbert, Cyril; Monneau, Régis Nonconvex coercive Hamilton–Jacobi equations : Guerand’s relaxation revisited, Pure and Applied Analysis, Volume 6 (2024) no. 4, p. 1055 | DOI:10.2140/paa.2024.6.1055
  • Schumacher, Johannes M.; Reddy, Puduru Viswanadha; Engwerda, Jacob C. Jump Equilibria in Public-Good Differential Games with a Single State Variable, Dynamic Games and Applications, Volume 12 (2022) no. 3, p. 784 | DOI:10.1007/s13235-021-00415-x
  • Tien, Phan Trong; Van Bang, Tran Hamilton–Jacobi equations for optimal control on junctions with unbounded running cost functions, Applicable Analysis, Volume 100 (2021) no. 7, p. 1397 | DOI:10.1080/00036811.2019.1643012
  • Bayraktar, Erhan; Poor, H. Vincent; Zhang, Xin Malicious Experts Versus the Multiplicative Weights Algorithm in Online Prediction, IEEE Transactions on Information Theory, Volume 67 (2021) no. 1, p. 559 | DOI:10.1109/tit.2020.3025866
  • Dao, Manh-Khang; Djehiche, Boualem Hamilton–Jacobi equations for optimal control on multidimensional junctions with entry costs, Nonlinear Differential Equations and Applications NoDEA, Volume 27 (2020) no. 2 | DOI:10.1007/s00030-020-0625-z
  • Carlini, E.; Festa, A.; Forcadel, N. A Semi-Lagrangian Scheme for Hamilton–Jacobi–Bellman Equations on Networks, SIAM Journal on Numerical Analysis, Volume 58 (2020) no. 6, p. 3165 | DOI:10.1137/19m1260931
  • Achdou, Yves; Tchou, Nicoletta Homogenization of a transmission problem with Hamilton–Jacobi equations and a two-scale interface. Effective transmission conditions, Journal de Mathématiques Pures et Appliquées, Volume 122 (2019), p. 164 | DOI:10.1016/j.matpur.2018.04.005
  • Bagagiolo, Fabio; Maggistro, Rosario Hybrid Thermostatic Approximations of Junctions for Some Optimal Control Problems on Networks, SIAM Journal on Control and Optimization, Volume 57 (2019) no. 4, p. 2415 | DOI:10.1137/17m111907x
  • Siconolfi, Antonio; Sorrentino, Alfonso Global results for eikonal Hamilton–Jacobi equations on networks, Analysis PDE, Volume 11 (2018) no. 1, p. 171 | DOI:10.2140/apde.2018.11.171
  • Festa, Adriano Domain decomposition based parallel Howard’s algorithm, Mathematics and Computers in Simulation, Volume 147 (2018), p. 121 | DOI:10.1016/j.matcom.2017.04.008
  • Imbert, Cyril; Nguyen, Vinh Duc Effective junction conditions for degenerate parabolic equations, Calculus of Variations and Partial Differential Equations, Volume 56 (2017) no. 6 | DOI:10.1007/s00526-017-1239-0
  • Imbert, Cyril; Monneau, Régis Quasi-convex Hamilton-Jacobi equations posed on junctions: The multi-dimensional case, Discrete Continuous Dynamical Systems - A, Volume 37 (2017) no. 12, p. 6405 | DOI:10.3934/dcds.2017278
  • Graber, P.J.; Hermosilla, C.; Zidani, H. Discontinuous solutions of Hamilton–Jacobi equations on networks, Journal of Differential Equations, Volume 263 (2017) no. 12, p. 8418 | DOI:10.1016/j.jde.2017.08.040
  • Iturriaga, Renato; Sánchez Morgado, Héctor The Lax-Oleinik semigroup on graphs, Networks Heterogeneous Media, Volume 12 (2017) no. 4, p. 643 | DOI:10.3934/nhm.2017026
  • Goreac, Dan; Kobylanski, Magdalena; Martinez, Miguel A Piecewise Deterministic Markov Toy Model for Traffic/Maintenance and Associated Hamilton–Jacobi Integrodifferential Systems on Networks, Applied Mathematics Optimization, Volume 74 (2016) no. 2, p. 375 | DOI:10.1007/s00245-015-9319-z
  • Achdou, Yves; Oudet, Salomé; Tchou, Nicoletta Effective transmission conditions for Hamilton–Jacobi equations defined on two domains separated by an oscillatory interface, Journal de Mathématiques Pures et Appliquées, Volume 106 (2016) no. 6, p. 1091 | DOI:10.1016/j.matpur.2016.04.002
  • Galise, Giulio; Imbert, Cyril; Monneau, Régis A junction condition by specified homogenization and application to traffic lights, Analysis PDE, Volume 8 (2015) no. 8, p. 1891 | DOI:10.2140/apde.2015.8.1891
  • Achdou, Yves; Tchou, Nicoletta Hamilton-Jacobi Equations on Networks as Limits of Singularly Perturbed Problems in Optimal Control: Dimension Reduction, Communications in Partial Differential Equations, Volume 40 (2015) no. 4, p. 652 | DOI:10.1080/03605302.2014.974764
  • Achdou, Yves; Oudet, Salomé; Tchou, Nicoletta Hamilton–Jacobi equations for optimal control on junctions and networks, ESAIM: Control, Optimisation and Calculus of Variations, Volume 21 (2015) no. 3, p. 876 | DOI:10.1051/cocv/2014054
  • Hermosilla, C.; Zidani, H. Infinite horizon problems on stratifiable state-constraints sets, Journal of Differential Equations, Volume 258 (2015) no. 4, p. 1430 | DOI:10.1016/j.jde.2014.11.001
  • Barles, Guy; Chasseigne, Emmanuel (Almost) Everything you always wanted to know about deterministic control problems in stratified domains, Networks Heterogeneous Media, Volume 10 (2015) no. 4, p. 809 | DOI:10.3934/nhm.2015.10.809
  • Rao, Z.; Siconolfi, A.; Zidani, H. Transmission conditions on interfaces for Hamilton–Jacobi–Bellman equations, Journal of Differential Equations, Volume 257 (2014) no. 11, p. 3978 | DOI:10.1016/j.jde.2014.07.015
  • Barles, G.; Briani, A.; Chasseigne, E. A Bellman Approach for Regional Optimal Control Problems in RN, SIAM Journal on Control and Optimization, Volume 52 (2014) no. 3, p. 1712 | DOI:10.1137/130922288
  • Forcadel, Nicolas; Rao, Zhiping Singular Perturbation of Optimal Control Problems on MultiDomains, SIAM Journal on Control and Optimization, Volume 52 (2014) no. 5, p. 2917 | DOI:10.1137/130916709
  • Rao, Zhiping; Zidani, Hasnaa Hamilton–Jacobi–Bellman Equations on Multi-domains, Control and Optimization with PDE Constraints, Volume 164 (2013), p. 93 | DOI:10.1007/978-3-0348-0631-2_6

Cité par 30 documents. Sources : Crossref