In this paper, we are interested in a diffusion process based on a gradient descent. The process is non Markov and has a memory term which is built as a weighted average of the drift term all along the past of the trajectory. For this type of diffusion, we study the long time behaviour of the process in terms of the memory. We exhibit some conditions for the long-time stability of the dynamical system and then provide, when stable, some convergence properties of the occupation measures and of the marginal distribution, to the associated steady regimes. When the memory is too long, we show that in general, the dynamical system has a tendency to explode, and in the particular Gaussian case, we explicitly obtain the rate of divergence.
Nous nous intéressons dans ce travail à une diffusion issue d'une descente de gradient, dont le terme de dérive utilise une mémoire sur le passé de la trajectoire. Le processus ainsi introduit est non-Markovien. Nous étudions les propriétés de stabilité et de convergence à l'équilibre des mesures d'occupation des trajectoires. Dans les situations stables, nous donnons des vitesses de convergence à la stationnarité alors que dans les cas où la mémoire possède une longue portée, nous prouvons l'explosion du système dynamique. Nous exhibons enfin des formules précises dans le cas gaussien.
Keywords: stochastic differential equation, memory diffusions, ergodic processes, Lyapunov function
@article{AIHPB_2014__50_2_564_0, author = {Gadat, S\'ebastien and Panloup, Fabien}, title = {Long time behaviour and stationary regime of memory gradient diffusions}, journal = {Annales de l'I.H.P. Probabilit\'es et statistiques}, pages = {564--601}, publisher = {Gauthier-Villars}, volume = {50}, number = {2}, year = {2014}, doi = {10.1214/12-AIHP536}, mrnumber = {3189085}, zbl = {1299.60092}, language = {en}, url = {http://archive.numdam.org/articles/10.1214/12-AIHP536/} }
TY - JOUR AU - Gadat, Sébastien AU - Panloup, Fabien TI - Long time behaviour and stationary regime of memory gradient diffusions JO - Annales de l'I.H.P. Probabilités et statistiques PY - 2014 SP - 564 EP - 601 VL - 50 IS - 2 PB - Gauthier-Villars UR - http://archive.numdam.org/articles/10.1214/12-AIHP536/ DO - 10.1214/12-AIHP536 LA - en ID - AIHPB_2014__50_2_564_0 ER -
%0 Journal Article %A Gadat, Sébastien %A Panloup, Fabien %T Long time behaviour and stationary regime of memory gradient diffusions %J Annales de l'I.H.P. Probabilités et statistiques %D 2014 %P 564-601 %V 50 %N 2 %I Gauthier-Villars %U http://archive.numdam.org/articles/10.1214/12-AIHP536/ %R 10.1214/12-AIHP536 %G en %F AIHPB_2014__50_2_564_0
Gadat, Sébastien; Panloup, Fabien. Long time behaviour and stationary regime of memory gradient diffusions. Annales de l'I.H.P. Probabilités et statistiques, Volume 50 (2014) no. 2, pp. 564-601. doi : 10.1214/12-AIHP536. http://archive.numdam.org/articles/10.1214/12-AIHP536/
[1] On the minimizing property of a second order dissipative system in Hilbert spaces. SIAM J. Control Optim. 38(4) (2000) 1102-1119. | MR | Zbl
.[2] A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics. Journal des Mathématiques Pures et Appliquées 81(8) (2002) 747-779. | MR | Zbl
, , and .[3] Minimization of convex functions on convex sets by means of differential equations (in Russian). Differ. Eq. 30(9) (1994) 1365-1375. | MR | Zbl
.[4] Existence and uniqueness of stationary solution of nonlinear stochastic differential equation with memory. Theory Probab. Appl. 47(4) (2002) 684-688. | MR | Zbl
.[5] Lyapunov exponents for stochastic differential equations with infinite memory and application to stochastic Navier-Stokes equations. Discrete Contin. Dyn. Syst. Ser. B 6(4) (2006) 697-709. | MR | Zbl
.[6] Stationary solutions of stochastic differential equations with memory and stochastic partial differential equations. Commun. Contemp. Math. 7(5) (2005) 553-582. | MR | Zbl
and .[7] Rate of convergence for ergodic continuous Markov processes: Lyapunov versus Poincare. J. Funct. Anal. 254(3) (2008) 727-759. | MR | Zbl
, and .[8] Lower bounds for densities of Asian type stochastic differential equations. J. Funct. Anal. 258(9) (2010) 3134-3164. | MR | Zbl
and .[9] Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dynam. Differ. Eq. 8(1) (1996) 141-176. | MR | Zbl
and .[10] Self-interacting diffusions. Probab. Theory Related Fields 122(1) (2002) 1-41. | MR | Zbl
, and .[11] Self-interacting diffusions III: Symmetric interactions. Ann. Probab. 33(5) (2003) 1716-1759. | MR | Zbl
and .[12] Trend to equilibrium and particle approximation for a weakly selfconsistent Vlasov-Fokker-Planck equation. Mathematical Modelling and Numerical Analysis 44(5) (2010) 867-884. | Numdam | MR | Zbl
, and .[13] Asymptotics for a gradient system with memory term. Proc. Amer. Math. Soc. 137(9) (2009) 3013-3024. | MR | Zbl
.[14] On the long time behavior of second order differential equations with asymptotically small dissipation. Trans. Amer. Math. Soc. 361(11) (2009) 5983-6017. | MR | Zbl
, and .[15] Second-order differential equations with asymptotically small dissipation and piecewise flat potentials. Electron. J. Differential Equations 17 (2009) 33-38. | MR | Zbl
, and .[16] Hypoelliptic non-homogeneous diffusions. Probab. Theory Related Fields 123(4) (2002) 453-483. | MR | Zbl
and .[17] Hypoellipticity theorems and conditionnal laws. Z. Wahrsch. verw. Gebiete 65(4) (1984) 573-597. | MR | Zbl
and .[18] Some particular self-interacting diffusions: Ergodic behaviour and almost sure convergence. Bernoulli 17(4) (2011) 1248-1267. | MR | Zbl
and .[19] Random walk with reinforcement. Preprint, 1987.
and .[20] Control and Nonlinearity. Mathematical Surveys and Monographs. American Mathematical Society, Providence, RI, 2007. | MR | Zbl
.[21] Self-attracting diffusions: Two case studies. Math. Ann. 303(1) (1995) 87-93. | MR | Zbl
and .[22] Ergodicity for Infinite-Dimensional Systems. Mathematical Society Lecture Note Series. Cambridge Univ. Press, London, 1996. | MR | Zbl
and .[23] Density estimates for a random noise propagating through a chain of differential equations. J. Funct. Anal. 259(6) (2010) 1577-1630. | MR | Zbl
and .[24] Subgeometric rates of convergence of f-ergodic strong Markov processes. Stochastic Process. Appl. 119(3) (2009) 897-923. | MR | Zbl
, and .[25] Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23(4) (1995) 1671-1691. | MR | Zbl
, and .[26] Asymptotic behavior of Brownian polymers. Probab. Theory Related Fields 92(3) (1992) 337-349. | MR | Zbl
and .[27] Markov Processes. Wiley, New York, 1986. | MR | Zbl
and .[28] On Malliavin's proof of Hörmander's theorem. Bull. Sci. Math. 165(6-7) (2011) 650-666. | MR | Zbl
.[29] Systèmes dynamiques dissipatifs et applications. R.M.A. Masson, Paris, 1991. | MR | Zbl
.[30] Stochastic Stability of Differential Equations. Sijthoff & Noordhoff, Alphen aan den Rijn, The Nederlands, 1980. | MR | Zbl
.[31] Hypoelliptic second order differential equations. Acta Math. 117(4) (1967) 147-171. | MR | Zbl
.[32] Stochastic Differential Equations and Diffusion Processes. North-Holland, Amsterdam, 1981. | MR | Zbl
and .[33] Pseudodifferential Operator with Applications. Lectures on Degenerate Elliptic Problems. Liguori, Naples, 1977. | MR | Zbl
.[34] The ODE method for some self-interacting diffusions on . Ann. Inst. Henri Poincaré Probab. Stat. 3 (2010) 618-643. | Numdam | MR | Zbl
.[35] Recursive computation of the invariant distribution of a diffusion: The case of a weakly mean reverting drift. Stoch. Dyn. 3(4) (2003) 435-451. | MR | Zbl
and .[36] Vertex-reinforced random walk. Probab. Theory Related Fields 1 (1992) 117-136. | MR | Zbl
.[37] Introduction to Optimization. Optimization Software, New York, 1987. | MR | Zbl
.[38] Self-attracting diffusions: Case of the constant interaction. Probab. Theory Related Fields 107(2) (1997) 177-196. | MR | Zbl
.[39] Diffusion processes. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability, Vol. III: Probability Theory 361-368. Univ. California Press, Berkeley, 1972. | MR | Zbl
and .[40] Introduction to Pseudodifferential and Fourier Integral Operators. Vol. 1. Plenum Press, New York, 1980. | MR | Zbl
.[41] Hypocoercivity. Mem. Amer. Math. Soc. 202(950) (2009) iv+141. | MR | Zbl
.[42] Large and moderate deviations and exponential convergence for stochastic damping Hamilton systems. Stochastic Process. Appl. 91(2) (2001) 205-238. | MR | Zbl
.Cited by Sources: