Based on a modified secant equation, we propose a scalar approximation of the Hessian to be used in the trust region subproblem. Then, we suggest an adaptive nonmonotone trust region algorithm with a simple quadratic model. Under proper conditions, it is briefly shown that the proposed algorithm is globally and locally superlinearly convergent. Numerical experiments are done on a set of unconstrained optimization test problems of the CUTEr collection, using the Dolan-Moré performance profile. They demonstrate efficiency of the proposed algorithm.
Mots-clés : Unconstrained optimization, trust region method, secant equation, adaptive radius, global convergence, superlinear convergence
@article{RO_2019__53_3_829_0,
author = {Rezaee, Saeed and Babaie-Kafaki, Saman},
title = {An adaptive nonmonotone trust region method based on a modified scalar approximation of the {Hessian} in the successive quadratic subproblems},
journal = {RAIRO - Operations Research - Recherche Op\'erationnelle},
pages = {829--839},
publisher = {EDP-Sciences},
volume = {53},
number = {3},
year = {2019},
doi = {10.1051/ro/2017057},
zbl = {1461.65182},
mrnumber = {3973925},
language = {en},
url = {http://archive.numdam.org/articles/10.1051/ro/2017057/}
}
TY - JOUR AU - Rezaee, Saeed AU - Babaie-Kafaki, Saman TI - An adaptive nonmonotone trust region method based on a modified scalar approximation of the Hessian in the successive quadratic subproblems JO - RAIRO - Operations Research - Recherche Opérationnelle PY - 2019 SP - 829 EP - 839 VL - 53 IS - 3 PB - EDP-Sciences UR - http://archive.numdam.org/articles/10.1051/ro/2017057/ DO - 10.1051/ro/2017057 LA - en ID - RO_2019__53_3_829_0 ER -
%0 Journal Article %A Rezaee, Saeed %A Babaie-Kafaki, Saman %T An adaptive nonmonotone trust region method based on a modified scalar approximation of the Hessian in the successive quadratic subproblems %J RAIRO - Operations Research - Recherche Opérationnelle %D 2019 %P 829-839 %V 53 %N 3 %I EDP-Sciences %U http://archive.numdam.org/articles/10.1051/ro/2017057/ %R 10.1051/ro/2017057 %G en %F RO_2019__53_3_829_0
Rezaee, Saeed; Babaie-Kafaki, Saman. An adaptive nonmonotone trust region method based on a modified scalar approximation of the Hessian in the successive quadratic subproblems. RAIRO - Operations Research - Recherche Opérationnelle, Tome 53 (2019) no. 3, pp. 829-839. doi : 10.1051/ro/2017057. http://archive.numdam.org/articles/10.1051/ro/2017057/
and , A nonmonotone trust region method with adaptive radius for unconstrained optimization problems. Comput. Math. Appl. 60 (2010) 411–442. | DOI | MR | Zbl
, Accelerated scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization. European J. Oper. Res. 204 (2010) 410–420. | DOI | MR | Zbl
, A modified scaled memoryless BFGS preconditioned conjugate gradient method for unconstrained optimization. 4OR 11 (2013) 361–374. | DOI | MR | Zbl
, On optimality of the parameters of self-scaling memoryless quasi-Newton updating formulae. J. Optim. Theory Appl. 167 (2015) 91–101. | DOI | MR | Zbl
and , Two-point stepsize gradient methods. IMA J. Numer. Anal. 8 (1988) 141–148. | DOI | MR | Zbl
, and , Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results. Math. Program. 127 (2011) 245–295. | DOI | MR | Zbl
and , Benchmarking optimization software with performance profiles. Math. Program. 9 (2002) 201–213. | DOI | MR | Zbl
, and , CUTEr: a constrained and unconstrained testing environment, revisited. ACM Trans. Math. Softw. 29 (2003) 373–394. | DOI | Zbl
and , Algorithm 851: CG_Descent, a conjugate gradient method with guaranteed descent. ACM Trans. Math. Softw. 32 (2006) 113–137. | DOI | MR | Zbl
and , A modified BFGS method and its global convergence in nonconvex minimization. J. Comput. Appl. Math. 129 (2001) 15–35. | DOI | MR | Zbl
and , On the global convergence of the BFGS method for nonconvex unconstrained optimization problems. SIAM J. Optim. 11 (2001) 1054–1064. | DOI | MR | Zbl
, Accelerating the cubic regularization of Newton’s method on convex problems. Math. Program. 112 (2008) 159–181. | DOI | MR | Zbl
and , Cubic regularization of Newton’s method and its global performance. Math. Program. 108 (2006) 177–205. | DOI | MR | Zbl
and , Self-scaling variable metric (SSVM) algorithms. I. Criteria and sufficient conditions for scaling a class of algorithms. Management Sci. 20 (1974) 845–862. | DOI | MR | Zbl
and , Optimal conditioning of self-scaling variable metric algorithms. Math. Program. 10 (1976) 70–90. | DOI | MR | Zbl
and , An adaptive nonmonotone trust region method for unconstrained optimization problems based on a simple subproblem. Iranian J. Numer. Anal. Optim. 5 (2015) 95–117. | Zbl
and , A self-adaptive trust region method with line search based on a simple subproblem model. J. Comput. Appl. Math. 232 (2009) 514–522. | DOI | MR | Zbl
and , Optimization Theory and Methods: Nonlinear Programming. Springer, New York (2006). | MR | Zbl
, Nonmonotone trust region algorithms for nonlinear optimization subject to convex constraints. SIAM J. Sci. Comput. 17 (1996) 725–739. | Zbl
, and , An adaptive trust region method and its convergence. Sci. China Ser. A Math. 45 (2002) 620–631. | DOI | MR | Zbl
, and , A nonmonotone trust region method based on simple quadratic models. J. Comput. Appl. Math. 272 (2014) 107–115. | DOI | MR | Zbl
and , A new nonmonotone adaptive trust region method based on simple quadratic models. J. Appl. Math. Comput. 40 (2012) 111–123. | DOI | MR | Zbl
and , A nonlinear conjugate gradient method based on the MBFGS secant condition. Optim. Methods Softw. 21 (2006) 707–714. | DOI | MR | Zbl
, and , The quasi-Cauchy relation and diagonal updating. SIAM J. Optim. 9 (1999) 1192–1204. | DOI | MR | Zbl
Cité par Sources :
