结合非单调线搜索技术与修正的Levenberg-Marquardt算法(L-M算法), 本文提出了一种新的求解非线性方程组的非单调修正L-M 算法. 在新算法的每次迭代中, 引入修正步, 并利用价值函数的梯度范数更新L-M参数. 如果试探步没有被接受, 则采用非单调线搜索技术来获取新的迭代点. 在一定的假设条件下, 证明了该算法的全局收敛性和局部收敛性. 数值实验结果表明, 该算法是可行和有效的.
Abstract
In this paper, a new nonmonotone modified L-M algorithm for solving nonlinear equations is proposed by combining the nonmonotone line search technique with the modified Levenberg-Marquardt algorithm (L-M algorithm). In each iteration of the new algorithm, a modified step is introduced, and the gradient norm of the value function is used to update the L-M parameters. If the trial step is not accepted, the nonmonotone line search technique is used to obtain the new iteration point. Under certain assumptions, the global convergence and local convergence of the algorithm are proved. Numerical experiment results show that the algorithm is feasible and effective.
关键词
非线性方程组 /
Levenberg-Marquardt算法 /
非单调线搜索 /
收敛性
{{custom_keyword}} /
Key words
nonlinear equations /
Levenberg-Marquardt algorithm /
nonmonotone line search /
convergence
{{custom_keyword}} /
中图分类号：
O221
{{custom_clc.code}}
({{custom_clc.text}})
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
参考文献
[1] Zhao R X, Fan J Y. Global complexity bound of the Levenberg Marquardt method. Optimization and Methods and Software, 2016, 31(4): 805-814
[2] Fan J Y. The modified Levenberg-Marquardt method for nonlinear equations with cubic convergence. Mathematics of Computation, 2012, 81(277): 447-466
[3] Li D H, Fukushima M. A globally and superlinearly convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations. SIAM Journal on Numerical Analysis, 1999, 37(1): 152-172
[4] Zhou W J, Li D H. A globally convergent BFGS method for nonlinear monotone equations without any merit functions. Mathematics of Computation, 2008, 77(264): 2231-2240
[5] Fan J Y, Yuan Y X. On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption. Computing: Archives for informatics and numerical computation, 2005, 74(1): 23-39
[6] Gu G Z, Li D H, Qi L and Zhou S Z. Descent Directions of Quasi-Newton Methods for Symmetric Nonlinear Equations. SIAM Journal on Numerical Analysis, 2003, 40(5): 1763-1774
[7] Wang X F, Tao Y X. A New Newton Method with Memory for Solving Nonlinear Equations. Mathematics, 2020, 8(1): 1-9
[8] Gasparo M G. A nonmonotone hybrid method for nonlinear systems. Optimization Methods and Software, 2000, 13(2): 79-94
[9] Zhao R X, Fan J Y. On a New Updating Rule of the Levenberg-Marquardt Parameter. Journal of Scientific Computing, 2018, 74(2): 1146-1162
[10] Fan J Y, Zeng J L. A Levenberg-Marquardt algorithm with correction for singular system of nonlinear equations. Applied Mathematics and Computation, 2013, 219(17): 9438-9446
[11] Deng N Y, Xiao Y, Zhou F J. Nonmonotonic trust region algorithm. Journal of Optimization Theory and Applications, 1993, 76(2): 259-285
[12] GU N Z, MO J T. Incorporating nonmonotone strategies into the trust region method for unconstrained optimization. Computers and Mathematics with Applications, 2008, 55(9): 2158-2172
[13] Kimiaei M. Nonmonotone self-adaptive Levenberg-Marquardt approach for solving systems of nonlinear equations. Numerical Functional Analysis and Optimization, 2018, 39(1): 47-66
[14] Powell M J D. An iterative method for finding stationary values of a function of several variables. The Computer Journal, 1962, 5(2): 147-151
[15] 郭楠, 黄华鹰. 求解非线性方程组的一类非单调修正Levenberg-Marquardt算法. 安徽大学学报(自然科学版), 2016, 40(2): 14-20 (Guo N, Huang H Y. A class of nonmonotonic modified Levenberg-Marquardt algorithm for solving nonlinear equations. Journal of Anhui University (Natural Science), 2016, 40(2): 14-20)
[16] Yamashita N, Fukus hima M. On the rate of convergence of the Levenberg-Marquardt method. Computing (Supplementum), 2001, 15: 239-249
[17] Moré J J, Garbow B S, Hillstrom K H. Testing Unconstrained Optimization Software. ACM Transactions on Mathematical Software, 1981, 7(1): 17-41
{{custom_fnGroup.title_cn}}
脚注
{{custom_fn.content}}
基金
国家自然科学基金(11871383,52275504);湖北省教育厅科学技术研究项目(Q20211111);湖北省冶金工业过程系统科学重点实验室开放基金项目(Y201905)资助.
{{custom_fund}}
PDF(508 KB)
