Abstract
Some classical penalty function algorithms may not always be convergent under big penalty parameters in Matlab software, which makes them impossible to find out an optimal solution to constrained optimization problems. In this paper, a novel penalty function (called M-objective penalty function) with one penalty parameter added to both objective and constrained functions of inequality constrained optimization problems is proposed. Based on the M-objective penalty function, an algorithm is developed to solve an optimal solution to the inequality constrained optimization problems, with its convergence proved under some conditions. Furthermore, numerical results show that the proposed algorithm has a much better convergence than the classical penalty function algorithms under big penalty parameters, and is efficient in choosing a penalty parameter in a large range in Matlab software.
Similar content being viewed by others
References
Zangwill W I, Nonlinear programming via penalty function, Manangement Science, 1967, 13: 334–358.
Han S P and Mangasrian O L, Exact penalty function in nonlinear programming, Mathematical Programming, 1979, 17: 251–269.
Rosenberg E, Globally convergent algorithms for convex programming, Mathematics of Operations Rresearch, 1981, 6: 437–443.
Rosenberg E, Exact penalty functions and stability in locally Lipschitz programming, Math. Programming, 1984, 30(3): 340–356.
Di Pillo G and Grippo L, An exact penalty function method with global conergence properties for nonlinear programming problems, Mathemathical Programming, 1986, 36: 1–18.
Zenios S A, Pinar M C, and Dembo R S, A smooth penalty function algorithm for networkstructured problems, European Journal of Operational Research, 1993, 64: 258–277.
Pinar M C and Zenios S A, On smoothing exact penalty functions for convex constraints optimization, SIAM Journal on Optimization, 1994, 4: 486–511.
Mongeau M and Sartenaer A, Automatic decrease of the penalty parameter in exact penalty functions methods, European Journal of Operational Research, 1995, 83: 686–699.
Rubinov A M, Glover B M, and Yang X Q, Extended lagrange and penalty functions in continuous optimization, Optimization, 1999, 46: 327–351.
Rubinov A M, Glover B M, and Yang X Q, Decreasing functions with applications to penalization, SIAM Journal on Optimization, 1999, 10: 289–313.
Yang X Q and Huang X X, A nonlinear Lagrangian approach to constrained optimization problems, SIAM Journal on Optimization, 2001, 11: 1119–1144.
Huang X X and Yang X Q, Duality and exact penalization for vector optimization via augumentd Lagrangian, Journal of Optimization Theory and Applications, 2001, 111: 615–640.
Morrison D D, Optimization by least squares, SIAM Journal on Numerical Analysis, 1968, 5: 83–88.
Fletcher R, Practical Method of Optimization, A Wiley-Interscience Publication, New York, 1981.
Fletcher R, Penalty Functions, in: Mathematical Programming: The State of the Art (Eds. by Bachem A, Grotschel M, and Korte B), Springer, Berlin, 1983, 87–114.
Burke J V, An exact penalization viewpoint of constrained optimization, SIAM Journal on Controland Optimization, 1991, 29: 968–998.
Fiacco A V and McCormick G P, Nonlinear Programming: Sequential Unconstrained Minimization Techniques, Wiley, New York, 1968.
Mauricio D and Maculan N, A boolean penalty method for zero-one nonlinear programming, Jouranl of Global Optimaization, 2000, 16: 343–354.
Li H, An appproximate method for local optmal for nonlinear mixed integer programming problems, Computers & Operation Reaserch, 1992, 19: 435–444.
Yang X Q, Meng Z Q, Huang X X, and Pong G T Y, Smoothing nonlinear penalty functions for constrained optimization, Numerical Functional Analysis and Optimization, 2003, 24(3–4): 351–364.
Meng Z Q, Dang C Y, and Yang X Q, On the smoothing of the square-root exact penalty function for inequality constrained optimization, Computational Optimization and Applications, 2006, 35: 375–398.
Meng Z Q, Hu Q Y, and Dang C Y, A penalty function algorithm with objective parameters for nonlinear mathematical programming, Journal of Industrial and Management Optimization, 2009, 5(3): 585–601.
Clarke F H, Optimization and Nonsmooth Analysis, John-Wiley & Sons, New York, 1983.
Fang S C, Rajasekera J R, and Tsao H S J, Entropy Optimization and Mathematical Proggramming, Kluwer, 1997.
Qi L Q, Wu S Y, and Zhou G, Semismooth newton methods for solving semi-infinite programming problems, Journal of Global Optimization, 2003, 27: 215–232.
Teo K L, Yang X Q, and Jennings L S. Computational discretization algorithms for functional inequality constrained optimization, Annals of Operations Research, 2000, 98: 215–234.
Richard H B, Gabriel L C, and Jorge N, A line search exact penalty method using steering rules, Mathematical Programming, 2012, 133(1–2): 39–73.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the National Natural Science Foundation of China under Grant No. 11271329.
This paper was recommended for publication by Editor DAI Yuhong.
Rights and permissions
About this article
Cite this article
Zheng, Y., Meng, Z. & Shen, R. An M-Objective Penalty Function Algorithm Under Big Penalty Parameters. J Syst Sci Complex 29, 455–471 (2016). https://doi.org/10.1007/s11424-015-3204-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-015-3204-3