Skip to main content
Log in

An M-Objective Penalty Function Algorithm Under Big Penalty Parameters

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

Some classical penalty function algorithms may not always be convergent under big penalty parameters in Matlab software, which makes them impossible to find out an optimal solution to constrained optimization problems. In this paper, a novel penalty function (called M-objective penalty function) with one penalty parameter added to both objective and constrained functions of inequality constrained optimization problems is proposed. Based on the M-objective penalty function, an algorithm is developed to solve an optimal solution to the inequality constrained optimization problems, with its convergence proved under some conditions. Furthermore, numerical results show that the proposed algorithm has a much better convergence than the classical penalty function algorithms under big penalty parameters, and is efficient in choosing a penalty parameter in a large range in Matlab software.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Zangwill W I, Nonlinear programming via penalty function, Manangement Science, 1967, 13: 334–358.

    MathSciNet  Google Scholar 

  2. Han S P and Mangasrian O L, Exact penalty function in nonlinear programming, Mathematical Programming, 1979, 17: 251–269.

    Article  MathSciNet  Google Scholar 

  3. Rosenberg E, Globally convergent algorithms for convex programming, Mathematics of Operations Rresearch, 1981, 6: 437–443.

    Article  MathSciNet  MATH  Google Scholar 

  4. Rosenberg E, Exact penalty functions and stability in locally Lipschitz programming, Math. Programming, 1984, 30(3): 340–356.

    Article  MathSciNet  MATH  Google Scholar 

  5. Di Pillo G and Grippo L, An exact penalty function method with global conergence properties for nonlinear programming problems, Mathemathical Programming, 1986, 36: 1–18.

    Article  Google Scholar 

  6. Zenios S A, Pinar M C, and Dembo R S, A smooth penalty function algorithm for networkstructured problems, European Journal of Operational Research, 1993, 64: 258–277.

    Article  Google Scholar 

  7. Pinar M C and Zenios S A, On smoothing exact penalty functions for convex constraints optimization, SIAM Journal on Optimization, 1994, 4: 486–511.

    Article  MathSciNet  MATH  Google Scholar 

  8. Mongeau M and Sartenaer A, Automatic decrease of the penalty parameter in exact penalty functions methods, European Journal of Operational Research, 1995, 83: 686–699.

    Article  MATH  Google Scholar 

  9. Rubinov A M, Glover B M, and Yang X Q, Extended lagrange and penalty functions in continuous optimization, Optimization, 1999, 46: 327–351.

    Article  MathSciNet  MATH  Google Scholar 

  10. Rubinov A M, Glover B M, and Yang X Q, Decreasing functions with applications to penalization, SIAM Journal on Optimization, 1999, 10: 289–313.

    Article  MathSciNet  MATH  Google Scholar 

  11. Yang X Q and Huang X X, A nonlinear Lagrangian approach to constrained optimization problems, SIAM Journal on Optimization, 2001, 11: 1119–1144.

    Article  MathSciNet  MATH  Google Scholar 

  12. Huang X X and Yang X Q, Duality and exact penalization for vector optimization via augumentd Lagrangian, Journal of Optimization Theory and Applications, 2001, 111: 615–640.

    Article  MathSciNet  MATH  Google Scholar 

  13. Morrison D D, Optimization by least squares, SIAM Journal on Numerical Analysis, 1968, 5: 83–88.

    Article  MathSciNet  MATH  Google Scholar 

  14. Fletcher R, Practical Method of Optimization, A Wiley-Interscience Publication, New York, 1981.

    MATH  Google Scholar 

  15. Fletcher R, Penalty Functions, in: Mathematical Programming: The State of the Art (Eds. by Bachem A, Grotschel M, and Korte B), Springer, Berlin, 1983, 87–114.

  16. Burke J V, An exact penalization viewpoint of constrained optimization, SIAM Journal on Controland Optimization, 1991, 29: 968–998.

    Article  MathSciNet  MATH  Google Scholar 

  17. Fiacco A V and McCormick G P, Nonlinear Programming: Sequential Unconstrained Minimization Techniques, Wiley, New York, 1968.

    MATH  Google Scholar 

  18. Mauricio D and Maculan N, A boolean penalty method for zero-one nonlinear programming, Jouranl of Global Optimaization, 2000, 16: 343–354.

    Article  MathSciNet  MATH  Google Scholar 

  19. Li H, An appproximate method for local optmal for nonlinear mixed integer programming problems, Computers & Operation Reaserch, 1992, 19: 435–444.

    Article  Google Scholar 

  20. Yang X Q, Meng Z Q, Huang X X, and Pong G T Y, Smoothing nonlinear penalty functions for constrained optimization, Numerical Functional Analysis and Optimization, 2003, 24(3–4): 351–364.

    Article  MathSciNet  MATH  Google Scholar 

  21. Meng Z Q, Dang C Y, and Yang X Q, On the smoothing of the square-root exact penalty function for inequality constrained optimization, Computational Optimization and Applications, 2006, 35: 375–398.

    Article  MathSciNet  MATH  Google Scholar 

  22. Meng Z Q, Hu Q Y, and Dang C Y, A penalty function algorithm with objective parameters for nonlinear mathematical programming, Journal of Industrial and Management Optimization, 2009, 5(3): 585–601.

    Article  MathSciNet  MATH  Google Scholar 

  23. Clarke F H, Optimization and Nonsmooth Analysis, John-Wiley & Sons, New York, 1983.

    MATH  Google Scholar 

  24. Fang S C, Rajasekera J R, and Tsao H S J, Entropy Optimization and Mathematical Proggramming, Kluwer, 1997.

    Book  MATH  Google Scholar 

  25. Qi L Q, Wu S Y, and Zhou G, Semismooth newton methods for solving semi-infinite programming problems, Journal of Global Optimization, 2003, 27: 215–232.

    Article  MathSciNet  MATH  Google Scholar 

  26. Teo K L, Yang X Q, and Jennings L S. Computational discretization algorithms for functional inequality constrained optimization, Annals of Operations Research, 2000, 98: 215–234.

    Article  MathSciNet  MATH  Google Scholar 

  27. Richard H B, Gabriel L C, and Jorge N, A line search exact penalty method using steering rules, Mathematical Programming, 2012, 133(1–2): 39–73.

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ying Zheng.

Additional information

This research was supported by the National Natural Science Foundation of China under Grant No. 11271329.

This paper was recommended for publication by Editor DAI Yuhong.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, Y., Meng, Z. & Shen, R. An M-Objective Penalty Function Algorithm Under Big Penalty Parameters. J Syst Sci Complex 29, 455–471 (2016). https://doi.org/10.1007/s11424-015-3204-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-015-3204-3

Keywords

Navigation