Skip to main content
Log in

Low dimensional simplex evolution: a new heuristic for global optimization

  • Published:
Journal of Global Optimization Aims and scope Submit manuscript

Abstract

This paper presents a new heuristic for global optimization named low dimensional simplex evolution (LDSE). It is a hybrid evolutionary algorithm. It generates new individuals following the Nelder-Mead algorithm and the individuals survive by the rule of natural selection. However, the simplices therein are real-time constructed and low dimensional. The simplex operators are applied selectively and conditionally. Every individual is updated in a framework of try-try-test. The proposed algorithm is very easy to use. Its efficiency has been studied with an extensive testbed of 50 test problems from the reference (J Glob Optim 31:635–672, 2005). Numerical results show that LDSE outperforms an improved version of differential evolution (DE) considerably with respect to the convergence speed and reliability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ali M.M., Khompatraporn C., Zabinsky Z.B.: A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems. J. Glob. Optim. 31, 635–672 (2005)

    Article  Google Scholar 

  2. Coello, C.A.C.: List of references on constraint-handling techniques used with evolutionary algorithms. http://www.cs.cinvestav.mx/~constraint (2010) Accessed 15 April 2010

  3. Gutknecht, M.H.: A brief introduction to Krylov space methods for solving linear systems. In: Proceedings of Frontiers of Computational Science, pp. 53–62 (2007)

  4. Hansenand, N., Ostermeier, A.: Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In: Proceedings of IEEE International Conference on Evolutionary Computation, pp. 312–317 (1996)

  5. Hedar A., Fukushima M.: Minimizing multimodal functions by simplex coding genetic algorithm. Optim. Method Softw. 18, 265–282 (2003)

    Google Scholar 

  6. Horst R., Tuy H.: Global Optimization: Deterministic Approaches, 3rd edn. Springer, Berlin (1996)

    Google Scholar 

  7. Huyer W., Neumaier A.: Global optimization by multilevel coordinate search. J. Glob. Optim. 14, 331–355 (1999)

    Article  Google Scholar 

  8. Ingber L.: Simulated annealing: practice versus theory. J. Math. Comput. Modell. 18, 29–57 (1993)

    Article  Google Scholar 

  9. Jones D.R., Perttunen C.D., Stuckman B.E.: Lipschitzian optimization without the Lipschitz constant. J. Opt. Theor. Appl. 79, 157–181 (1993)

    Article  Google Scholar 

  10. Jones, D.R.: Direct global optimization algorithm. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn. Part 4, pp. 725–735 (2009)

  11. Kaelo P., Ali M.M.: A numerical study of some modified differential evolution algorithms. Eur. J. Oper. Res. 169, 1176–1181 (2006)

    Article  Google Scholar 

  12. Kennedy, J., Eberhart R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948. Piscataway, NJ (1995)

  13. Nelder J.A., Mead R.: A simplex method for function minimization. Comput. J. 7, 308–313 (1965)

    Google Scholar 

  14. Neumaier A.: Complete search in continuous global optimization and constraint satisfaction. Acta Numerica 13, 271–369 (2004)

    Article  Google Scholar 

  15. Pardalos, P.M., Resende, M. (eds.): Handbook of Applied Optimization. Oxford University Press, New York (2002)

    Google Scholar 

  16. Pardalos, P.M., Romeijn, E. (eds.): Handbook of Global Optimization—Volume 2: Heuristic Approaches. Kluwer, Dordrecht (2002)

    Google Scholar 

  17. Pardalos, P.M., Mavridou, T.D.: Simulated annealing. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn., Part 19, pp. 3591–3593 (2009)

  18. Pintér J.D.: Global Optimization in Action. Kluwer, Dordrecht (1996)

    Google Scholar 

  19. Pintér J.D.: Computational Global Optimization in Nonlinear Systems: An Interactive Tutorial. Lionheart Publishing Inc., Atlanta (2001)

    Google Scholar 

  20. Pintér J.D.: Nonlinear optimization with GAMS/LGO. J. Glob. Optim. 38, 79–101 (2007)

    Article  Google Scholar 

  21. Pintér, J.D.: Continuous global optimization: models, algorithms and software. In: Floudas, C.A., Pardalos, P.M. (eds.), Encyclopedia of Optimization, Part 3, 2nd edn, pp. 486–493 (2009)

  22. Renders, J.M., Bersini, H.: Hybridizing genetic algorithms with hill-climbing methods for global optimization: two possible ways. In: Proceedings of the First IEEE Conference on Evolutionary Computation, pp. 312–317 (1994)

  23. Price K., Storn R., Lampinen J.: Differential Evolution—A Practical Approach to Global Optimization. Springer, Berlin (2005)

    Google Scholar 

  24. Sahinidis N.V.: BARON: a general purpose global optimization software package. J. Glob. Optim. 8, 201–205 (1996)

    Article  Google Scholar 

  25. Spendley W., Hext G.R., Himsworth F.R.: Sequential application of simplex designs in optimization and evolutionary operation. Technometrics 4, 441–461 (1962)

    Article  Google Scholar 

  26. Storn R., Price K.: Differential evolution—a simple and efficient heuristic for global optimization over continuous space. J. Glob. Optim. 11, 341–359 (1997)

    Article  Google Scholar 

  27. Tuy, H.: Cutting plane methods for global optimization. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn., Part 3, pp. 590–594 (2009)

  28. Zhigljavsky A.A., Zilinskas A.G.: Stochastic Global Optimization. Springer, Berlin (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Changtong Luo.

Additional information

This research has been supported by the National Natural Science Foundation of China (Grants 10632090 and 90916028).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Luo, C., Yu, B. Low dimensional simplex evolution: a new heuristic for global optimization. J Glob Optim 52, 45–55 (2012). https://doi.org/10.1007/s10898-011-9678-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10898-011-9678-1

Keywords

Navigation