Abstract
This paper presents a new heuristic for global optimization named low dimensional simplex evolution (LDSE). It is a hybrid evolutionary algorithm. It generates new individuals following the Nelder-Mead algorithm and the individuals survive by the rule of natural selection. However, the simplices therein are real-time constructed and low dimensional. The simplex operators are applied selectively and conditionally. Every individual is updated in a framework of try-try-test. The proposed algorithm is very easy to use. Its efficiency has been studied with an extensive testbed of 50 test problems from the reference (J Glob Optim 31:635–672, 2005). Numerical results show that LDSE outperforms an improved version of differential evolution (DE) considerably with respect to the convergence speed and reliability.
Similar content being viewed by others
References
Ali M.M., Khompatraporn C., Zabinsky Z.B.: A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems. J. Glob. Optim. 31, 635–672 (2005)
Coello, C.A.C.: List of references on constraint-handling techniques used with evolutionary algorithms. http://www.cs.cinvestav.mx/~constraint (2010) Accessed 15 April 2010
Gutknecht, M.H.: A brief introduction to Krylov space methods for solving linear systems. In: Proceedings of Frontiers of Computational Science, pp. 53–62 (2007)
Hansenand, N., Ostermeier, A.: Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In: Proceedings of IEEE International Conference on Evolutionary Computation, pp. 312–317 (1996)
Hedar A., Fukushima M.: Minimizing multimodal functions by simplex coding genetic algorithm. Optim. Method Softw. 18, 265–282 (2003)
Horst R., Tuy H.: Global Optimization: Deterministic Approaches, 3rd edn. Springer, Berlin (1996)
Huyer W., Neumaier A.: Global optimization by multilevel coordinate search. J. Glob. Optim. 14, 331–355 (1999)
Ingber L.: Simulated annealing: practice versus theory. J. Math. Comput. Modell. 18, 29–57 (1993)
Jones D.R., Perttunen C.D., Stuckman B.E.: Lipschitzian optimization without the Lipschitz constant. J. Opt. Theor. Appl. 79, 157–181 (1993)
Jones, D.R.: Direct global optimization algorithm. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn. Part 4, pp. 725–735 (2009)
Kaelo P., Ali M.M.: A numerical study of some modified differential evolution algorithms. Eur. J. Oper. Res. 169, 1176–1181 (2006)
Kennedy, J., Eberhart R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948. Piscataway, NJ (1995)
Nelder J.A., Mead R.: A simplex method for function minimization. Comput. J. 7, 308–313 (1965)
Neumaier A.: Complete search in continuous global optimization and constraint satisfaction. Acta Numerica 13, 271–369 (2004)
Pardalos, P.M., Resende, M. (eds.): Handbook of Applied Optimization. Oxford University Press, New York (2002)
Pardalos, P.M., Romeijn, E. (eds.): Handbook of Global Optimization—Volume 2: Heuristic Approaches. Kluwer, Dordrecht (2002)
Pardalos, P.M., Mavridou, T.D.: Simulated annealing. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn., Part 19, pp. 3591–3593 (2009)
Pintér J.D.: Global Optimization in Action. Kluwer, Dordrecht (1996)
Pintér J.D.: Computational Global Optimization in Nonlinear Systems: An Interactive Tutorial. Lionheart Publishing Inc., Atlanta (2001)
Pintér J.D.: Nonlinear optimization with GAMS/LGO. J. Glob. Optim. 38, 79–101 (2007)
Pintér, J.D.: Continuous global optimization: models, algorithms and software. In: Floudas, C.A., Pardalos, P.M. (eds.), Encyclopedia of Optimization, Part 3, 2nd edn, pp. 486–493 (2009)
Renders, J.M., Bersini, H.: Hybridizing genetic algorithms with hill-climbing methods for global optimization: two possible ways. In: Proceedings of the First IEEE Conference on Evolutionary Computation, pp. 312–317 (1994)
Price K., Storn R., Lampinen J.: Differential Evolution—A Practical Approach to Global Optimization. Springer, Berlin (2005)
Sahinidis N.V.: BARON: a general purpose global optimization software package. J. Glob. Optim. 8, 201–205 (1996)
Spendley W., Hext G.R., Himsworth F.R.: Sequential application of simplex designs in optimization and evolutionary operation. Technometrics 4, 441–461 (1962)
Storn R., Price K.: Differential evolution—a simple and efficient heuristic for global optimization over continuous space. J. Glob. Optim. 11, 341–359 (1997)
Tuy, H.: Cutting plane methods for global optimization. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn., Part 3, pp. 590–594 (2009)
Zhigljavsky A.A., Zilinskas A.G.: Stochastic Global Optimization. Springer, Berlin (2008)
Author information
Authors and Affiliations
Corresponding author
Additional information
This research has been supported by the National Natural Science Foundation of China (Grants 10632090 and 90916028).
Rights and permissions
About this article
Cite this article
Luo, C., Yu, B. Low dimensional simplex evolution: a new heuristic for global optimization. J Glob Optim 52, 45–55 (2012). https://doi.org/10.1007/s10898-011-9678-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-011-9678-1