Abstract
This paper proposes a Differential Evolution based algorithm for numerical optimization in the presence of noise. The proposed algorithm, namely Noise Analysis Differential Evolution (NADE), employs a randomized scale factor in order to overcome the structural difficulties of a Differential Evolution in a noisy environment as well as a noise analysis component which determines the amount of samples required for characterizing the stochastic process and thus efficiently performing pairwise comparisons between parent and offspring solutions.
The NADE has been compared, for a benchmark set composed of various fitness landscapes under several levels of noise bandwidth, with a classical evolutionary algorithm for noisy optimization and two recently proposed metaheuristics. Numerical results show that the proposed NADE has a very good performance in detecting high quality solutions despite the presence of noise. The NADE seems, in most cases, very fast and reliable in detecting promising search directions and continuing evolution towards the optimum.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Branke, J., Schmidt, C.: Selection in the presence of noise. In: Cantu-Paz, E., et al. (eds.) GECCO 2003. LNCS, vol. 2723, pp. 766–777. Springer, Heidelberg (2003)
Di Pietro, A., While, L., Barone, L.: Applying evolutionary algorithms to problems with noisy, time-consuming fitness functions. In: Proceedings of the IEEE Congress on Evolutionary Computation, vol. 2, pp. 1254–1261 (2004)
Beyer, H.G., Sendhoff, B.: Functions with noise-induced multimodality: a test for evolutionary robust optimization-properties and performance analysis. IEEE Transactions on Evolutionary Computation 10(5), 507–526 (2006)
Jin, Y., Branke, J.: Evolutionary optimization in uncertain environments-a survey
Fitzpatrick, J.M., Grefenstette, J.J.: Genetic algorithms in noisy environments. Machine Learning 3, 101–120 (1988)
Beyer, H.G.: Toward a theory of evolution strategies: Some asymptotical results from the (1,+ λ)-theory. Evolutionary Computation 1(2), 165–188 (1993)
Aizawa, A.N., Wah, B.W.: Scheduling of genetic algorithms in a noisy environment. Evolutionary Computation 2(2), 97–122 (1994)
Stagge, P.: Averaging efficiently in the presence of noise. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, H.-P. (eds.) PPSN 1998. LNCS, vol. 1498, pp. 188–200. Springer, Heidelberg (1998)
Neri, F., Cascella, G.L., Salvatore, N., Kononova, A.V., Acciani, G.: Prudent-daring vs tolerant survivor selection schemes in control design of electric drives. In: Rothlauf, F., et al. (eds.) EvoWorkshops 2006. LNCS, vol. 3907, pp. 805–809. Springer, Heidelberg (2006)
Branke, J., Schmidt, C., Schmeck, H.: Efficient fitness estimation in noisy environments. In: Spector, L., et al. (eds.) Genetic and Evolutionary Computation Conference, pp. 243–250. Morgan Kaufmann, San Francisco (2001)
Sano, Y., Kita, H., Kamihira, I., Yamaguchi, M.: Online optimization of an engine controller by means of a genetic algorithm using history of search. In: Proceedings of the Asia-Pacific Conference on Simulated Evolution and Learning, pp. 2929–2934. Springer, Heidelberg (2000)
Neri, F., del Toro Garcia, X., Cascella, G.L., Salvatore, N.: Surrogate assisted local search on PMSM drive design. COMPEL: International Journal for Computation and Mathematics in Electrical and Electronic Engineering 27(3), 573–592 (2008)
Markon, O., Arnold, D.V., Biick, T., Beielstein, T., Beyer, H.G.: Thresholding - a selection operator for noisy ES. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 465–472 (2001)
Branke, J., Schmidt, C.: Sequential sampling in noisy environments. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 202–211. Springer, Heidelberg (2004)
Bartz-Beielstein, T., Blum, D., Branke, J.: Particle swarm optimization and sequential sampling in noisy environments. In: Doerner, K.F., et al. (eds.) Metaheuristics. Operations Research/Computer Science Interfaces Series, vol. 39, pp. 261–273. Springer, Heidelberg (2007)
Pan, H., Wanga, L., Liu: Particle swarm optimization for function optimization in noisy environment. Applied Mathematics and Computation 181, 908–919 (2006)
Klamargias, A.D., Parsopoulos, K.E., Alevizos, P.D., Vrahatis, M.N.: Particle filtering with particle swarm optimization in systems with multiplicative noise. In: Proceedings of the 10th annual conference on Genetic and evolutionary computation, pp. 57–62. ACM, New York (2008)
Krink, T., Filipič, B., Fogel, G.B.: Noisy optimization problems - a particular challenge for differential evolution? In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 332–339 (2004)
Das, S., Konar, A.: An improved differential evolution scheme for noisy optimization problems. In: Pal, S.K., Bandyopadhyay, S., Biswas, S. (eds.) PReMI 2005. LNCS, vol. 3776, pp. 417–421. Springer, Heidelberg (2005)
Das, S., Konar, A., Chakraborty, U.: Improved differential evolution algorithms for handling noisy optimization problems. In: Proceedings of the IEEE Congress on Evolutionary Computation, vol. 2, pp. 1691–1698 (2005)
Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.: Opposition-based differential evolution for optimization of noisy problems. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1865–1872 (2006)
NIST/SEMATECH: e-handbook of statistical methods, http://www.itl.nist.gov/div898/handbook/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Caponio, A., Neri, F. (2009). Differential Evolution with Noise Analyzer. In: Giacobini, M., et al. Applications of Evolutionary Computing. EvoWorkshops 2009. Lecture Notes in Computer Science, vol 5484. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01129-0_81
Download citation
DOI: https://doi.org/10.1007/978-3-642-01129-0_81
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01128-3
Online ISBN: 978-3-642-01129-0
eBook Packages: Computer ScienceComputer Science (R0)