Koki Ikeda
ABSTRACT
This paper proposes a natural evolution strategy (NES) for mixed-integer black-box optimization (MI-BBO) that appears in real-world problems such as hyperparameter optimization of machine learning and materials design. This problem is difficult to optimize because plateaus where the values do not change appear when the integer variables are relaxed to the continuous ones. CMA-ES w. Margin that addresses the plateaus reportedly showed good performance on MI-BBO benchmark problems. However, it has been observed that the search performance of CMA-ES w. Margin deteriorates when continuous variables contribute more to the objective function value than integer ones. In order to address the problem of CMA-ES w. Margin, we propose Distance-weighted eXponential Natural Evolution Strategy taking account of Implicit Constraint and Integer (DX-NES-ICI). We compare the search performance of DX-NES-ICI with that of CMA-ES w. Margin through numerical experiments. As a result, DX-NES-ICI was up to 3.7 times better than CMA-ES w. Margin in terms of a rate of finding the optimal solutions on benchmark problems where continuous variables contribute more to the objective function value than integer ones. DX-NES-ICI also outperformed CMA-ES w. Margin on problems where CMA-ES w. Margin originally showed good performance.
- Laurens Bliek, Arthur Guijt, Sicco Verwer, and Mathijs de Weerdt. 2021. Black-Box Mixed-Variable Optimisation Using a Surrogate Model That Satisfies Integer Constraints. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '21). 1851--1859. Google Scholar
Digital Library
- Garuda Fujii, Masayuki Takahashi, and Youhei Akimoto. 2018. CMA-ES-based structural topology optimization using a level set boundary expression-Application to optical and carpet cloaks. Computer Methods in Applied Mechanics and Engineering 332 (2018), 624--643. Google ScholarCross Ref
- Ryoki Hamano, Shota Saito, Masahiro Nomura, and Shinichi Shirakawa. 2022. CMA-ES with Margin: Lower-Bounding Marginal Probability for Mixed-Integer Black-Box Optimization. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '22). 639--647. Google ScholarDigital Library
- Nikolaus Hansen, Sibylle D. Müller, and Petros Koumoutsakos. 2003. Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES). Evolutionary Computation 11, 1 (2003), 1--18. Google ScholarDigital Library
- N. Hansen and A. Ostermeier. 1996. Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In Proceedings of IEEE International Conference on Evolutionary Computation (ICEC '96). 312--317. Google ScholarCross Ref
- Elad Hazan, Adam Klivans, and Yang Yuan. 2018. Hyperparameter optimization: a spectral approach. In International Conference on Learning Representations (ICLR '18).Google Scholar
- Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren. 2019. Automated Machine Learning : Methods, Systems, Challenges. Springer. Google ScholarCross Ref
- Akshay Iyer, Yichi Zhang, Aditya Prasad, Praveen Gupta, Siyu Tao, Yixing Wang, Prajakta Prabhune, Linda S. Schadler, L. Catherine Brinson, and Wei Chen. 2020. Data centric nanocomposites design via mixed-variable Bayesian optimization. Molecular Systems Design & Engineering 5, 8 (2020), 1376--1390. Google ScholarCross Ref
- Rui Li, Michael T.M. Emmerich, Jeroen Eggermont, Thomas Bäck, M. Schütz, J. Dijkstra, and J.H.C. Reiber. 2013. Mixed Integer Evolution Strategies for Parameter Optimization. Evolutionary Computation 21, 1 (2013), 29--64. Google ScholarDigital Library
- Atsuhiro Miyagi, Youhei akimoto, and Hajime Yamamoto. 2018. Well Placement Optimization for Carbon Dioxide Capture and Storage via CMA-ES with Mixed Integer Support. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '18). 1696--1703. Google ScholarDigital Library
- Masahiro Nomura, Nobuyuki Sakai, Nobusumi Fukushima, and Isao Ono. 2021. Distance-weighted Exponential Natural Evolution Strategy for Implicitly Constrained Black-Box Function Optimization. In IEEE Congress on Evolutionary Computation (CEC '21). 1099--1106. Google ScholarDigital Library
- I. Ono, Y. Tatsuzawa, S. Kobayashi, and K. Yoshida. 2000. Global Optimization of Lens Systems by A Genetic Algorithm Taking Account of Glass Selection. In Proc. 2nd Int'l Conf. on Optical Design and Fabrication (ODF '00). 289--292.Google Scholar
- Jinn-Moon Yang and Cheng-Yan Kao. 1998. An evolutionary algorithm for synthesizing optical thin-film designs. In Proceedings of Parallel Problem Solving from Nature (PPSN '98). 947--956. Google ScholarCross Ref
- Yichi Zhang, Daniel W. Apley, and Wei Chen. 2020. Bayesian Optimization for Materials Design with Mixed Quantitative and Qualitative Variables. Scientific Reports 10, Article 4924 (2020). Google ScholarCross Ref
Index Terms
- Natural Evolution Strategy for Mixed-Integer Black-Box Optimization
Recommendations
(1+1)-CMA-ES with Margin for Discrete and Mixed-Integer Problems
GECCO '23: Proceedings of the Genetic and Evolutionary Computation ConferenceThe covariance matrix adaptation evolution strategy (CMA-ES) is an efficient continuous black-box optimization method. The CMA-ES possesses many attractive features, including invariance properties and a well-tuned default hyperparameter setting. ...
Mixed integer evolution strategies for parameter optimization
Evolution strategies ESs are powerful probabilistic search and optimization algorithms gleaned from biological evolution theory. They have been successfully applied to a wide range of real world applications. The modern ESs are mainly designed for ...
Marginal Probability-Based Integer Handling for CMA-ES Tackling Single-and Multi-Objective Mixed-Integer Black-Box Optimization
This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that samples ...
Comments