ABSTRACT
Collaborative optimization (CO) is an architecture within the multi-disciplinary design optimization (MDO) paradigm that partitions a constrained optimization problem into system and subsystem problems, with couplings between them. Multi-objective CO has multiple objectives at the system level and inequality constraints at the subsystem level. Whilst CO is an established technique, there are currently no scalable, constrained benchmark problems for multi-objective CO. In this study, we extend recent methods for generating scalable MDO benchmarks to propose a new benchmark test suite for multi-objective CO that is scalable in disciplines and variables, called 'CO-ZDT'. We show that overly-constraining the number of generations in each iteration of the system-level optimizer leads to poor consistency constraint satisfaction. Increasing the number of subsystems in each of the problems leads to increasing system-level constraint violation. In problems with two subsystems, we find that convergence to the global Pareto front is very sensitive to the complexity of the landscape of the original non-decomposed problem. As the number of subsystems increases, convergence issues are encountered even for the simpler problem landscapes.
Supplemental Material
Available for Download
Supplemental material.
- Natalia Alexandrov and Robert Lewis. 2000. Comparative Properties Of Collaborative Optimization And Other Approaches To Mdo. ASMO UK/ISSMO conference on engineering design optimization (03 2000).Google Scholar
- J. Blank and K. Deb. 2020. pymoo: Multi-Objective Optimization in Python. IEEE Access 8 (2020), 89497--89509.Google ScholarCross Ref
- Robert D. Braun, Peter Gage, I. M. Kroo, and I Sobiesiki. 1996. Implementation and Performance Issues in Collaborative Optimization (6th AIAA/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization). 295--305. Google ScholarCross Ref
- Dimo Brockhoff, Anne Auger, Nikolaus Hansen, and Tea Tušar. 2022. Using Well-Understood Single-Objective Functions in Multiobjective Black-Box Optimization Test Suites. Evolutionary Computation 30, 2 (06 2022), 165--193. arXiv:https://direct.mit.edu/evco/article-pdf/30/2/165/2025995/evco_a_00298.pdf Google ScholarCross Ref
- Timothy Cormier, Andrew Scott, Laura Ledsinger, David McCormick, David Way, and John Olds. 2012. Comparison of collaborative optimization to conventional design techniques for a conceptual RLV. In 8th Symposium on Multidisciplinary Analysis and Optimization. arXiv:https://arc.aiaa.org/doi/pdf/10.2514/6.2000-4885 Google ScholarCross Ref
- Evin J. Cramer, J. E. Dennis, Jr., Paul D. Frank, Robert Michael Lewis, and Gregory R. Shubin. 1994. Problem Formulation for Multidisciplinary Optimization. SIAM Journal on Optimization 4, 4 (1994), 754--776. Google ScholarDigital Library
- K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2 (2002), 182--197. Google ScholarDigital Library
- Kalyanmoy Deb, Lothar Thiele, Marco Laumanns, and Eckart Zitzler. 2005. Scalable Test Problems for Evolutionary Multiobjective Optimization. Springer London, London, 105--145. Google ScholarCross Ref
- Joao Duro, Yiming Yan, Robin Purshouse, and Peter Fleming. 2018. Collaborative Multi-Objective Optimization for Distributed Design of Complex Products. GECCO '18: Proceedings of the Genetic and Evolutionary Computation Conference, 625--632. Google ScholarDigital Library
- Yang Fan and Bouchlaghem Dino. 2010. Genetic Algorithm-Based Multiobjective Optimization for Building Design. Architectural Engineering and Design Management 6, 1 (2010), 68--82. arXiv:https://doi.org/10.3763/aedm.2008.0077 Google ScholarCross Ref
- Michael Farnsworth, Ashutosh Tiwari, Meiling Zhu, and Elhadj Benkhelifa. 2018. A Multi-objective and Multidisciplinary Optimisation Algorithm for Microelectromechanical Systems. Springer International Publishing, Cham, 205--238. Google ScholarCross Ref
- S Gunawan, S Azarm, J Wu, and A Boyars. 2003. Quality-Assisted Multi-Objective Multidisciplinary Genetic Algorithms. AIAA journal 41, 9 (2003), 1752--1762.Google ScholarCross Ref
- Chen-Hung Huang. 2003. Development of Multi-Objective Concurrent Sub-space Optimization and Visualization Methods for Multidisciplinary Design. Ph. D. Dissertation. Buffalo, NY: State University of New York at Buffalo.Google Scholar
- Chen-Hung Huang and Christina Bloebaum. 2004. Incorporation of Preferences in Multi-Objective Concurrent Subspace Optimization for Multidisciplinary Design. In 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. arXiv:https://arc.aiaa.org/doi/pdf/10.2514/6.2004-4548 Google ScholarCross Ref
- S. Huband, P. Hingston, L. Barone, and L. While. 2006. A review of multiobjective test problems and a scalable test problem toolkit. IEEE Transactions on Evolutionary Computation 10, 5 (2006), 477--506. Google ScholarDigital Library
- V. Johnson, J. A. Duro, V. Kadirkamanathan, and R. C. Purhouse. 2022. Toward scalable benchmark problems for multi-objective multidisciplinary optimization. In Proceedings of the 2022 IEEE Symposium Series On Computational Intelligence (IEEE SSCI). 133--140.Google Scholar
- V. Johnson, J. A. Duro, V. Kadirkamanathan, and R. C. Purhouse. 2023. A scalable test suite for bi-objective multidisciplinary optimisation. In Proceedings of the 2023 International Conference Series on Evolutionary Multi-Criterion Optimization (EMO). 319--332.Google Scholar
- Kathrin Klamroth, Sanaz Mostaghim, Boris Naujoks, Silvia Poles, Robin Purshouse, Günter Rudolph, Stefan Ruzika, Serpil Sayın, Margaret M. Wiecek, and Xin Yao. 2017. Multiobjective optimization for interwoven systems. Journal of Multi-Criteria Decision Analysis 24, 1--2 (2017), 71--81. Google ScholarCross Ref
- Andrew B. Lambe and Joaquim R. R. A. Martins. 2012. Extensions to the design structure matrix for the description of multidisciplinary design, analysis, and optimization processes. Structural and Multidisciplinary Optimization 46, 2 (01 Aug 2012), 273--284. Google ScholarDigital Library
- Haiyan Li, Mingxu Ma, and Wenlei Zhang. 2016. Multi-objective collaborative optimization using linear physical programming with dynamic weight. Journal of Mechanical Science and Technology 30, 2 (01 Feb 2016), 763--770. Google ScholarCross Ref
- Joaquim R. R. A. Martins and Andrew B. Lambe. 2013. Multidisciplinary Design Optimization: A Survey of Architectures. AIAA Journal 51, 9 (2013), 2049--2075. Google ScholarCross Ref
- Charles D. McAllister and Timothy W. Simpson. 2003. Multidisciplinary Robust Design Optimization of an Internal Combustion Engine. Journal of Mechanical Design 125, 1 (2003), 124--130. Google ScholarCross Ref
- C. D. McAllister, T. W. Simpson, K. Hacker, K. Lewis, and A. Messac. 2005. Integrating linear physical programming within collaborative optimization for multiobjective multidisciplinary design optimization. Structural and Multidisciplinary Optimization 29, 3 (01 Mar 2005), 178--189. Google ScholarCross Ref
- Petra Meier, Robin Purshouse, Marion Bain, Clare Bambra, Richard Bentall, Mark Birkin, John Brazier, Alan Brennan, Mark Bryan, Julian Cox, et al. 2019. The SIPHER Consortium: Introducing the new UK hub for systems science in public health and health economic research. Wellcome Open Research 4, 174 (2019). Google ScholarCross Ref
- Sharon Padula, Natalia Alex, Lawrence Green, and Natalia Alexandrov. 1996. MDO Test Suite At Nasa Langley Research Center. (Sep 1996). Google ScholarCross Ref
- Sumeet Parashar and Christina Bloebaum. 2006. Multi-Objective Genetic Algorithm Concurrent Subspace Optimization (MOGACSSO) for Multidisciplinary Design. Collection of Technical Papers - AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 8. Google ScholarCross Ref
- Sébastien Rabeau, Philippe Dépincé, and Fouad Bennis. 2007. Collaborative optimization of complex systems: a multidisciplinary approach. International Journal on Interactive Design and Manufacturing (IJIDeM) 1, 4 (01 Nov 2007), 209--218. Google ScholarCross Ref
- R. Sellar, S. Batill, and J. Renaud. 1996. Response surface based, concurrent subspace optimization for multidisciplinary system design. In 34th Aerospace Sciences Meeting and Exhibit. 96--0714. Google ScholarCross Ref
- Ravindra V. Tappeta and John E. Renaud. 1997. Multiobjective Collaborative Optimization (International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. Volume 2: 23rd Design Automation Conference). 403--411. arXiv:https://asmedigitalcollection.asme.org/IDETC-CIE/proceedings-pdf/DETC97/80449/V002T29A017/6640325/v002t29a017-detc97-dac-3772.pdfV002T29A017. Google ScholarCross Ref
- Nathan P. Tedford and Joaquim R. R. A. Martins. 2010. Benchmarking multidisciplinary design optimization algorithms. Optimization and Engineering 11 (2010), 159--183. Google ScholarCross Ref
- Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, Stéfan J. van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson, Eric Jones, Robert Kern, Eric Larson, C J Carey, İlhan Polat, Yu Feng, Eric W. Moore, Jake VanderPlas, Denis Laxalde, Josef Perktold, Robert Cimrman, Ian Henriksen, E. A. Quintero, Charles R. Harris, Anne M. Archibald, Antônio H. Ribeiro, Fabian Pedregosa, Paul van Mulbregt, and SciPy 1.0 Contributors. 2020. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods 17 (2020), 261--272. Google ScholarCross Ref
- Eckart Zitzler, Kalyanmoy Deb, and Lothar Thiele. 2000. Comparison of Multiobjective Evolutionary Algorithms: Empirical Results. Evolutionary Computation 8, 2 (2000), 173--195. Google ScholarDigital Library
Index Terms
- A distributed multi-disciplinary design optimization benchmark test suite with constraints and multiple conflicting objectives
Recommendations
Multi-objective Optimization with Dynamic Constraints and Objectives: New Challenges for Evolutionary Algorithms
GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary ComputationDynamic Multi-objective Optimization (DMO) is a challenging research topic since the objective functions, constraints, and problem parameters may change over time. Several evolutionary algorithms have been proposed to deal with DMO problems. ...
Handling multiple objectives with biogeography-based optimization
Biogeography-based optimization (BBO) is a new evolutionary optimization method inspired by biogeography. In this paper, BBO is extended to a multi-objective optimization, and a biogeography-based multi-objective optimization (BBMO) is introduced, which ...
Enhanced multi-objective particle swarm optimisation for estimating hand postures
AbstractMulti-objective problems with conflicting objectives cannot be effectively solved by aggregation-based methods. The answer to such problems is a Pareto optimal solution set. Due to the difficulty of solving multi-objective problems ...
Comments