Abstract
We present a study on optimization and robustness of Probability Collectives Multi-agent Systems (PCMAS). This framework for distributed optimization is deeply connected with both game theory and statistical physics. In contrast to traditional biologically-inspired algorithms, Probability-Collectives (PC) based methods do not update populations of solutions. Instead, they update an explicitly parameterized probability distribution p over the space of solutions by a collective of agents. That updating of p arises as the optimization of a functional of p. The functional is chosen so that any p that optimizes it should be p peaked about good solutions. By comparing with genetic algorithms, we show that the PCMAS method appeared superior to the GA method in initial rate of decent, long term performance as well as the robustness of the search on complex optimization problems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Dorigo, M.: Optimization, learning and natural algorithms. Ph.D. thesis, Politecnico di Milano (1992)
Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proc. of IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)
Wolpert, D.H.: Theory of collectives. The Design and Analysis of Collectives. Springer, New York (2003), http://ic.arc.nasa.gov/dhw
Wolpert, D.H.: Information theory – the bridge connecting bounded rational game theory and statistical physicsy. In: Braha, D., Bar-Yam, Y. (eds.) Complex Engineering Systems. Perseus Books, Cambridge (2004)
Bieniawski, S., Wolpert, D. H., Kroo, I.: Discrete, continuous, and constrained optimization using collectives. In: Proc. of the 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, AIAA Paper 2004–4580 (2004)
Huang, C.F., Bieniawski, S., Wolpert, D.H., Strauss, C.: Comparative study of probability collectives based multi–agent systems and genetic algorithms. In: Proc. of the 2005 Genetic and Evolutionary Computation Conference (GECCO 2005), pp. 751–752 (2005)
Huang, C.-F., Chang, B.R.: Probability collectives multi-agent systems: A study of robustness in search. In: Pan, J.-S., Chen, S.-M., Nguyen, N.T. (eds.) ICCCI 2010. LNCS (LNAI), vol. 6422, pp. 334–343. Springer, Heidelberg (2010)
Kulkarni, A., Tai, K.: Probability collectives: a multi-agent approach for solving combinatorial optimization problems. Applied Soft Computing 10(3), 759–771 (2010)
Cheng, C., Wang, W., Xu, D., Chau, K.: Optimizing hydropower reservoir operation using hybrid genetic algorithm and chaos. Water Resource Management 22, 895–909 (2008)
Blumenthal, H., Parker, G.: Benchmarking punctuated anytime learning for evolving a multi-agent team’s binary controllers. In: World Automation Congress (2006)
Bouvry, P., Arbab, F., Seredynski, F.: Distributed evolutionary optimization, in Manifold: Rosenbrock’s function case study. Information Sciences 122, 141–159 (2000)
Fudenberg, D., Tirole, J.: Game Theory. MIT Press, Cambridge (1991)
Mackay, D.: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, Cambridge (2003)
Wolpert, D., Bieniawski, S.: Distributed control by lagrangian steepest descent. In: Proc. of the 43rd IEEE Conference on Decision and Control, pp. 1562–1567 (2004)
Bieniawski, S.: Distributed optimization and flight control using collectives. Ph.D. thesis, Stanford University, CA (2005)
Goldberg, D. E., Deb, K.: A comparative analysis of selection schemes used in genetic algorithms. Foundation of Genetic Algorithms, 69–93 (1991)
Schaffer, J.D., Caruana, R.A., Eshelman, L.J., Das, R.: A study of control parameters affecting online performance of genetic algorithms for function optimization. In: Proc. 3rd International Conference on Genetic Algorithms, pp. 51–60. Morgan Kaufmann, San Francisco (1989)
Second International Contest on Evolutionary Optimization, held in the IEEE-ICEC 1997 Conference (1997)
De Jong, K.: Analysis of the Behavior of a Class of Genetic Adaptive Systems. PhD thesis, University of Michigan, Ann Arbor (1975)
Ackley, D.H.: A connectionist machine for genetic hillclimbing. Kluwer Academic Publishers, Boston (1987)
Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs. Springer, Heidelberg (1992)
Goldberg, D.E.: Genetic Algorithms in search, Optimization, and Machine Learning. Addison Wesley, Reading (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Huang, CF., Chang, B.R. (2011). A Study of Probability Collectives Multi-agent Systems on Optimization and Robustness. In: Nguyen, N.T. (eds) Transactions on Computational Collective Intelligence IV. Lecture Notes in Computer Science(), vol 6660. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21884-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-21884-2_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21883-5
Online ISBN: 978-3-642-21884-2
eBook Packages: Computer ScienceComputer Science (R0)