Abstract
Designing effective behavioral controllers for mobile robots can be difficult and tedious; this process can be circumvented by using unsupervised learning techniques which allow robots to evolve their own controllers online in an automated fashion. In multi-robot systems, robots learning in parallel can share information to dramatically increase the evolutionary rate. However, manufacturing variations in robotic sensors may result in perceptual differences between robots, which could impact the learning process. In this chapter, we explore how varying sensor offsets and scaling factors affects parallel swarm-robotic learning of obstacle avoidance behavior using both Genetic Algorithms and Particle Swarm Optimization. We also observe the diversity of robotic controllers throughout the learning process using two different metrics in an attempt to better understand the evolutionary process.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Antonsson, E.K., Zhang, Y., Martinoli, A.: Evolving Engineering Design Trade-Offs. In: Proc. of the ASME Fifteenth Int. Conf. on Design Theory and Methodology, Chicago, IL, USA, paper No. DETC2003/DTM–48676 (September 2003)
Balch, T.: Behavioral diversity in learning robot teams. PhD Thesis, College of Computing, Georgia Institute of Technology (1998)
Balch, T.: Measuring robot group diversity. In: Balch, T., Parker, L.E. (eds.) Robot teams: From diversity to polymorphism, pp. 93–135 (2002)
Cianci, C., Raemy, X., Pugh, J., Martinoli, A.: Communication in a swarm of miniature robots: The e-puck as an educational tool for swarm robotics. In: Şahin, E., Spears, W.M., Winfield, A.F.T. (eds.) SAB 2006 Ws 2007. LNCS, vol. 4433, pp. 103–115. Springer, Heidelberg (2007)
Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proc. of the Sixth Int. Symposium on Micro Machine and Human Science, MHS 1995, October 4–6, pp. 39–43 (1995)
Floreano, D., Mondada, F.: Evolution of Homing Navigation in a Real Mobile Robot. IEEE Transactions on Systems, Man and Cybernetics, Part B 26(3), 396–407 (1996)
Fourie, P.C., Groenwold, A.A.: The particle swarm optimization algorithm in size and shape optimization. Struct. Multidisc. Optim. 23, 259–267 (2002)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization & Machine Learning. Addison-Wesley, Reading (1989)
Kelly, I.D., Keating, D.A.: Faster learning of control parameters through sharing experiences of autonomous mobile robots. Int. Journal of System Science 29(7), 783–793 (1998)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proc. of the IEEE Int. Conf. on Neural Networks, vol. 4, pp. 1942–1948 (November/December 1995)
Kennedy, J., Spears, W.M.: Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator. In: Proc. of IEEE Int. Conf. on Evolutionary Computation, Anchorage, pp. 78–83 (May 1998)
Li, L., Martinoli, A., Abu-Mostafa, Y.: Learning and Measuring Specialization in Collaborative Swarm Systems. Adaptive Behavior 12(3-4), 199–212 (2004)
Matarić, M.J.: Learning to Behave Socially. In: Proc. of the 3rd Int. Conf. on Simulation and Adaptive Behaviors - From animals to animats, vol. 3, pp. 453–462 (1994)
Matarić, M.J., Cliff, D.: Challenges in evolving controllers for physical robots. Robot. and Autonomous Sys. 19(1), 67–83 (1996)
Matarić, M.J.: Learning in behavior-based multi-robot systems: Policies, models, and other agents. Special Issue on Multi-disciplinary studies of multi-agent learning, Ron Sun (ed.) Cognitive Systems Research 2(1), 81–93 (2001)
Michel, O.: Webots: Professional Mobile Robot Simulation. Int. J. of Advanced Robotic Systems 1, 39–42 (2004)
Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1996)
Mondada, F., Franzi, E., Ienne, P.: Mobile robot miniaturisation: A tool for investigation in control algorithms. In: Proc. of the Third Int. Symp. on Experimental Robotics, Kyoto, Japan, pp. 501–513 (October 1993)
Murciano, A., Millán, J.R., Zamora, J.: Specialization in multi-agent systems through learning. Behavioral Cybernetics 76, 375–382 (1997)
Nehmzow, U.: Learning in multi-robot scenarios through physically embedded genetic algorithms. In: Proc. of the 7th Int. Conf. on the Simulation of Adaptive Behavior: From animals to animats, pp. 391–392 (2002)
Nolfi, S., Floreano, D.: Evolutionary Robotics: The Biology, Intelligence, and Technology. MIT Press, Cambridge (2000)
Pugh, J., Zhang, Y., Martinoli, A.: Particle swarm optimization for unsupervised robotic learning. In: IEEE Swarm Intelligence Symposium, Pasadena, CA, pp. 92–99 (June 2005)
Pugh, J., Martinoli, A.: Multi-Robot Learning with Particle Swarm Optimization. In: Int. Conf. on Autonomous Agents and Multiagent Systems, Hakodate, Japan, May 8–12, pp. 441–448 (2006)
Pugh, J., Martinoli, A.: Parallel Learning in Heterogeneous Multi-Robot Swarms. In: IEEE Congress on Evolutionary Computation, Singapore, September 25-28, pp. 3839–3846 (2007)
Stone, P.: Layered Learning in Multi-Agent Systems. PhD Thesis, School of Computer Science, Carnegie Mellon University (1998)
Stone, P., Veloso, M.: Multiagent Systems: A Survey from a Machine Learning Perspective. Autonomous Robots 8(3), 345–383 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Pugh, J., Martinoli, A. (2009). An Exploration of Online Parallel Learning in Heterogeneous Multi-robot Swarms. In: Liu, D., Wang, L., Tan, K.C. (eds) Design and Control of Intelligent Robotic Systems. Studies in Computational Intelligence, vol 177. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89933-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-89933-4_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89932-7
Online ISBN: 978-3-540-89933-4
eBook Packages: EngineeringEngineering (R0)