Abstract
This paper describes the results of an empirical evaluation comparing the performance of five different algorithms in a pursuit and evasion game. The pursuit and evasion game was played using two robots. The task of the pursuer was to catch the other robot (the evader). The algorithms tested were a random player, the optimal player, a genetic algorithm learner, a k-nearest neighbor learner, and a reinforcement learner. The k-nearest neighbor learner performed best overall, but a closer analysis of the results showed that the genetic algorithm suffered from an exploration-exploitation problem.
Chapter PDF
Similar content being viewed by others
References
Jacky Baltes and Yuming Lin. Path-tracking control of non-holonomic car-like robots using reinforcement learning. In Manuela Veloso, Enrico Pagello, and Hiroaki Kitano, editors, RoboCup-99: Robot Soccer World Cup III, pages 162–173, New York, 2000. Springer.
John F. Grefenstette. Credit assignment in rule discovery systems based on genetic algorithms. Machine Learning, 3(2/3):225–245, 1988.
John F. Grefenstette and Helen G. Cobb. Learning sequential decision rules using simulation models and competition. Machine Learning, 5:355–381, 1990.
Rufus Isaacs. Differential games: A mathematical theory with applications to warfare and other topics. Technical Report 1, Center of Naval Analysis, Washington, D.C., 1963.
G. F. Miller and D. Cliff. Co-evolution of pursuit and evasion 2: Simulation methods and results. Technical report, University of Sussex, Brighton BN1 9QH, U.K., 1994.
Peter Stone, Richard Sutton, and Satinder Singh. Towards reinforcement learning for 3 vs. 2 keepaway. In Proceedings of the Fourth Workshop on RoboCup, Mel-bourne, August 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baltes, J., Park, Y. (2002). Comparison of Several Machine Learning Techniques in Pursuit-Evasion Games. In: Birk, A., Coradeschi, S., Tadokoro, S. (eds) RoboCup 2001: Robot Soccer World Cup V. RoboCup 2001. Lecture Notes in Computer Science(), vol 2377. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45603-1_29
Download citation
DOI: https://doi.org/10.1007/3-540-45603-1_29
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43912-7
Online ISBN: 978-3-540-45603-2
eBook Packages: Springer Book Archive