Abstract
We show how genetic programming can be applied to helicopter hovering control, a nonlinear high dimensional control problem which previously has been included in the literature in the set of benchmarks for the derivation of new intelligent controllers . The evolved controllers are compared with a neuroevolutionary approach which won the first position in the 2008 helicopter hovering reinforcement learning competition. GP performs similarly (and in some cases better) with the winner of the competition, even in the case where unknown wind is added to the dynamic system and control is based on structures evolved previously, i.e. the evolved controllers have good generalisation capability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dracopoulos, D.C., Piccoli, R.: Bioreactor Control by Genetic Programming. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN XI, Part II. LNCS, vol. 6239, pp. 181–188. Springer, Heidelberg (2010)
Si, J., Barto, A.G., Powell, W.B., Wunch II, D. (eds.): Handbook of Learning and Approximate Dynamic Programming. Wiley (2004)
Werbos, P.J.: Foreword - ADP: The key direction for future research in intelligent control and understanding brain intelligence. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 38(4), 898–900 (2008)
Koppejan, R., Whiteson, S.: Neuroevolutionary reinforcement learning for generalized helicopter control. In: Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation, pp. 145–152. ACM (2009)
Ng, A., Kim, H., Jordan, M., Sastry, S., Ballianda, S.: Autonomous helicopter flight via reinforcement learning. In: Advances in Neural Information Processing Systems, pp. 799–806. MIT Press (2004)
RLC: Reinforcement learning competition (2009), http://www.rl-competition.org
Gonzalez, A., Mahtani, R., Bejar, M., Ollero, A.: Control and stability analysis of an autonomous helicopter. In: Proceedings of World Automation Congress, vol. 15, pp. 399–404 (June-July 2004)
Koo, T.J., Ma, Y., Sastry, S.S.: Nonlinear control of a helicopter based unmanned aerial vehicle model (2001), http://citeseer.ist.psu.edu/417459.html
Abbeel, P., Ganapathi, V., Ng, A.: Learning vehicular dynamics, with application to modeling helicopters. In: Advances in Neural Information Processing Systems, vol. 18, pp. 1–8 (2006)
Koza, J.R.: Genetic Programming On the Programming of Computers by Means of Natural Selection. MIT Press (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dracopoulos, D.C., Effraimidis, D. (2012). Genetic Programming for Generalised Helicopter Hovering Control. In: Moraglio, A., Silva, S., Krawiec, K., Machado, P., Cotta, C. (eds) Genetic Programming. EuroGP 2012. Lecture Notes in Computer Science, vol 7244. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29139-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-29139-5_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29138-8
Online ISBN: 978-3-642-29139-5
eBook Packages: Computer ScienceComputer Science (R0)