skip to main content
10.1145/3387304.3387327acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccrtConference Proceedingsconference-collections
research-article

Multicopter PID Attitude Controller Gain Auto-tuning through Reinforcement Learning Neural Networks

Published:13 May 2020Publication History

ABSTRACT

Multicopters continue to gain their applications in the real world and their control problem has attracted a great number of studies. Among several control techniques, the proportional-integral-derivative control method appears to play important roles in seeking a simple and efficient controller for a complex system like a multicopter. However, the gain tuning process of a proportional-integral-derivative controller is still a time-consuming task and, therefore, finding an automatic gain tuning method which saves time and ensures satisfactory control performance has become one of the most important efforts that researchers all around the world are nowadays undertaking. In this paper, we present a proportional-integral-derivative controller gain auto-tuning method using the reinforcement learning neural networks. Software and hardware-in-the-loop simulations were carried out to demonstrate the effectiveness of the proposed method.

References

  1. Xuan-Mung, N.; Hong, S. K. Improve Altitude Control Algorithm for Quadcopter Unmanned Aerial Vehicles, Applied Sciences, vol. 9, 2122. 2019.Google ScholarGoogle Scholar
  2. Pounds, P.E.I.; Bersak, D.R.; Dollar, A.M. Stability of small-scale UAV helicopters and quadrotors with added payload mass under PID control. Auton Robot., vol. 33, pp. 129--142, 2012.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Salih, A.L.; Moghavvemi, M.; Mohamed, H.A.F.; Gaeid, K.F. "Modelling and PID controller design for a quadrotor unmanned air vehicle," in Proc. AQTR '10, May 2010, pp. 1--5.Google ScholarGoogle Scholar
  4. Li, J.; Li, Y., "Dynamic analysis and PID control for a quadrotor," in Proc. IEEE International Conference on Mechatronics and Automation, 7-10 Aug. 2011.Google ScholarGoogle Scholar
  5. Ahmed, A.H.; Ouda, A.N.; Kamel, A.M.; Elhalwagy, Y.Z., "Attitude stabilization and altitude control of quadrotor," in Proc. ICENCO, 28-29 Dec. 2016, pp. 578.Google ScholarGoogle Scholar
  6. Khan, H.S.; Kadri, M.B., "Attitude and altitude control of quadrotor by discrete PID control and non-linear model Predictive control," in Proc. ICICT, 12-13 December 2015.Google ScholarGoogle Scholar
  7. Nguyen, N.P.; Hong, S.K, "Position control of a hummingbird quadcopter augmented by gain scheduling," Int. J. Eng. Res. Technol, Vol. 11, pp. 1485--1498, Nov. 2018.Google ScholarGoogle Scholar
  8. Xuan-Mung, N.; Hong, S.K, "A Multicopter ground testbed for the evaluation of attitude and position controller," Int. J. Eng. Technol. Vol. 7, pp. 65--73, Jul. 2018.Google ScholarGoogle Scholar
  9. Xuan-Mung, N.; Hong, S.K, "Robust Adaptive Formation Flight Control of Quadcopters based," Leader-Follower Approach. International Journal of Advanced Robotic System, Vol. 16, pp. 1--11, Jul. 2019.Google ScholarGoogle Scholar
  10. (2019) The ROS (Robot operation system) website. [Online]. Available: https://www.ros.org/.Google ScholarGoogle Scholar
  11. L.P.Kaelbling, M.L.Littman, A.W.Moore, "Reinforcement Learning: A Survey.", vol. 4, pp. 237--285, May. 1996.Google ScholarGoogle Scholar
  12. Tommi Jaakkola, "Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems," in NIPS'94, 1994,p.345--352.Google ScholarGoogle Scholar
  13. Volodtmyr Mnih. "Playing Atari with Deep Reinforcement Learning," in NIPS Deep Learning Workshop 2013, 2013, vol. abs/1312.5602.Google ScholarGoogle Scholar
  14. (2019) The Keras website. [Online]. Available: https://keras.io/.Google ScholarGoogle Scholar
  15. (2019) The MAVROS website. [Online]. Available: http://wiki.ros.org/mavros.Google ScholarGoogle Scholar
  16. (2019) The Rospy website. [Online]. Available: http://wiki.ros.org/rospy.Google ScholarGoogle Scholar
  17. (2019) The TX2 website. [Online]. Available: https://www.nvidia.com/.Google ScholarGoogle Scholar

Index Terms

  1. Multicopter PID Attitude Controller Gain Auto-tuning through Reinforcement Learning Neural Networks

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICCRT 2019: Proceedings of the 2019 2nd International Conference on Control and Robot Technology
      December 2019
      158 pages
      ISBN:9781450372527
      DOI:10.1145/3387304

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 May 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)37
      • Downloads (Last 6 weeks)6

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader