欢迎访问《兵工学报》官方网站,今天是 分享到:

兵工学报 ›› 2022, Vol. 43 ›› Issue (8): 1947-1955.doi: 10.12382/bgxb.2021.0786

• 论文 • 上一篇    下一篇

基于强化学习补偿的地面无人战车行进间跟瞄自适应控制

魏连震1,2, 龚建伟1, 陈慧岩1, 李子睿1,3, 龚乘1   

  1. (1.北京理工大学 机械与车辆学院, 北京 100081; 2.北京理工大学 长三角研究院, 浙江 嘉兴 314019;3.代尔夫特理工大学 交通与规划系, 荷兰 代尔夫特 2628 CN)
  • 上线日期:2022-07-01
  • 作者简介:魏连震(1998—), 男, 硕士研究生。E-mail:3120200396@bit.edu.cn
  • 基金资助:
    武器装备预先研究项目(301060701)

Tracking and Aiming Adaptive Control for Unmanned Combat Ground Vehicle on the Move Based on Reinforcement LearningCompensation

WEI Lianzhen1,2, GONG Jianwei1, CHEN Huiyan1, LI Zirui1,3, GONG Cheng1   

  1. (1.School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China; 2.Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing 314019, Zhejiang, China; 3.Department of Transport and Planning, Delft University of Technology, Delft 2628 CN, The Netherlands)
  • Online:2022-07-01

摘要: 针对底盘运动和路面起伏对地面无人战车行进间跟瞄带来的非线性干扰问题,提出一种 基于强化学习补偿的地面无人战车行进间跟瞄自适应控制方法。该跟瞄控制方法由主控制器与补偿控制器两部分构成,主控制器利用PID控制算法结合当前跟瞄误差得到主控制量,补偿控制器利用Dueling Q 网络强化学习算法对战车当前状态和局部规划路径附近的路面起伏信息进行处理得到补偿控制量。建立地面无人战车一体化运动学模型,对基于强化学习的补偿控制算法进行阐述;基于V-REP动力学软件在三维场景中进行仿真验证。实验结果表明:基于强化学习补偿的跟瞄控制方法对底盘运动和路面起伏具备较好的自适应能力,有效地提升了无人战车行进间跟瞄的准确性与稳定性。

关键词: 地面无人战车, 行进间跟瞄, 强化学习, 自适应控制, 补偿控制

Abstract: To deal with the nonlinear interference caused by chassis movement and road surface undulations with the tracking and aiming of unmanned combat ground vehicles, a tracking and aiming adaptive control method for unmanned combat ground vehicles on the move based on reinforcement learning compensation is proposed. This method consists of a main controller and a compensation controller. The main controller uses the PID control algorithm combined with the current tracking error to obtain the main control quantity, and the compensation controller uses the Dueling DQN reinforcement learning network to process the current state of the combat vehicle as well as the road surface undulation information near the local planning path to obtain the compensation control quantity. Firstly, the integrated kinematics model of the unmanned combat ground vehicle is established. Then, the compensation control algorithm based on reinforcement learning is described. Finally, simulation and verification are performed in three-dimensional scenes based on the V-REP dynamic software. The experimental results show that the tracking and aiming control method based on reinforcement learning compensation has good adaptive ability for chassis movement and road surface undulations, which effectively improves the tracking/aiming accuracy and stability of unmanned combat vehicles.

Key words: unmannedcombatgroundvehicle, trackingandaimingonthemove, reinforcementlearning, adaptivecontrol, compensationcontrol

中图分类号: