| 引用本文: | 樊博璇,陈桂明,韩磊,等.导弹突防后弹道机动调整策略强化学习.[J].国防科技大学学报,2024,46(2):94-103.[点击复制] |
| FAN Boxuan,CHEN Guiming,HAN Lei,et al.Reinforcement learning of ballistic maneuver adjustment strategy after missile penetration[J].Journal of National University of Defense Technology,2024,46(2):94-103[点击复制] |
|
| |
|
|
| 本文已被：浏览 3534次 下载 2208次 |
| 导弹突防后弹道机动调整策略强化学习 |
| 樊博璇1,2,陈桂明1,韩磊2,李冰2 |
|
(1. 火箭军工程大学 作战保障学院, 陕西 西安 710025;2. 火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025)
|
| 摘要: |
| 针对弹道导弹中段突防后飞行弹道与标准弹道产生较大偏离的弹道机动调整问题,建立了机动调整时机策略最优化模型。设计了机动调整逆序Q学习算法,采用Tile coding逼近器编码状态特征空间,并对其进行线性逼近。构建了Q学习算法与蒙特卡罗方法相结合的逆序更新策略机制,以对导弹机动调整最优时机进行训练。仿真测试分析结果表明,在给定场景参数下,通过10 000代强化学习算法训练得到的策略能够可靠地使用最少机动次数控制导弹突防后飞行弹道的调整决策,验证了方法的有效性。 |
| 关键词: 弹道导弹 中段突防 强化学习 Q学习 控制决策 |
| DOI：10.11887/j.cn.202402010 |
| 投稿日期：2022-01-15 |
| 基金项目:国家自然科学基金资助项目(71601180) |
|
| Reinforcement learning of ballistic maneuver adjustment strategy after missile penetration |
| FAN Boxuan1,2, CHEN Guiming1, HAN Lei2, LI Bing2 |
|
(1. College of Operational Support, Rocket Force University of Engineering, Xi′an 710025, China;2. The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China)
|
| Abstract: |
| In order to solve the problem of trajectory maneuver adjustment caused by large deviation of flight trajectory after midcourse penetration of ballistic missile, an optimization model of maneuver adjustment timing strategy was established. A reverse sequence Q learning algorithm for maneuver adjustment was designed, and a Tile coding approximator encoding was used to encode the state characteristics space, and the space was linearly approximated. A reverse-order update strategy mechanism combining Q learning algorithm and Monte Carlo method was constructed, the optimal timing of missile maneuvering adjustment was trained. The simulation results show that the strategy obtained by training 10 000 generations of reinforcement learning algorithm can reliably control the adjustment decision of flight trajectory after missile penetration with the minimum maneuver times under given scenario parameters, which verifies the effectiveness of the method. |
| Keywords: ballistic missile midcourse penetration reinforcement learning Q learning control decision |
|
|
|
|
|
