导弹突防后弹道机动调整策略强化学习
2024,46(2):94-103
樊博璇
火箭军工程大学 作战保障学院, 陕西 西安 710025;
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025，1092442646@qq.com
陈桂明
火箭军工程大学 作战保障学院, 陕西 西安 710025，792757066@qq.com
韩磊
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025
李冰
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025
火箭军工程大学 作战保障学院, 陕西 西安 710025;
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025，1092442646@qq.com
陈桂明
火箭军工程大学 作战保障学院, 陕西 西安 710025，792757066@qq.com
韩磊
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025
李冰
火箭军装备部驻西安地区第一军事代表室, 陕西 西安 710025
摘要：
针对弹道导弹中段突防后飞行弹道与标准弹道产生较大偏离的弹道机动调整问题,建立了机动调整时机策略最优化模型。设计了机动调整逆序Q学习算法,采用Tile coding逼近器编码状态特征空间,并对其进行线性逼近。构建了Q学习算法与蒙特卡罗方法相结合的逆序更新策略机制,以对导弹机动调整最优时机进行训练。仿真测试分析结果表明,在给定场景参数下,通过10 000代强化学习算法训练得到的策略能够可靠地使用最少机动次数控制导弹突防后飞行弹道的调整决策,验证了方法的有效性。
针对弹道导弹中段突防后飞行弹道与标准弹道产生较大偏离的弹道机动调整问题,建立了机动调整时机策略最优化模型。设计了机动调整逆序Q学习算法,采用Tile coding逼近器编码状态特征空间,并对其进行线性逼近。构建了Q学习算法与蒙特卡罗方法相结合的逆序更新策略机制,以对导弹机动调整最优时机进行训练。仿真测试分析结果表明,在给定场景参数下,通过10 000代强化学习算法训练得到的策略能够可靠地使用最少机动次数控制导弹突防后飞行弹道的调整决策,验证了方法的有效性。
基金项目：
国家自然科学基金资助项目(71601180)
国家自然科学基金资助项目(71601180)
Reinforcement learning of ballistic maneuver adjustment strategy after missile penetration
FAN Boxuan
College of Operational Support, Rocket Force University of Engineering, Xi′an 710025, China;
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China,1092442646@qq.com
CHEN Guiming
College of Operational Support, Rocket Force University of Engineering, Xi′an 710025, China,792757066@qq.com
HAN Lei
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China
LI Bing
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China
College of Operational Support, Rocket Force University of Engineering, Xi′an 710025, China;
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China,1092442646@qq.com
CHEN Guiming
College of Operational Support, Rocket Force University of Engineering, Xi′an 710025, China,792757066@qq.com
HAN Lei
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China
LI Bing
The First Military Representative Office of the Rocket Force Equipment Department in Xi′an Region, Xi′an 710025, China
Abstract：
In order to solve the problem of trajectory maneuver adjustment caused by large deviation of flight trajectory after midcourse penetration of ballistic missile, an optimization model of maneuver adjustment timing strategy was established. A reverse sequence Q learning algorithm for maneuver adjustment was designed, and a Tile coding approximator encoding was used to encode the state characteristics space, and the space was linearly approximated. A reverse-order update strategy mechanism combining Q learning algorithm and Monte Carlo method was constructed, the optimal timing of missile maneuvering adjustment was trained. The simulation results show that the strategy obtained by training 10 000 generations of reinforcement learning algorithm can reliably control the adjustment decision of flight trajectory after missile penetration with the minimum maneuver times under given scenario parameters, which verifies the effectiveness of the method.
In order to solve the problem of trajectory maneuver adjustment caused by large deviation of flight trajectory after midcourse penetration of ballistic missile, an optimization model of maneuver adjustment timing strategy was established. A reverse sequence Q learning algorithm for maneuver adjustment was designed, and a Tile coding approximator encoding was used to encode the state characteristics space, and the space was linearly approximated. A reverse-order update strategy mechanism combining Q learning algorithm and Monte Carlo method was constructed, the optimal timing of missile maneuvering adjustment was trained. The simulation results show that the strategy obtained by training 10 000 generations of reinforcement learning algorithm can reliably control the adjustment decision of flight trajectory after missile penetration with the minimum maneuver times under given scenario parameters, which verifies the effectiveness of the method.
收稿日期：
2022-01-15
2022-01-15
