| 引用本文: | 王冲,景宁,李军,等.一种基于多Agent强化学习的多星协同任务规划算法.[J].国防科技大学学报,2011,33(1):53-58.[点击复制] |
| WANG Chong,JING Ning,LI Jun,et al.An Algorithm of Cooperative Multiple Satellites Mission Planning Based on Multi-agent Reinforcement Learning[J].Journal of National University of Defense Technology,2011,33(1):53-58[点击复制] |
|
| |
|
|
| 本文已被：浏览 8119次 下载 7110次 |
| 一种基于多Agent强化学习的多星协同任务规划算法 |
| 王冲, 景宁, 李军, 王钧, 陈浩 |
|
(国防科技大学 电子科学与工程学院，湖南 长沙 410073)
|
| 摘要: |
| 在分析任务特点和卫星约束的基础上给出了多星协同任务规划问题的数学模型。引入约束惩罚算子和多星联合惩罚算子对卫星Agent原始的效用值增益函数进行改进，在此基础上提出了一种多卫星Agent强化学习算法以求解多星协同任务分配策略，设计了基于黑板结构的多星交互方式以降低学习交互过程中的通信代价。通过仿真实验及分析证明该方法能够有效解决多星协同任务规划问题。 |
| 关键词: 卫星任务规划 协同规划 多智能体强化学习 黑板结构 |
| DOI： |
| 投稿日期：2010-06-25 |
| 基金项目:国家自然科学基金资助项目(60604035)；国家863高技术资助项目(2007AA12020203) |
|
| An Algorithm of Cooperative Multiple Satellites Mission Planning Based on Multi-agent Reinforcement Learning |
| WANG Chong, JING Ning, LI Jun, WANG Jun, CHEN Hao |
|
(College of Electronic Science and Engineering, National Univ. of Defense Technology, Changsha 410073, China)
|
| Abstract: |
| A multi-satellite cooperative planning problem model was given considering the characteristics of the task requests and satellite
constraints. Then the original performance function of each satellite agent was modified by introducing both the constraint punishing operator and the multi-satellite joint punishing operator. Next, a multi-satellite reinforcement learning algorithm (MUSARLA) was proposed to derive the coordinated task allocation strategy. Furthermore, the interaction among multiple satellites was designed based on blackboard architecture to reduce the communication cost while learning. Finally, simulated experiments are carried out which verified the effectiveness of the proposed algorithm. |
| Keywords: satellite mission planning cooperative planning multi-agent reinforcement learning blackboard architecture |
|
|
|
|
|
