欢迎访问《空军工程大学学报》官方网站!

咨询热线:029-84786242 RSS EMAIL-ALERT
具有精英策略的深度强化学习无人机集群通信网络拓扑设计
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP393

基金项目:

国家自然科学基金(61472443)


Topology Design of Network Based on Deep Reinforcement Learning with Strategy of Elite
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对集群无人机背景下定向天线网络拓扑设计的NP-hard特点,基于网络高抗毁、低功耗、高稳定性等要求,以抗毁性(3-连通)、链路量、链路功耗和稳定性为奖励,提出了一种具有精英策略的深度强化学习通信网络拓扑生成算法,验证了精英经验池加速训练效果。与传统DQN相比,引入精英经验池能够有效加速模型收敛,训练时间减少3倍以上。与遗传算法相比,算法分离了训练与使用过程,当网络训练完成后,能够根据场景需要实时计算通信网络拓扑。实验阶段设计了随机给定空间位置的6节点、10节点、24节点和36节点的3-连通通信网络拓扑。实验结果表明:所提算法具有强的实时性和适用性,对于不大于36节点的网络,可在183 ms内实现网络拓扑的更新计算,达到了实际应用的实时性要求。

    Abstract:

    Aiming at the NP-hard characteristics of directional antenna network topology design under cluster UAV background, an elite strategy for deep reinforcement learning communication network topology generation algorithm is introduced with the requirements of high survivability, low power consumption and high stability of the network, which has the rewarding of invulnerability (3-connectivity), link quantity, link power consumption and stability. Compared with traditional DQN, elite experience pool verifies the acceleration training effect by effectively accelerating the convergence of the model and reducing the training time by more than three times. Rather than genetic algorithm, this algorithm separates the processes of use and training . When the network training is completed, the communication network topology can be calculated in real time with the needs of scene. In experimental stage, a 3-connected communication network topology with randomly given spatial location is designed which includes 6 nodes, 10 nodes, 24 nodes and 36 nodes . The experimental results has shown that this proposed algorithm has strong realtime and applicability, it can help network topology which has less than 36 nodes update in 183 ms so that meeting the realtime requirements of practical application.

    参考文献
    相似文献
    引证文献
引用本文

董方昊,冯有前,尹忠海,梁晓龙,周诚,李明杰.具有精英策略的深度强化学习无人机集群通信网络拓扑设计[J].空军工程大学学报,2019,20(4):52-58

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2019-10-23
  • 出版日期: