异构混合存储的软硬件协同数据放置策略
作者:
作者单位:

(1. 信息工程大学 地理空间信息学院, 河南 郑州 450001;2. 中国人民解放军31008部队, 北京 100091)

作者简介:

李鸿飞(1974—),男,黑龙江哈尔滨人,高级工程师,硕士,E-mail:lihongfei18188@126.com

通讯作者:

中图分类号:

TP311.13

基金项目:


Software and hardware co-design of data placement in heterogeneous hybrid store
Author:
Affiliation:

(1.Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China;2.The PLA Unit 31008, Beijing 100091, China)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    分析比较当前大数据中心典型混合存储架构,针对其不能综合运用存储管理系统和存储设备优势的问题,提出软硬件协同的数据放置策略,同时考虑软件层混合存储管理系统和硬件层混合存储设备的特点,根据应用特性为数据选择合适的存储管理系统和设备。面向不同应用场景,提出运行前规划存储路径的静态放置模式和运行中规划存储路径的动态放置模式。基于存储管理系统和设备性能参数建模,采用仿真方法实现各数据放置策略,并运行实际应用中的三类负载进行实验测试,结果表明采用软硬件协同的数据放置策略相比只考虑存储管理系统和存储设备的数据放置策略,性能可以提高近30%。

    Abstract:

    The analysis of the existing typical hybrid store architectures in big data center found that they cannot fully take advantage of both hybrid storage management systems and hybrid storage devices. Thus a hardware and software co-design data placement strategy was proposed, which simultaneously considers the hybrid storage management systems at software level and the hybrid storage devices at hardware level, and figures out the trail of data placement on both storage systems and devices regarding application characteristics. Moreover, the static placement pattern before running and the dynamic placement pattern during running were proposed on the basis of different application scenes. An experiment was implemented by running three kinds of workloads on simulated data placement strategies based on the model according to the performance parameters of storage management systems and storage devices. The results show that the proposed design outperforms traditional ones that either consider storage management systems or storage devices separately by up to 30%.

    参考文献
    相似文献
    引证文献
引用本文

李鸿飞,杜溢墨,曾熠,等.异构混合存储的软硬件协同数据放置策略[J].国防科技大学学报,2020,42(2):64-71.
LI Hongfei, DU Yimo, ZENG Yi, et al. Software and hardware co-design of data placement in heterogeneous hybrid store[J]. Journal of National University of Defense Technology,2020,42(2):64-71.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2019-03-02
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2020-04-29
  • 出版日期: 2020-04-28
文章二维码