| 引用本文: | 宋效东,窦万峰,汤国安,等.分布式并行地形分析中数据划分机制研究.[J].国防科技大学学报,2013,35(1):130-135.[点击复制] |
| SONG Xiaodong,DOU Wanfeng,TANG Guoan,et al.Research on data partitioning of distributed parallel terrain analysis[J].Journal of National University of Defense Technology,2013,35(1):130-135[点击复制] |
|
| |
|
|
| 本文已被：浏览 7852次 下载 6416次 |
| 分布式并行地形分析中数据划分机制研究 |
| 宋效东1, 窦万峰2, 汤国安1, 江岭1, 赵菁2, 赵明伟1 |
|
(1.南京师范大学 虚拟地理环境教育部重点实验室，江苏 南京 210046;2.南京师范大学 计算机科学与技术学院，江苏 南京 210046)
|
| 摘要: |
| 数据粒度是海量空间数据并行计算的重要问题之一。通过对不同性质的并行算法的对比分析，提出空间数据粒度模型，量化地反映并行地形分析中数据划分的规模，建立并行数据粒度评价模型。通过研究集群环境下不同算法的数据并行数据粒度问题，提出基于并行数据粒度评价模型的优化数据粒度调度算法。通过计算每一次并行计算的时间与数据粒度效率，从而实现对计算数据粒度动态更新以追求更高的加速比。经过实验验证，该算法较之传统算法，可提供更高的任务执行效率并具有更好的可移植性。 |
| 关键词: 并行计算 数字地形分析 数据划分 数据粒度 |
| DOI： |
| 投稿日期：2012-07-09 |
| 基金项目:国家863计划资助项目（2011AA120303）；国家自然科学基金资助项目（41171298）；
资源与环境信息系统国家重点实验室开放基金资助项目（2010KF0002SA）；江苏省普通高校研究生科研创新计划项目（CXZZ12_0393） |
|
| Research on data partitioning of distributed parallel terrain analysis |
| SONG Xiaodong1, DOU Wanfeng2, TANG Guoan1, JIANG Ling1, ZHAO Jing2, ZHAO Mingwei1 |
|
(1.Key Laboratory of Virtual Geographic Environment of Ministry of Education, Nanjing Normal University, Nanjing 210046, China;2.School of Computer Science and Technology, Nanjing Normal University, Nanjing 210046, China)
|
| Abstract: |
| Data granularity is one of the most important issues of parallel computing based on large volume of spatial data. After a comparison with the different types of terrain analysis algorithms, a Geo-Data Granularity Model (GDGM in short) was proposed, which can be used for the quantitative description of data partition granularity in parallel computing process of massive spatial data. In this algorithm, according to the parallel evaluation method, the parallel data granularity was adaptively adjusted and finally an optimized data grain was obtained. The execution time of each parallel computing was recorded for the comparison of computing efficiency values from different data granularities. Furthermore, by means of the comparison, a dynamic algorithm was designed for the dynamic scheduling of different data granularity so that the optimal performance of specific algorithm was achieved. The preliminary experiments show that the algorithm has much better efficiency and portability than the traditional ones so far. |
| Keywords: parallel computing digital terrain analysis data partition data granularity |
|
|
|
|
|
