通信学报

• 学术论文 •    下一篇

满足本地化计算的集群资源调度策略

郭 平,宁立江,陈海珠   

  1. 1.重庆大学 计算机学院,重庆 400044;2.软件理论与技术重庆市重点实验室,重庆 400044;3.重庆电子工程职业学院,重庆 401331
  • 出版日期:2014-11-25 发布日期:2014-12-17
  • 基金资助:
    国家自然科学青年基金资助项目(61201347);重庆市自然基金资助项目(2012jjA40022, 2011jjA40027, 2012jjA40011)

Scheduling strategy for achieving locality in cluster

  • Online:2014-11-25 Published:2014-12-17

摘要: 将本地化计算分成节点本地化计算和机架本地化计算2个层次,分别称作节点本地化计算和机架本地化计算。结合主导资源公平调度策略DRF和Delay调度约束机制提出一种满足本地化计算的集群资源调度策略DDRF,旨在既能达到一个较高的本地化计算水平,又能保证资源调度的“公平性”。通过数据实验分析了在DDRF调度策略下本地化计算延迟对作业执行效率的影响。

Abstract: The data locality is divided into two levels. One is called the node data locality, which placing tasks on nodes that contain their input data. The other one is called the rack data locality, which placing tasks on nodes whose rack contains their input data. A new scheduling strategy called DDRF is proposed which combines the DRF and the delay. The DDRF is not only able to meet high locality but also achieve fairness. In the DDRF, the simulation results show the influence on the efficiency of jobs’ implement.

No Suggested Reading articles found!