满足本地化计算的集群资源调度策略

doi:10.3969/j.issn.1000-436x.2014.z2.001

Abstract

Abstract:

The data locality is divided into two levels.One is called the node data locality,which placing tasks on nodes that contain their input data.The other one is called the rack data locality,which placing tasks on nodes whose rack contains their input data.A new scheduling strategy called DDRF is proposed which combines the DRF and the delay.The DDRF is not only able to meet high locality but also achieve fairness.In the DDRF,the simulation results show the influence on the efficiency of jobs’ implement.

Key words: DDRF, scheduling, locality, computing cluster

Ping GUO,Li-jiang NING,Hai-zhu CHEN. Scheduling strategy for achieving locality in cluster[J]. Journal on Communications, 2014, 35(Z2): 1-8.

Figures/Tables 6

References 14

[1]	FIFO[EB/OL]. .
[2]	LEBOUDEC J Y . Rate adaptation,congestion control and fairnes s:a tutorial[EB/OL]. .
[3]	Capacity scheduler[EB/OL]. .
[4]	ZAHARIA M , BORTHAKUR D , SARMA J S ,et al. Job Scheduling for Multi-user Mapreduce Clusters:UCB/EECS-2009-55[R]. Berkeley:EECS Department,University of California, 2009.
[5]	GHODSI A , ZAHARIA M , HINDMAN B ,et al. Dominant resource fairness:fair allocation of multiple resource types[A]. Proceedings of the 8th USENIX Conference on NSDI[C]. Berbeley:USENIX Association, 2011. 24-37.
[6]	ZAHARIA M , KONWINSKI A , JOSEPH A D ,et al. Improving mapreduce performance in heterogeneous environments[A]. 8th USENIX Symposium on Operating Systems Design and Implementation[C]. San Diego:USENIX Association, 2008. 29-42.
[7]	POLO J , CARRERA D , BECERRA Y ,et al. Performance-driven task co-scheduling for mapreduce environments[A]. Network Operations and Management Symposium (NOMS)[C]. San Diego:IEEE, 2010. 373-380.
[8]	KC K , ANYANWU K . Scheduling hadoop jobs to meet deadlines[A]. Cloud Computing Technology and Science (CloudCom)[C]. San Diego:IEEE, 2010: 388-392.
[9]	Dynamic priority scheduling[EB/OL]. .
[10]	ZAHARIA M , BORTHAKUR D , SEN SARMA J ,et al. Delay scheduling:a simple technique for achieving locality and fairness in cluster scheduling[A]. Proceedings of the 5th European conference on Computer systems[. Paris:ACM, 2010: 265-278.
[11]	SHVACHKO K , KUANG H , RADIA S ,et al. The hadoop distributed file system[A]. Mass Storage Systems and Technologies (MSST)[C]. Lake Tahoe,Nevada,USA:IEEE, 2010: 1-10.
[12]	GUO P , NING L , SU L ,et al. A new strategy of resource management for cloud computing[J]. Information Technology Journal, 2013,12(18).
[13]	Amazon elastic compute cloud[EB/OL]. .
[14]	OSTERMANN S , IOSUP A , YIGITBASI N ,et al. A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing Cloud Computing[M]. Springer Berlin Heidelberg, 2010. 115-131.

Metrics

Recommended 0

No Suggested Reading articles found!

调度序列	A		B		CPU使用量	内存使用量
调度序列	资源占比	主导资源占比	资源占比	主导资源占比	CPU使用量	内存使用量
B	＜0,0＞	0	＜3/9,1/18＞	1/3	3/9	1/18
A	＜1/9,4/18＞	2/9	＜3/9,1/18＞	1/3	4/9	5/18
A	＜2/9,8/18＞	4/9	＜3/9,1/18＞	1/3	5/9	9/18
B	＜2/9,8/18＞	4/9	＜6/9,2/18＞	2/3	8/9	10/18
A	＜3/9,12/18＞	2/3	＜6/9,2/18＞	2/3	1	14/18

E₁	p
10	40%
20	65%
30	79%
40	87%
50	93%
60	98%

[1]	Long YANG, Li ZHAO, Yuchen ZHOU, Bingtao HE, Jian CHEN. Buffer-aided cooperative NOMA with power transfer [J]. Journal on Communications, 2023, 44(6): 77-89.
[2]	Weifeng LU, Ning LI, Jia XU, Lijie XU, Jian XU. Joint scheduling algorithm for correlative tasks in multi-access edge computing [J]. Journal on Communications, 2023, 44(4): 87-98.
[3]	Shuxu ZHAO, Ping WEI, Xiaolong WANG. Optimal coalition structure generation strategy in multi-task concurrent edge computing environment [J]. Journal on Communications, 2023, 44(2): 172-184.
[4]	Hongrui NIE, Shaosheng LI, Yong LIU. Optimized scheduling mechanism based on IEEE 802.1Qch standard in time-sensitive networking [J]. Journal on Communications, 2022, 43(9): 12-26.
[5]	Zongxuan SHA, Ru HUO, Chuang SUN, Shuo WANG, Tao HUANG. Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(8): 30-40.
[6]	Shiwen HE, Jun YUAN, Zhenyu AN, Min ZHANG, Yongming HUANG, Yaoxue ZHANG. GNN-based optimization algorithm for joint user scheduling and beamforming [J]. Journal on Communications, 2022, 43(7): 73-84.
[7]	Zhiqin WANG, Jiamo JIANG, Peixi LIU, Xiaowen CAO, Yang LI, Kaifeng HAN, Ying DU, Guangxu ZHU. New design paradigm for federated edge learning towards 6G:task-oriented resource management strategies [J]. Journal on Communications, 2022, 43(6): 16-27.
[8]	Wenlong KOU, Yuyang ZHANG, Fenghua LI, Xiaogang CAO, Jiamin LI, Zhu WANG, Kui GENG. On-demand and efficient scheduling scheme for cryptographic service resource [J]. Journal on Communications, 2022, 43(6): 108-118.
[9]	Changchuan YIN, Yanjue LI, Hailong ZHU, Xinxin HE, Wenxuan HAN. HSTC: hybrid traffic scheduling mechanism in time-sensitive networking [J]. Journal on Communications, 2022, 43(6): 119-132.
[10]	Sijin YANG, Lei ZHUANG, Yu SONG, Jiaxing WANG, Xinyu YANG. Intelligent scheduling mechanism of time-sensitive network modal in polymorphic network [J]. Journal on Communications, 2022, 43(5): 82-91.
[11]	Hongyong JIA, Yunfei PAN, Wenhe LIU, Junjie ZENG, Jianhui ZHANG. Executive dynamic scheduling algorithm based on high-order heterogeneity [J]. Journal on Communications, 2022, 43(3): 233-245.
[12]	Jinchuan PEI, Yuxiang HU, Le TIAN, Tao HU, Ziyong LI. Time-sensitive network traffic scheduling method with joint routing planning [J]. Journal on Communications, 2022, 43(12): 54-65.
[13]	Jiuchuan HU, Dongrui FAN, Jiancong CHENG, Long YAN, Xiaochun YE, Lingzhi LI, Liangyi WAN, Haibin ZHONG. Theoretical analysis for the data immigration between memory and processor percolation cache [J]. Journal on Communications, 2021, 42(8): 217-225.
[14]	Qing TONG, Yunfei GUO, Shumin HUO, Yawen WANG, Yujia MAN, Kai ZHANG. Design of self-adaptive spatio-temporal diversity joint scheduling strategy [J]. Journal on Communications, 2021, 42(7): 12-24.
[15]	Jun’e LI, Qiuyu LU, Jian LIU, Kai YUAN, Wei TIAN, Bijun PENG. Communication service priority in smart substation and its queue scheduling method [J]. Journal on Communications, 2021, 42(7): 25-40.

Scheduling strategy for achieving locality in cluster

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 6

References 14

Related Articles 15

Metrics

Recommended 0