基于利益相关视角的多维QoS云资源调度方法

doi:10.11959/j.issn.1000-436x.2019113

通信学报 ›› 2019, Vol. 40 ›› Issue (6): 102-115.doi: 10.11959/j.issn.1000-436x.2019113

基于利益相关视角的多维QoS云资源调度方法

苏命峰¹,王国军²(),李仁发³

¹ 中南大学计算机学院,湖南长沙 410083
² 广州大学计算机科学与网络工程学院，广东广州510006
³ 湖南大学信息科学与工程学院，湖南长沙 410082

修回日期:2019-02-08 出版日期:2019-06-25 发布日期:2019-07-04
作者简介:苏命峰（1980- ），男，湖南宁乡人，中南大学博士生，主要研究方向为云计算、边缘计算、云-端协同计算等。|王国军（1970- ），男，湖南长沙人，博士，广州大学教授、博士生导师，主要研究方向为云计算、边缘计算、云-端协同计算等。|李仁发（1957- ），男，湖南宜章人，博士，湖南大学教授、博士生导师，主要研究方向为云计算、嵌入式系统、无线传感网等。
基金资助:
国家自然科学基金资助项目(61632009);国家自然科学基金资助项目(61472451);国家自然科学基金资助项目(61672217);湖南省自然科学基金资助项目(2019JJ70057);广东省自然科学基金资助项目(2017A030308006);广东省高等教育高层次人才计划基金资助项目(2016ZJ01);中南大学中央高校基本科研业务费专项资金基金资助项目(2018zzts180)

Multidimensional QoS cloud computing resource scheduling method based on stakeholder perspective

SU Mingfeng¹,WANG Guojun²(),LI Renfa³

¹ School of Computer Science and Engineering,Central South University,Changsha 410083,China
² School of Computer Science and Cyber Engineering,Guangzhou University,Guangzhou 510006,China
³ College of Computer Science and Electronic Engineering,Hunan University,Changsha 410082,China

Revised:2019-02-08 Online:2019-06-25 Published:2019-07-04
Supported by:
The National Natural Science Foundation of China(61632009);The National Natural Science Foundation of China(61472451);The National Natural Science Foundation of China(61672217);The Natural Science Foundation of Hunan Province(2019JJ70057);The Natural Science Foundation of Guangdong Province(2017A030308006);The High-Level Talents Program of Higher Education of Guangdong Province(2016ZJ01);The Fundamental Research Funds for the Central Universities of Central South University(2018zzts180)

摘要/Abstract

摘要：

基于云用户和云服务提供商的利益相关视角，以低计算成本（如能耗、经济成本和系统可用性等）满足云用户高QoS需求（如任务执行时间和任务最终完成时间），设计多维QoS云计算体系结构，构建多维QoS云资源调度模型，面向二级云资源调度，提出采用多重Greedy算法思想的MQoS云资源调度算法。实验结果表明，在具有无后效性的4种云计算应用场景下，MQoS云资源调度算法相比FIFO云资源调度算法、M2EC多维能耗虚拟机调度算法，其多维QoS度总体提升206.42%~228.99%、34.26%~56.93%，其云数据中心负载均衡差平均总体降低0.48~0.49、0.20~0.27。

关键词: 云计算, 资源调度, 多目标优化, 利益相关视角, 多维服务质量

Abstract:

A multidimensional cloud computing architecture is designed and a multidimensional cloud resource scheduling model is constructed based on the stakeholder perspective of cloud users and cloud service providers to meet the high QoS requirements of cloud users (such as task execution time and task completion time) with low computing costs (such as energy consumption,economic costs and system availability).For the second-level cloud resource scheduling,an MQoS cloud resource scheduling algorithm based on multiple Greedy algorithm is proposed.The experimental results show that under the four cloud computing application scenarios with no aftereffects,the MQoS cloud resource scheduling algorithm has an overall increase of 206.42%~228.99% and 34.26%~56.93 in terms of multidimensional QoS degree compared with FIFO and M2EC algorithms.It has an average overall reduction of 0.48~0.49 and 0.20~0.27 in terms of cloud data center load balance difference.

Key words: cloud computing, resource scheduling, multi-objective optimization, stakeholder perspective

中图分类号:

TP393

苏命峰,王国军,李仁发. 基于利益相关视角的多维QoS云资源调度方法[J]. 通信学报, 2019, 40(6): 102-115.

SU Mingfeng,WANG Guojun,LI Renfa. Multidimensional QoS cloud computing resource scheduling method based on stakeholder perspective[J]. Journal on Communications, 2019, 40(6): 102-115.

图/表 11

图1

表1

图2

表1

表2

表3

表4

图3

图4

图5

图6

参考文献 30

[1]	TOPCUOGLU H , HARIRI S , WU M Y . Performance-effective and low-complexity task scheduling for heterogeneous computing[J]. IEEE Transactions on Parallel and Distributed Systems, 2002,13(3): 260-274.
[2]	MACE J , BODIK P , MUSUVATHI M ,et al. 2DFQ:two-dimensional fair queuing for multi-tenant cloud services[C]// The ACM Special Interest Group on Data Communication. ACM, 2016: 144-159.
[3]	GRANDL R , CHOWDHURY M , AKELLA A ,et al. Altruistic scheduling in multi-resource clusters[C]// The USENIX Symposium on Operating Systems Design and Implementation. USENIX, 2016: 65-80.
[4]	WANG Z , HAYAT M , GHANI N ,et al. Optimizing cloud-service performance:efficient resource provisioning via optimal workload allocation[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(6): 1689-1702.
[5]	DALVANDI A , GURUSAMY M , CHUA K . Application scheduling,placement,and routing for power efficiency in cloud data centers[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(4): 947-960.
[6]	陈黄科, 祝江汉, 朱晓敏 ,等. 云计算中资源延迟感知的实时任务调度方法[J]. 计算机研究与发展, 2017,54(2): 446-456.
	CHEN H K , ZHU J H , ZHU X M ,et al. Resource-delay-aware scheduling for real-time tasks in clouds[J]. Journal of Computer Research and Development, 2017,54(2): 446-456.
[7]	ZHANG H , CHEN L , YI B ,et al. CODA:toward automatically identifying and scheduling coflows in the dark[C]// The Conference of the ACM Special Interest Group on Data Communication. ACM, 2016: 160-173.
[8]	GHADERI J , . Randomized algorithms for scheduling vms in the cloud[C]// The Annual IEEE International Conference on Computer Communications. IEEE, 2016: 1-9.
[9]	KULKARNI S G , ZHANG W , HWANG J ,et al. NFVnice:dynamic backpressure and scheduling for NFV service chains[C]// The Conference of the ACM Special Interest Group on Data Communication. ACM, 2017: 71-84.
[10]	GONG Y , HE B , LI D . Network performance aware optimizations on IaaS clouds[J]. IEEE Transactions on Computers, 2017,66(4): 672-687.
[11]	刘维杰, 王丽娜, 王丹磊 ,等. 面向云计算平台的虚拟机同驻方法[J]. 通信学报, 2018,39(11): 116-128.
	LIU W J , WANG L N , WANG D L ,et al. Virtual machine co-residency method on cloud computing platform[J]. Journal on Communications, 2018,39(11): 116-128.
[12]	CHOWDHURY M , STOICA I . Efficient coflow scheduling without prior knowledge[C]// The Conference of the ACM Special Interest Group on Data Communication. ACM, 2015: 393-406.
[13]	DALVANDI A , GURUSAMY M , CHUA K C . Application scheduling,placement,and routing for power efficiency in cloud data centers[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(4): 947-960.
[14]	李智勇, 陈少淼, 杨波 ,等. 异构云环境多目标 memetic 优化任务调度方法[J]. 计算机学报, 2016,39(2): 377-390.
	LI Z Y , CHEN S M , YANG B ,et al. Multi-objective memetic algorithm for task scheduling on heterogeneous cloud[J]. Chinese Journal of Computers, 2016,39(2): 377-390.
[15]	沈尧, 秦小麟, 鲍芝峰 . 一种云环境中数据流的高效多目标调度方法[J]. 软件学报, 2017,28(3): 579-597.
	SHEN Y , QIN X L , BAO Z F . Effective multi-objective scheduling strategy of dataflow in cloud[J]. Journal of Software, 2017,28(3): 579-597.
[16]	徐久强, 郭雪静, 王进法 ,等. CPS 资源服务模型和资源调度研究[J]. 计算机学报, 2018,41(10): 2330-2343.
	XU J Q , GUO X J , WANG J F ,et al. Research on CPS resource service model and resource scheduling[J]. Chinese Journal of Computers, 2018,41(10): 2330-2343.
[17]	REN X , ANANTHANARAYANAN G , WIERMAN A ,et al. Hopper:decentralized speculation-aware cluster scheduling at scale[C]// The ACM Special Interest Group on Data Communication. ACM, 2015: 379-392.
[18]	CUI L , HAO Z , PENG Y ,et al. Piccolo:a fast and efficient rollback system for virtual machine clusters[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(8): 2328-2341.
[19]	HOMSI S , LIU S , CHAPARRO-BAQUERO G A ,et al. Workload consolidation for cloud data centers with guaranteed qos using request reneging[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(7): 2103-2116.
[20]	CHENG D Z H , ZHOU X B , LAMA P ,et al. Energy efficiency aware task assignment with DVFS in heterogeneous hadoop clusters[J]. IEEE Transactions on Parallel and Distributed Systems, 2018,29(1): 70-82.
[21]	HU Z , LI B , LUO J ,et al. Time-and cost-efficient task scheduling across geo-distributed data centers[J]. IEEE Transactions on Parallel and Distributed Systems, 2018,29(3): 705-718.
[22]	DU Y , VECIANA G D . Scheduling for cloud-based computing systems to support soft real-time applications[C]// The Conference of the ACM Special Interest Group on Data Communication. ACM, 2016: 1-9.
[23]	CUI L , CZIVA R , TSO F P ,et al. Synergistic policy and virtual machine consolidation in cloud data centers[C]// The Annual IEEE International Conference on Computer Communications. IEEE, 2016: 1-9.
[24]	YANG S , WIEDER P , YAHYAPOUR R ,et al. Reliable virtual machine placement and routing in clouds[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(10): 2965-2978.
[25]	ADAM O , LEE Y C , ZOMAYA A Y . Stochastic resource provisioning for containerized multi-tier Web services in clouds[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(7): 2060-2073.
[26]	RAMPERSAUD S , GROSU D . Sharing-aware online virtual machine packing in heterogeneous resource clouds[J]. IEEE Transactions on Parallel and Distributed Systems, 2017,28(7): 2046-2059.
[27]	孙大为, 常桂然, 陈东 ,等. 云计算环境中绿色服务级目标的分析、量化、建模及评价[J]. 计算机学报, 2013,36(7): 1509-1525.
	SUN D W , CHANG G R , CHEN D ,et al. Profiling,quantifying,modeling and evaluating green service level objectives in cloud computing enviroments[J]. Chinese Journal of Computers, 2013,36(7): 1509-1525.
[28]	ADDYA S K , TURUK A K , SAHOO B ,et al. A game theoretic approach to estimate fair cost of VM Placement in cloud data center[J]. IEEE System Journal, 2018,12(4): 3509-3518.
[29]	ALHARBI F , TIAN Y C , TANG M L ,et al. An ant colony system for energy-efficient dynamic virtual machine placement in data centers[J]. Expert System witch Applications, 2019(120): 228-239.
[30]	LEBRE A , PASTOR J , SIMONET A ,et al. Putting the next 500 VMplacement algorithms to the acid test:the infrastructure provider viewpoint[J]. IEEE Transactions on Parallel and Distributed Systems, 2019,30(1): 204-217.

符号	含义
CU	云用户
CT	云任务
PM	物理机
VM	虚拟机
CSP	云服务提供商
CDC	云数据中心
CET	云任务执行时间
CFT	云任务最终完成时间
CEC	云系统能耗
CA	云系统可用性
CE	云系统经济
CET_ijk	云任务j在云数据中心k虚拟机i的执行时间
CFT_ijk	云任务j在云数据中心k虚拟机i的最终完成时间
CEC _kl	云数据中心k的物理机l的云系统能耗
CA _km	云数据中心k的虚拟机m的云系统可用性
CE _kl	云数据中心k的物理机l的云系统经济
Qs	多维QoS度
LBD	云数据中心负载均衡差

CDC 序号	节点数/个	CPU/PE	RAM/GB	BW/(Gbit·s^-1)
DC00~DC02	200	2~4	8~32	1~10
DC03~DC05	250	4~6	8~32	1~10
DC06~DC08	300	4~6	8~64	1~20
DC09~DC11	350	4~8	8~64	1~20
DC12~DC14	400	4~8	16~128	1~40
DC15~DC17	500	4~16	16~128	1~40

VM类型	虚拟CPU/颗	RAM/GB	Storage/GB	BW/(Gbit·s^-1)
通用型	2	8	500	1
计算型	8	16	500	2
内存型	4	32	500	4
存储型	2	8	2 000	10

应用场景	CU数/个	资源差	任务差
HR-HT	1×10⁴~9×10⁴	100,1]	1,500]
HR-LT	1×10⁴~9×10⁴	10,1]	1,500]
LR-HT	1×10⁴~9×10⁴	100,1]	1,10]
LR-LT	1×10⁴~9×10⁴	10,1]	1,10]

参数	参数值	描述
δ	0.2,0.8]	基于能耗和动态能耗的调节参数
T	60	时间段
W	0.2,0.2,0.2,0.2,0.2]	五维性能指标的权重向量

基于利益相关视角的多维QoS云资源调度方法

Multidimensional QoS cloud computing resource scheduling method based on stakeholder perspective

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献 30

相关文章 15

Metrics

推荐阅读 0

[1]	王莉, 费爱国, 张平, 徐连明. 智能应急指挥通信网络新框架与关键技术研究[J]. 通信学报, 2023, 44(6): 1-11.
[2]	马玲, 樊漆亮, 许婷, 郭冠琛, 张圣林, 孙永谦, 张玉志. 基于强化学习的在线离线混部云环境下的调度框架[J]. 通信学报, 2023, 44(6): 90-102.
[3]	赵庶旭, 韦萍, 王小龙. 多任务并发边缘计算环境中最优联盟结构生成策略[J]. 通信学报, 2023, 44(2): 172-184.
[4]	朱思峰, 蔡江昊, 柴争义, 孙恩林. 车联网云边协同计算场景下的多目标优化卸载决策[J]. 通信学报, 2022, 43(6): 223-234.
[5]	王化群, 刘哲, 何德彪, 李继国. 公有云中身份基多源IoT终端数据PDP方案[J]. 通信学报, 2021, 42(7): 52-60.
[6]	何元智, 彭聪, 于季弘, 刘韵. 面向密集多波束组网的卫星通信系统资源调度算法[J]. 通信学报, 2021, 42(4): 109-118.
[7]	张键红, 武梦龙, 王晶, 刘沛, 姜正涛, 彭长根. 云环境下安全的可验证多关键词搜索加密方案[J]. 通信学报, 2021, 42(4): 139-149.
[8]	李瑞琪, 贾春福, 王雅飞. 基于NTRU的多密钥同态代理重加密方案及其应用[J]. 通信学报, 2021, 42(3): 11-22.
[9]	张嘉伟, 马建峰, 马卓, 李腾. 云计算中基于时间和隐私保护的可撤销可追踪的数据共享方案[J]. 通信学报, 2021, 42(10): 81-94.
[10]	王文娟, 杜学绘, 单棣斌. 基于动态概率攻击图的云环境攻击场景构建方法[J]. 通信学报, 2021, 42(1): 1-17.
[11]	诸天逸,李凤华,金伟,郭云川,房梁,成林. 互操作性与自治性平衡的跨域访问控制策略映射[J]. 通信学报, 2020, 41(9): 29-48.
[12]	田有亮,骆琴. 基于改进Merkle-Tree认证方法的可验证多关键词搜索方案[J]. 通信学报, 2020, 41(9): 118-129.
[13]	王娜,郑坤,付俊松,李剑. 基于分块的移动边缘计算密文检索方法[J]. 通信学报, 2020, 41(7): 95-102.
[14]	张沛,刘帅军,马治国,王晓晖,宋俊德. 基于深度增强学习和多目标优化改进的卫星资源分配算法[J]. 通信学报, 2020, 41(6): 51-60.
[15]	赵临东,庄文芹,陈建新,周亮. 异构蜂窝网络中分层任务卸载：建模与优化[J]. 通信学报, 2020, 41(4): 34-44.