Ceph云存储网络中一种业务优先级区分的多播流调度方法

doi:10.11959/j.issn.1000-436x.2020233

通信学报 ›› 2020, Vol. 41 ›› Issue (11): 40-51.doi: 10.11959/j.issn.1000-436x.2020233

Ceph云存储网络中一种业务优先级区分的多播流调度方法

柯文龙¹,王勇²,叶苗^1,³(),陈俊奇²

¹ 桂林电子科技大学信息与通信学院，广西桂林 541004
² 桂林电子科技大学计算机与信息安全学院，广西桂林 541004
³ 桂林电子科技大学认知无线电与信息处理省部共建教育部重点实验室，广西桂林 541004

修回日期:2020-10-09 出版日期:2020-11-25 发布日期:2020-12-19
作者简介:柯文龙（1989- ），男，安徽铜陵人，桂林电子科技大学博士生，主要研究方向为云存储系统网络、软件定义网络等|王勇（1964- ），男，四川南充人，博士，桂林电子科技大学教授、博士生导师，主要研究方向为云计算、分布式存储系统、信息安全等|叶苗（1977- ），男，广西桂林人，博士，桂林电子科技大学教授、博士生导师，主要研究方向为分布式存储、无线传感器网络、工程中的优化理论与方法、模式识别与机器学习|陈俊奇（1997- ），男，湖南邵阳人，桂林电子科技大学硕士生，主要研究方向为云存储系统、软件定义网络等
基金资助:
国家自然科学基金资助项目(61861013);国家自然科学基金资助项目(61662018);广西创新驱动发展专项_科技重大专项基金资助项目(桂科AA18118031);广西自然科学基金资助项目(2018GXNSFAA050028);“认知无线电与信息处理”教育部重点实验室主任基金资助项目(CRKL190102);广西高校中青年教师科研基础能力提升基金资助项目(2019KY0822)

Priority differentiated multicast flow scheduling method in Ceph cloud storage network

Wenlong KE¹,Yong WANG²,Miao YE^1,³(),Junqi CHEN²

¹ School of Information and Communication,Guilin University of Electronic Technology,Guilin 541004,China
² School of Computer Science and Information Security,Guilin University of Electronic Technology,Guilin 541004,China
³ Key Lab.of Cognitive Radio and Information Processing,Guilin University of Electronic Technology,Guilin 541004,China

Revised:2020-10-09 Online:2020-11-25 Published:2020-12-19
Supported by:
The National Natural Science Foundation of China(61861013);The National Natural Science Foundation of China(61662018);Guangxi Innovation-Driven Development Project(桂科AA18118031);Guangxi Natural Science Foundation of China(2018GXNSFAA050028);Director Fund Project of Key Laboratory of Cognitive Radio and Information Processing of Ministry of Education(CRKL190102);Guangxi Colleges and Universities Basic Ability Improvement Project of Young and Middle-Aged Teachers(2019KY0822)

摘要/Abstract

摘要：

摘要:针对现有流调度方法难以满足 Ceph 云存储网络中多业务流的不同多播调度需求问题，设计了一种支持业务优先级区分的多播流调度方法。首先，采用软件定义网络技术实时获取网络状态信息，为流调度方法提供数据支撑；然后，将待处理的多播流调度任务分解为多个单播路径选择的多属性决策问题，提出基于理想解法的单播路径选择方法，根据业务流对网络性能的需求为其找到一个最优单播路径集；最后，通过各路径集间的最大公共子路径确定多播分发节点以构建多播传输路径。实验结果表明，与现有方法相比，所提方法可以在降低冗余流量、提高网络负载均衡性能的同时，降低高优先级流的传输时延。

关键词: Ceph, 云存储网络, 多播流调度, 软件定义网络

Abstract:

In order to solve the problem that existing flow scheduling method is difficult to meet the different multicast scheduling requirements of multi-service flows in the Ceph cloud storage network,a service priority-based multicast flow scheduling method was tailored.First,the network status was obtained via software defined network (SDN) to support flow scheduling.Then,a multicast task was decomposed into multiple attribute decision problems for multiple unicast path selection,and a method of unicast path selection based on technique for order preference by similarity to ideal solution (TOPSIS) was proposed.The unicast path selection method was used to find the optimal unicast path set for the service flow based on the flow’s network performance requirements.Then,the multicast distribution node was determined by the maximum common sub-path among the optimal unicast path sets for construct a multicast transmission path.The experiment results show that the proposed method can reduce the transmission delay of high priority flows while reduce the redundant traffic and better balance the traffic loads compared with the existing methods.

Key words: Ceph, cloud storage network, multicasting flow scheduling, SDN

中图分类号:

TP393

柯文龙,王勇,叶苗,陈俊奇. Ceph云存储网络中一种业务优先级区分的多播流调度方法[J]. 通信学报, 2020, 41(11): 40-51.

Wenlong KE,Yong WANG,Miao YE,Junqi CHEN. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on Communications, 2020, 41(11): 40-51.

图/表 9

图1

表1

图2

图3

表2

图4

图5

图6

图7

参考文献 31

[32]	HONG S S , WONG F , WU S F . TCPtransform:property-oriented TCP traffic transformation[J]. Lecture Notes in Computer Science, 2005,3548: 222-240.
[33]	KE W L , WANG Y , YE M . GRSA:service-aware flow scheduling for cloud storage datacenter networks[J]. China Communications, 2020,17(6): 164-179.
[1]	NIELSEN L , VESTERGAARD R , YAZDANI N ,et al. Alexandria:a proof-of-concept implementation and evaluation of generalised data deduplication[C]// 2019 IEEE Global Communications Conference (GLOBECOM). Piscataway:IEEE Press, 2019: 1-6.
[2]	ZHANG Y , WEI Q S , CHEN C ,et al. Dynamic scheduling with service curve for QoS guarantee of large-scale cloud storage[J]. IEEE Transactions on Computers, 2018,67(4): 457-468.
[3]	YANG C T , LIU J C , KRISTIANI E ,et al. NetFlow monitoring and cyberattack detection using deep learning with Ceph[J]. IEEE Access, 2020,8: 7842-7850.
[4]	CHOWDHURY M , ZHONG Y , STOICA I . Efficient coflow scheduling with varys[J]. ACM SIGCOMM Computer Communication Review, 2014,44(4): 443-454.
[5]	FAN F J , HU B , YEUNG K L ,et al. Mini forest:distributed and dynamic multicasting in datacenter networks[J]. IEEE Transactions on Network and Service Management, 2019,16(3): 1268-1281.
[6]	HUANG K , SU X . Scalable datacenter multicast using in-packet bitmaps[J]. Distributed and Parallel Databases, 2018,36(3): 445-460.
[7]	WANG Y C , YOU S Y . An efficient route management framework for load balance and overhead reduction in SDN-based data center networks[J]. IEEE Transactions on Network and Service Management, 2018,15(4): 1422-1434.
[8]	CUI W Z , QIAN C . Scalable and load-balanced data center multicast[C]// 2015 IEEE Global Telecommunications Conference (GLOBECOM). Piscataway:IEEE Press, 2015: 1-6.
[9]	ZHANG Y X , CUI L , ZHANG Y . A stable matching based elephant flow scheduling algorithm in data center networks[J]. Computer Networks, 2017,120: 186-197.
[10]	SEHERY W , CLANCY C . Flow optimization in data centers with clos networks in support of cloud applications[J]. IEEE Transactions on Network and Service Management, 2017,14(4): 847-859.
[11]	胡智尧, 李东升, 李紫阳 . 数据中心网络流调度技术前沿进展[J]. 计算机研究与发展, 2018,55(9): 1920-1930.
	HU Z Y , LI D S , LI Z Y . Recent advances in datacenter flow scheduling[J]. Journal of Computer Research and Development, 2018,55(9): 1920-1930.
[12]	CHIESA M , KINDLER G , SCHAPIRA M . Traffic engineering with equal-cost-multipath:an algorithmic perspective[J]. IEEE-ACM Transactions on Networking, 2017,25(2): 779-792.
[13]	AL-FARES M , RADHAKRISHNAN S , RAGHAVAN B ,et al. Hedera:dynamic flow scheduling for data center networks[C]// 2010 USENIX Conference on Networked System Design and Implementation (NSDI). Berkeley:USENIX Press, 2010:19.
[14]	HONG C Y , CAESAR M , GODFREY P B . Finishing flows quickly with preemptive scheduling[J]. ACM SIGCOMM Computer Communication Review, 2012,42(4): 127-138.
[15]	ALIZADEH M , YANG S , SHARIF M ,et al. pFabric:minimal near-optimal datacenter transport[J]. ACM SIGCOMM Computer Communication Review, 2013,43(4): 435-446.
[16]	郑成渝, 焦博, 王军 ,等. 基于可计算网络的SDN视频总线系统架构研究[J]. 通信学报, 2018,39(Z1): 271-277.
	ZHENG C Y , JIAO B , WANG J ,et al. Research on SDN video bus system architecture based on computable network[J]. Journal on Communications, 2018,39(Z1): 271-277.
[17]	ISLAM S , MUSLIM N , ATWOOD J W . A survey on multicasting in software-defined networking[J]. IEEE Communications Surveys and Tutorials, 2018,20(1): 355-387.
[18]	ALSAEED Z , AHMAD I , HUSSAIN I . Multicasting in software defined networks:a comprehensive survey[J]. Journal of Network and Computer Applications, 2018,104: 61-77.
[19]	LEE M W , LI Y S , HUANG X ,et al. Robust multipath multicast routing algorithms for videos in software-defined networks[C]// 2014 IEEE International Symposium of Quality of Service (IWQoS). Piscataway:IEEE Press, 2014: 218-227.
[20]	GUO Z Y , DUAN J , YANG Y Y . On-line multicast scheduling with bounded congestion in fat-tree data center networks[J]. IEEE Journal on Selected Areas in Communications, 2014,32(1): 102-115.
[21]	LI G Z , GUO S T , YANG Y Y . Multicast scheduling algorithm in software defined fat-tree data center networks[C]// 2017 IEEE International Symposium of Quality of Service (IWQoS). Piscataway:IEEE Press, 2017: 127-135.
[22]	LI G Z , GUO S T , LIU G Y ,et al. Multicast scheduling with Markov chains in fat-tree data center networks[C]// 2017 International Conference on Networking,Architecture,and Storage (NAS). Piscataway:IEEE Press, 2017: 188-194.
[23]	GEORGOPOULOS P , ELKHATIB Y , BROADBENT M ,et al. Towards network-wide QoE fairness using openflow-assisted adaptive video streaming[C]// 2013 ACM SIGCOMM Workshop on Future Human-Centric Multimedia Networking (FhMN). New York:ACM Press, 2013: 15-20.
[24]	AMIRI M , ALOSMAN H , SHIRMOHAMMADI S ,et al. Towarddelay-efficient game-aware data centers for cloud gaming[J]. ACM Transactions on Multimedia Computing Communications and Applications, 2016,12(5s): 1-19.
[25]	ZHU T W , FENG D , WANG F ,et al. A congestion-aware and robust multicast protocol in SDN-based data center networks[J]. Journal of Network and Computer Applications, 2017,95: 105-117.
[26]	ABDELMONIEM A M , BENSAOU B , ABU A J . Mitigating incast-TCP congestion in data centers with SDN[J]. Annals of Telecommunications, 2017,73(3-4): 263-277.
[27]	王勇, 叶苗, 何倩 ,等. 基于软件定义网络和多属性决策的Ceph存储系统节点选择方法[J]. 计算机学报, 2019,42(2): 93-108.
	WANG Y , YE M , HE Q ,et al. A new node selecting approach in Ceph storage system based on software defined network and multi-attributes decision-making model[J]. Chinese Journal of Computers, 2019,42(2): 93-108.
[28]	BARBEHENN M . A note on the complexity of Dijkstra's algorithm for graphs with weighted vertices[J]. IEEE Transactions on Computers, 1998,47(2): 263-263.
[29]	LUO Y Q , XIA J B , CHEN T P . Comparison of objective weight determination methods in network performance evaluation[J]. Journal of Computer Application, 2009,29(10): 2624-2626.
[30]	LANTZ B , O’CONNOR B . A mininet-based virtual testbed for distributed SDN development[J]. ACM SIGCOMM Computer Communication Review, 2015,45(4): 365-366.
[31]	ISLAM M T , ISLAM N , ALREFAT M . Node to node performance evaluation through RYU SDN controller[J]. Wireless Personal Communications, 2020,112(1): 555-570

符号	含义	符号	含义
V	网络顶点集	E	网络边集
?	多播流的序号	M	多播流的数量
e	连接相邻顶点的链路	Q	链路的数量
p	一源一端的单播路径	d_{? p}	?经p的传输时延
k	一源多端的多播路径	L	多播路径的数量
b_?	?所需的带宽	b_e	链路e的带宽容量
w_?	?对时延的敏感系数	d_{? b}	?的最大时延阈值
x_{? e}	二进制决策参数	x_{? k}	二进制决策参数

数据流类型	优先级	数据分组个数/个	平均数据分组大小/B	流速率/(Mbit.s^-1)	流持续时间/s
心跳数据流	1	54	1 477.42	92.87	0.006 554
用户业务数据流	2	67 073	1 508.65	12.93	39.31
系统迁移数据流	3	340 354	1 505.56	4.36	654.12

Ceph云存储网络中一种业务优先级区分的多播流调度方法

Priority differentiated multicast flow scheduling method in Ceph cloud storage network

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 31

相关文章 15

Metrics

推荐阅读 0

[1]	王东滨, 吴东哲, 智慧, 郭昆, 张勖, 时金桥, 张宇, 陆月明. 软件定义网络抗拒绝服务攻击的流表溢出防护[J]. 通信学报, 2023, 44(2): 1-11.
[2]	沙宗轩, 霍如, 孙闯, 汪硕, 黄韬. 基于深度强化学习的转发效能感知流量调度算法[J]. 通信学报, 2022, 43(8): 30-40.
[3]	燕昺昊, 刘勤让, 沈剑良, 汤先拓, 梁栋. 软件定义网络中一种快速无循环路径迁移策略[J]. 通信学报, 2022, 43(5): 24-35.
[4]	吴平, 常朝稳, 左志斌, 马莹莹. 基于地址重载的SDN分组转发验证[J]. 通信学报, 2022, 43(3): 88-100.
[5]	李传煌, 陈泱婷, 唐晶晶, 楼佳丽, 谢仁华, 方春涛, 王伟明, 陈超. QL-STCT：一种SDN链路故障智能路由收敛方法[J]. 通信学报, 2022, 43(2): 131-142.
[6]	吴平, 常朝稳, 马莹莹. 基于端址重载的SDN包转发验证[J]. 通信学报, 2021, 42(7): 70-83.
[7]	常朝稳, 金建树, 韩培胜, 祝现威. 基于属性签名标识的SDN数据包转发验证方案[J]. 通信学报, 2021, 42(6): 131-144.
[8]	周启钊, 于俊清, 李冬. SDN控制层泛洪防御机制研究：检测与缓解[J]. 通信学报, 2021, 42(11): 41-53.
[9]	李硕朋, 方娟, 陈肯. 基于SRv6的确定性网络服务共享保护方案[J]. 通信学报, 2021, 42(10): 32-42.
[10]	姚蓝,兰巨龙. 基于联盟博弈的自适应SDN交换机迁移机制[J]. 通信学报, 2020, 41(8): 1-10.
[11]	王耀民,王霞,董易,张松海,施心陵. 基于斐波那契树优化算法的数据中心流量调度策略[J]. 通信学报, 2020, 41(6): 112-127.
[12]	韩珍珍,赵国锋,徐川,周文涛,周洋洋. 基于时延的LEO卫星网络SDN控制器动态放置方法[J]. 通信学报, 2020, 41(3): 126-135.
[13]	赖英旭,蒲叶玮,刘静. 基于最小代价路径的交换机迁移方法研究[J]. 通信学报, 2020, 41(2): 131-142.
[14]	张海波,王子心,贺晓帆. SDN和MEC架构下V2X卸载与资源分配[J]. 通信学报, 2020, 41(1): 114-124.
[15]	董芳,胡宇翔,李鸥. 基于SDN的自组织网络路由框架及构建方法[J]. 通信学报, 2019, 40(9): 33-44.