Ceph云存储网络中一种业务优先级区分的多播流调度方法

doi:10.11959/j.issn.1000-436x.2020233

Abstract

Abstract:

In order to solve the problem that existing flow scheduling method is difficult to meet the different multicast scheduling requirements of multi-service flows in the Ceph cloud storage network,a service priority-based multicast flow scheduling method was tailored.First,the network status was obtained via software defined network (SDN) to support flow scheduling.Then,a multicast task was decomposed into multiple attribute decision problems for multiple unicast path selection,and a method of unicast path selection based on technique for order preference by similarity to ideal solution (TOPSIS) was proposed.The unicast path selection method was used to find the optimal unicast path set for the service flow based on the flow’s network performance requirements.Then,the multicast distribution node was determined by the maximum common sub-path among the optimal unicast path sets for construct a multicast transmission path.The experiment results show that the proposed method can reduce the transmission delay of high priority flows while reduce the redundant traffic and better balance the traffic loads compared with the existing methods.

Key words: Ceph, cloud storage network, multicasting flow scheduling, SDN

CLC Number:

TP393

Wenlong KE,Yong WANG,Miao YE,Junqi CHEN. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on Communications, 2020, 41(11): 40-51.

Figures/Tables 9

References 31

[32]	HONG S S , WONG F , WU S F . TCPtransform:property-oriented TCP traffic transformation[J]. Lecture Notes in Computer Science, 2005,3548: 222-240.
[33]	KE W L , WANG Y , YE M . GRSA:service-aware flow scheduling for cloud storage datacenter networks[J]. China Communications, 2020,17(6): 164-179.
[1]	NIELSEN L , VESTERGAARD R , YAZDANI N ,et al. Alexandria:a proof-of-concept implementation and evaluation of generalised data deduplication[C]// 2019 IEEE Global Communications Conference (GLOBECOM). Piscataway:IEEE Press, 2019: 1-6.
[2]	ZHANG Y , WEI Q S , CHEN C ,et al. Dynamic scheduling with service curve for QoS guarantee of large-scale cloud storage[J]. IEEE Transactions on Computers, 2018,67(4): 457-468.
[3]	YANG C T , LIU J C , KRISTIANI E ,et al. NetFlow monitoring and cyberattack detection using deep learning with Ceph[J]. IEEE Access, 2020,8: 7842-7850.
[4]	CHOWDHURY M , ZHONG Y , STOICA I . Efficient coflow scheduling with varys[J]. ACM SIGCOMM Computer Communication Review, 2014,44(4): 443-454.
[5]	FAN F J , HU B , YEUNG K L ,et al. Mini forest:distributed and dynamic multicasting in datacenter networks[J]. IEEE Transactions on Network and Service Management, 2019,16(3): 1268-1281.
[6]	HUANG K , SU X . Scalable datacenter multicast using in-packet bitmaps[J]. Distributed and Parallel Databases, 2018,36(3): 445-460.
[7]	WANG Y C , YOU S Y . An efficient route management framework for load balance and overhead reduction in SDN-based data center networks[J]. IEEE Transactions on Network and Service Management, 2018,15(4): 1422-1434.
[8]	CUI W Z , QIAN C . Scalable and load-balanced data center multicast[C]// 2015 IEEE Global Telecommunications Conference (GLOBECOM). Piscataway:IEEE Press, 2015: 1-6.
[9]	ZHANG Y X , CUI L , ZHANG Y . A stable matching based elephant flow scheduling algorithm in data center networks[J]. Computer Networks, 2017,120: 186-197.
[10]	SEHERY W , CLANCY C . Flow optimization in data centers with clos networks in support of cloud applications[J]. IEEE Transactions on Network and Service Management, 2017,14(4): 847-859.
[11]	胡智尧, 李东升, 李紫阳 . 数据中心网络流调度技术前沿进展[J]. 计算机研究与发展, 2018,55(9): 1920-1930.
	HU Z Y , LI D S , LI Z Y . Recent advances in datacenter flow scheduling[J]. Journal of Computer Research and Development, 2018,55(9): 1920-1930.
[12]	CHIESA M , KINDLER G , SCHAPIRA M . Traffic engineering with equal-cost-multipath:an algorithmic perspective[J]. IEEE-ACM Transactions on Networking, 2017,25(2): 779-792.
[13]	AL-FARES M , RADHAKRISHNAN S , RAGHAVAN B ,et al. Hedera:dynamic flow scheduling for data center networks[C]// 2010 USENIX Conference on Networked System Design and Implementation (NSDI). Berkeley:USENIX Press, 2010:19.
[14]	HONG C Y , CAESAR M , GODFREY P B . Finishing flows quickly with preemptive scheduling[J]. ACM SIGCOMM Computer Communication Review, 2012,42(4): 127-138.
[15]	ALIZADEH M , YANG S , SHARIF M ,et al. pFabric:minimal near-optimal datacenter transport[J]. ACM SIGCOMM Computer Communication Review, 2013,43(4): 435-446.
[16]	郑成渝, 焦博, 王军 ,等. 基于可计算网络的SDN视频总线系统架构研究[J]. 通信学报, 2018,39(Z1): 271-277.
	ZHENG C Y , JIAO B , WANG J ,et al. Research on SDN video bus system architecture based on computable network[J]. Journal on Communications, 2018,39(Z1): 271-277.
[17]	ISLAM S , MUSLIM N , ATWOOD J W . A survey on multicasting in software-defined networking[J]. IEEE Communications Surveys and Tutorials, 2018,20(1): 355-387.
[18]	ALSAEED Z , AHMAD I , HUSSAIN I . Multicasting in software defined networks:a comprehensive survey[J]. Journal of Network and Computer Applications, 2018,104: 61-77.
[19]	LEE M W , LI Y S , HUANG X ,et al. Robust multipath multicast routing algorithms for videos in software-defined networks[C]// 2014 IEEE International Symposium of Quality of Service (IWQoS). Piscataway:IEEE Press, 2014: 218-227.
[20]	GUO Z Y , DUAN J , YANG Y Y . On-line multicast scheduling with bounded congestion in fat-tree data center networks[J]. IEEE Journal on Selected Areas in Communications, 2014,32(1): 102-115.
[21]	LI G Z , GUO S T , YANG Y Y . Multicast scheduling algorithm in software defined fat-tree data center networks[C]// 2017 IEEE International Symposium of Quality of Service (IWQoS). Piscataway:IEEE Press, 2017: 127-135.
[22]	LI G Z , GUO S T , LIU G Y ,et al. Multicast scheduling with Markov chains in fat-tree data center networks[C]// 2017 International Conference on Networking,Architecture,and Storage (NAS). Piscataway:IEEE Press, 2017: 188-194.
[23]	GEORGOPOULOS P , ELKHATIB Y , BROADBENT M ,et al. Towards network-wide QoE fairness using openflow-assisted adaptive video streaming[C]// 2013 ACM SIGCOMM Workshop on Future Human-Centric Multimedia Networking (FhMN). New York:ACM Press, 2013: 15-20.
[24]	AMIRI M , ALOSMAN H , SHIRMOHAMMADI S ,et al. Towarddelay-efficient game-aware data centers for cloud gaming[J]. ACM Transactions on Multimedia Computing Communications and Applications, 2016,12(5s): 1-19.
[25]	ZHU T W , FENG D , WANG F ,et al. A congestion-aware and robust multicast protocol in SDN-based data center networks[J]. Journal of Network and Computer Applications, 2017,95: 105-117.
[26]	ABDELMONIEM A M , BENSAOU B , ABU A J . Mitigating incast-TCP congestion in data centers with SDN[J]. Annals of Telecommunications, 2017,73(3-4): 263-277.
[27]	王勇, 叶苗, 何倩 ,等. 基于软件定义网络和多属性决策的Ceph存储系统节点选择方法[J]. 计算机学报, 2019,42(2): 93-108.
	WANG Y , YE M , HE Q ,et al. A new node selecting approach in Ceph storage system based on software defined network and multi-attributes decision-making model[J]. Chinese Journal of Computers, 2019,42(2): 93-108.
[28]	BARBEHENN M . A note on the complexity of Dijkstra's algorithm for graphs with weighted vertices[J]. IEEE Transactions on Computers, 1998,47(2): 263-263.
[29]	LUO Y Q , XIA J B , CHEN T P . Comparison of objective weight determination methods in network performance evaluation[J]. Journal of Computer Application, 2009,29(10): 2624-2626.
[30]	LANTZ B , O’CONNOR B . A mininet-based virtual testbed for distributed SDN development[J]. ACM SIGCOMM Computer Communication Review, 2015,45(4): 365-366.
[31]	ISLAM M T , ISLAM N , ALREFAT M . Node to node performance evaluation through RYU SDN controller[J]. Wireless Personal Communications, 2020,112(1): 555-570

Metrics

Recommended 0

No Suggested Reading articles found!

符号	含义	符号	含义
V	网络顶点集	E	网络边集
?	多播流的序号	M	多播流的数量
e	连接相邻顶点的链路	Q	链路的数量
p	一源一端的单播路径	d_{? p}	?经p的传输时延
k	一源多端的多播路径	L	多播路径的数量
b_?	?所需的带宽	b_e	链路e的带宽容量
w_?	?对时延的敏感系数	d_{? b}	?的最大时延阈值
x_{? e}	二进制决策参数	x_{? k}	二进制决策参数

数据流类型	优先级	数据分组个数/个	平均数据分组大小/B	流速率/(Mbit.s^-1)	流持续时间/s
心跳数据流	1	54	1 477.42	92.87	0.006 554
用户业务数据流	2	67 073	1 508.65	12.93	39.31
系统迁移数据流	3	340 354	1 505.56	4.36	654.12

Priority differentiated multicast flow scheduling method in Ceph cloud storage network

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 31

Related Articles 15

Metrics

Recommended 0

[1]	Zhiyong LUO, Yu ZHANG, Qing WANG, Weiwei SONG. Study of SDN intrusion intent identification algorithm based on Bayesian attack graph [J]. Journal on Communications, 2023, 44(4): 216-225.
[2]	Jianzhong SU, Huayu ZHANG, Hailong ZHU. Computing method for periodic stream reservation in TSN combined with SDN controller [J]. Journal on Communications, 2021, 42(10): 23-31.
[3]	Yaomin WANG,Xia WANG,Yi DONG,Songhai ZHANG,Xinling SHI. Data center traffic scheduling strategy based on Fibonacci tree optimization algorithm [J]. Journal on Communications, 2020, 41(6): 112-127.
[4]	Zhenzhen HAN,Guofeng ZHAO,Chuan XU,Wentao ZHOU,Yangyang ZHOU. Dynamic SDN controller placement based on latency in LEO satellite network [J]. Journal on Communications, 2020, 41(3): 126-135.
[5]	Hongyan QIAN,Hao XUE,Ming CHEN. UDM:NFV-based prevention mechanism against DDoS attack on SDN controller [J]. Journal on Communications, 2019, 40(3): 116-124.
[6]	Hui ZHAO, Liangmin WANG. Hybrid anonymous channel for recipient untraceability via SDN-based node obfuscation scheme [J]. Journal on Communications, 2019, 40(10): 55-66.
[7]	Tong DUAN,Julong LAN,Yuxiang HU,Hongwei FAN. Orchestration mechanism for VNF hardware acceleration resources in SDN/NFV architecture [J]. Journal on Communications, 2018, 39(6): 98-108.
[8]	Songjie WEI,Xin SUN,Rudong ZHAO,Chao WU. Tracing IP-spoofed packets in software defined network [J]. Journal on Communications, 2018, 39(11): 181-189.
[9]	Zhi-yuan ZHAO,Xiang-ru MENG,Yu-ze SU,Zhen-tao LI. Virtual SDN embedding with differentiated QoS under multiple controller [J]. Journal on Communications, 2017, 38(8): 101-110.
[10]	Zhi SUN,Ming CHEN. PriQoS:priority-differentiated flow control mechanism based on SDN [J]. Journal on Communications, 2017, 38(2): 115-124.
[11]	Tao WANG,Hong-chang CHEN,Guo-zhen CHENG. Research on software-defined network and the security defense technology [J]. Journal on Communications, 2017, 38(11): 133-160.
[12]	Jian WANG,Guo-sheng ZHAO,Zhi-xin LI. Research on mapping algorithm of virtual network oriented to SDN [J]. Journal on Communications, 2017, 38(10): 26-35.
[13]	Zhi-geng HAN,Xia FENG,Geng CHEN. SDN based e-mail repudiation source restraining method [J]. Journal on Communications, 2016, 37(9): 55-67.
[14]	Jun-fei LI,Ju-long LAN,Yu-xiang HU,Jiang-xing WU. Quantitative approach of multi-controller’s consensus in SDN [J]. Journal on Communications, 2016, 37(6): 86-93.
[15]	Zhe WANG,Man-gui LIANG,Xiao-meng JI,MateusAbisai Fillipus. Source-controlled OpenFlow data plane [J]. Journal on Communications, 2015, 36(3): 195-201.