一种大象流两级识别方法

doi:10.11959/j.issn.1000-0801.2017076

Abstract

Abstract:

The high accuracy and low overhead of elephant flows identification have a great meaning on solving the controller's single point of failure problem in SDN traffic management.Aiming at the problem of high overhead of the existing elephant flows identification method,a two-level method for elephant flows identification was proposed which included a suspicious elephant detection algorithm based on TCP write-queue in the first stage and areal elephant detection algorithm based on flow duration in the second stage.During the first stage,the suspicious elephant flows were identified in the end systems to reduce the amount of flows monitored by the SDN controller at the second stage.Analysis and simulation prove that, under the premise of ensuring the accuracy of elephant flow identification, the two-level method for elephant flows identification reduces about 85% overhead of identification compared with sampling identification method.

Key words: elephant flow identification, TCP sending queue, SDN

CLC Number:

TP393

Junrong YAN,Jingchang YE,Peng PAN. A two-level method for elephant flow identification[J]. Telecommunications Science, 2017, 33(3): 36-43.

Figures/Tables 11

References 22

[1]	ZUO Q Y , CHEN M , ZHAO G S , et al. OpenFlow-based SDN technologies[J]. Journal of Software (Chinese), 2013(5): 1078-1097.
[2]	MCKEOWN N , ANDERSON T , BALAKRISHNAN H , et al. OpenFlow: enabling innovation in campus networks[J]. ACM SIGCOMM Computer Communication Review, 2008,38(2): 69-74.
[3]	CRISTIAN E , VARGHESE G . New directions in traffic measurement and accounting: focusing on the elephants, ignoring the mice[J]. ACM Transactions on Computer Systems (TOCS), 2003,21(3): 270-313.
[4]	BENSON T , AKELLA A , MALTZ D A . Network traffic characteristics of data centers in the wild[C]// The 10th ACM SIGCOMM Conference on Internet Measurement, November 1-30, 2010, Melbourne, Australia. New York: ACM Press, 2010: 267-280.
[5]	XIA J B , REN G M . Survey on elephant flow identifying methods[J]. Control and Decision, 2013,28(6): 801-807.
[6]	BI C H , LUO X , YE T , et al. On precision and scalability of elephant flow detection in data center with SDN[C]// 2013 IEEE Globecom Workshops(GC Wkshps), December 9-13, 2013, Atlanta,Georgia,USA. New Jersey: IEEE Press, 2013: 1227-1232.
[7]	MORI T , UCHIDA M , GOTO S . Identifying elephant flows through periodically sampled packets[C]// The 4th ACM SIGCOMM Conference on Internet Measurement, Oct 25-27, 2004, Taormina, Sicily, Italy. New York: ACM Press, 2004: 115-120.
[8]	ROBERT B , STROTHE R M . MJRTY-a fast majority vote algorithm[M]. Amsterdam: Springer Netherlands, 1991.
[9]	BAI L , LIU W J . Algorithm based on multiple filters for elephant flows identification[C]// 2011 International Conference on Transportation, Mechanical, and Electrical Engineering (TMEE), December 16-18, 2011, Changchun, China. New Jersey: IEEE Press, 2011: 1084-1087.
[10]	ZHAO X H , LI M H . Large flow identification based on counting bloom filter and space saving[J]. Journal of University of Chinese Academy of Sciences, 2015,32(3): 391-397.
[11]	SMITHA , KIM I , NARASIMHAREDDY A L . Identifying long-term high-bandwidth flows at a router[C]// The 8th International Conference on High Performance Computing, December 17-20, 2001, Hyderabad, India. Heidelberg: Springer, 2001: 361-371.
[12]	LIU X L , LIU Y , WANG C L . An identification algorithm of network elephant flow based on FEFS and CBF[J]. Computer Engineering, 2015,41(9): 68-73.
[13]	BAI L , TIAN L Q , CHEN C . Elephant flow detection algorithm for high speed networks based on flow sampling and LRU[J]. Computer Application and Software, 2016,33(4): 111-115.
[14]	XIE D Q , ZHOU Z H , LUO J W . An algorithm based on LRU and SCBF for elephant flows identification and its application in DDoS defense[J]. Journal of Computer Research and Development, 2011,48(8): 1517-1523.
[15]	TOOTOONCHIAN A , GHOBADI M , GANJALI Y . OpenTM:traffic matrix estimator for OpenFlow networks[C]// 2010 International Conference on Passive and Active Network Measurement, April 7-9, 2010, Zurich, Switzerland. Heidelberg: Springer, 2010: 201-210.
[16]	BENSON T , ANAND A , AKELLA A , et al. MicroTE: fine grained traffic engineering for data centers[C]// The Seventh Conference on Emerging Networking Experiments and Technologies, December 6-9, Tokyo, Japan. New York: ACM Press, 2011: 8.
[17]	LIN C Y , CHIEN C , CHANG J W , et al. Elephant flow detection in datacenters using openflow-based hierarchical statistics pulling[C]// 2014 IEEE Global Communications Conference, December 8-12, 2014, Austin, Texas, USA. New Jersey: IEEE Press, 2014: 2264-2269.
[18]	CURTIS A R , KIM W , YALAGANDULA P . Mahout:low-overhead datacenter traffic management using end-host-based elephant detection[C]// 2011 IEEE INFOCOM, April 10-15, Shanghai, China. New Jersey: IEEE Press, 2011: 1629-1637.
[19]	CHAO S C , LIN K C J , CHEN M S . Flow classification for software-defined data centers using stream mining[J]. IEEE Transactions on Services Computing. doi:10.1109/TSC 2016: 2597846.
[20]	FAN D D , MO L . Analysis of Linux kernel[M]. Beijing: China Machine Press, 2010.
[21]	OpenFlowSwitch Specification. Open networking foundation, version 1.3.0(wire protocol 0x04)[S]. IEEE Transactions on Information Theory, 2012.
[22]	KANDULA S , SENGUPTA S , GREENBERG A , et al. The nature of data center traffic: measurements ＆ analysis[C]// The 9th ACM SIGCOMM Conference on Internet Measurement Conference, November 4-6, 2009, Chicago, Illinois, USA. New York: ACM Press, 2009: 202-208.

Metrics

Recommended 0

No Suggested Reading articles found!

交换机编号	流表号	五元组	状态
*	0	源/目的IP地址；源/目的端口；四层协议	suspicious/real

交换机编号	流表号	五元组	状态
5e3e089e01616580	0	10.0.0.1,1120,10.0.0.2,21,tcp	real
5e3e089e01616580	0	10.0.0.1,1123,10.0.0.2,21,tcp	real
5e3e089e01616580	0	10.0.0.1,1124,10.0.0.2,21,tcp	suspicious

参数	功能	数值
H_sum/台	主机总数	128
H_ps/台	每台交换机连接的主机数	8
S/台	交换机总数	16
Flow/条	每个终端每秒平均产生的新流数量	10
P_s	采样频率	1/50
D_s/byte	每次采样的数据量（采集分组头）	54
T/s	流表项存在时间	60

A two-level method for elephant flow identification

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 11

References 22

Related Articles 15

Metrics

Recommended 0

[1]	Yanxia TAN, Guangquan WANG, Zelin WANG, Yanlei ZHENG, He ZHANG, Chenfang ZHANG, Sai HAN, Shikui SHEN. Research on technical scheme of SDN intelligent management and control orchestration system [J]. Telecommunications Science, 2023, 39(3): 143-152.
[2]	Tai LIU, Chao ZHU, Yi CHENG, Yiming WANG. Research on SDN based tactical communication network architecture [J]. Telecommunications Science, 2022, 38(10): 120-130.
[3]	Daoyun HU, Jin QI, Qianchun LU, Feng LI, Hongqiang FANG. Research and application of traffic engineering algorithm based on deep learning [J]. Telecommunications Science, 2021, 37(2): 107-114.
[4]	Le ZHANG, Yanqin WU, Ke ZHANG, Dongfeng MAO, Song JIANG, Huawei HU. Research and implementation of intelligent endogenous technology for SDN cooperative controller [J]. Telecommunications Science, 2021, 37(12): 101-109.
[5]	Yanshang YIN, Tongpeng SUO, Ligang DONG, Xian JIANG. SDN security prediction method based on bayesian attack graph [J]. Telecommunications Science, 2021, 37(11): 75-85.
[6]	Huiguang CHEN, Huan LI. Orchestration system architecture design and implementation of smart line service [J]. Telecommunications Science, 2021, 37(10): 152-161.
[7]	Xiongyan TANG,Haijun WANG,Hongbo YANG. Key technologies and application of optical transport network for leased line services [J]. Telecommunications Science, 2020, 36(7): 18-25.
[8]	Chang CAO,Shuai ZHANG,Ying LIU,Xiongyan TANG. Convergence of telco cloud and bearer network based computing power network orchestration [J]. Telecommunications Science, 2020, 36(7): 55-62.
[9]	Jinglin LI,Xiaolan WAN. SDN resolve space-ground integrated network based on end side computing [J]. Telecommunications Science, 2020, 36(7): 80-91.
[10]	Ping XIE,Xiaosong LIU. Security of the deployment of SDN-based IoT using blockchain [J]. Telecommunications Science, 2020, 36(12): 139-146.
[11]	Zhilan HUANG,Yongbing FAN,Ning FAN,Nan CHEN,Linze WU,Baohong LIN. Solution and key technology of integrating vFW in cloud platform [J]. Telecommunications Science, 2019, 35(5): 140-148.
[12]	Bowei WANG,Jin TAN,Wenbin JIANG. Data aggregation scheme based on SDN for internet of things [J]. Telecommunications Science, 2019, 35(2): 27-34.
[13]	Wei WANG. IPv6 based SD-WAN deployment [J]. Telecommunications Science, 2019, 35(12): 38-42.
[14]	Ding CHEN,Tao ZHANG,Ke LIU,Qiang LAN. Telecom cloud solution in re-architecture of MAN [J]. Telecommunications Science, 2018, 34(7): 23-34.
[15]	Qiao FU,Xiaodong DUAN,Lu WANG,Yamei FAN. Architecture and key technology of telco edge cloud [J]. Telecommunications Science, 2018, 34(7): 35-40.