基于sketch的软件定义测量数据平面硬件模型

doi:10.11959/j.issn.1000-436x.2017203

Abstract

Abstract:

A sketch-based data plane hardware model for software-defined measurement was introduced,and it was implemented in the programmable network device NetMagic.A generic sketch model for collecting flow-level data using high-speed memories on the FPGA was proposed,the control plane collected and cached the data for further process.Count-min sketch and 2-universal hash functions in the SRAM of FPGA for real-time traffic counting of high-speed traffic were implemented; Bloom filter was used to rebuild the original 5-tuple data which solved the irreversibility of sketch.The CERNET backbone trace to evaluate the prototype system was used,the result shows that it has the ability to use the limited hardware resource to measure a large amount of network traffic data with a proper measurement accuracy at the same time.

Key words: software-defined measurement, FPGA, universal hash

CLC Number:

TP393

Mian DAI,Guang CHENG. Sketch-based data plane hardware model for software-defined measurement[J]. Journal on Communications, 2017, 38(10): 113-121.

Figures/Tables 12

References 16

[1]	HOFSTEDE R,?ELEDA P , TRAMMELL B ,et al. Flow monitoring explained:from packet capture to data analysis with NetFlow and IPFIX[J]. IEEE Communications Surveys ＆ Tutorials, 2014,16(4): 2037-2064.
[2]	S OMMER R , FELDMANN A . NetFlow:information loss or win?[C]// The 2nd ACM SIGCOMM Workshop on Internet Measurment. 2002: 173-174.
[3]	MOSHREF M , YU M , GOVINDAN R ,et al. SCREAM:sketch resource allocation for software-defined measurement[C]// The 11th ACM Conference on Emerging Networking Experiments and Technologies. ACM, 2015:14.
[4]	YU M , JOSE L , MIAO R . Software defined traffic measurement with OpenSketch[C]// Presented as Part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 2013: 29-42.
[5]	LIU Z , VORSANGER G , BRAVERMAN V ,et al. Enabling a RISC approach for software-defined monitoring using universal streaming[C]// The 14th ACM Workshop on Hot Topics in Networks. ACM, 2015:21.
[6]	LIU Z , MANOUSIS A , VORSANGER G ,et al. One sketch to rule them all:rethinking network flow monitoring with UnivMon[C]// The 2016 Conference on ACM SIGCOMM 2016 Conference. 2016: 101-114.
[7]	CORMODE G , MUTHUKRISHNAN S . What's new:finding significant differences in network data streams[J]. IEEE/ACM Transactions on Networking (TON), 2005,13(6): 1219-1232.
[8]	LIU Y , CHEN W , GUAN Y . A fast sketch for aggregate queries over high-speed network traffic[C]// INFOCOM. 2012: 2741-2745.
[9]	SCHWELLER R , GUPTA A , PARSONS E ,et al. Reversible sketches for efficient and accurate change detection over network data streams[C]// The 4th ACM SIGCOMM Conference on Internet Measurement. 2004: 207-212.
[10]	SCHWELLER R , LI Z , CHEN Y ,et al. Reversible sketches:enabling monitoring and analysis over high-speed data streams[J]. IEEE/ACM Transactions on Networking (ToN), 2007,15(5): 1059-1072.
[11]	DAI M , CHENG G , WANG Y . Detecting network topology and packet trajectory with SDN-enabled FPGA platform[C]// The 11th International Conference on Future Internet Technologies. 2016: 7-13.
[12]	LI T , SUN Z , JIA C ,et al. Using NetMagic to observe fine-grained per-flow latency measurements[C]// ACM SIGCOMM Computer Communication Review. 2011,41(4): 466-467.
[13]	BOSSHART P , DALY D , GIBB G ,et al. P4:programming protocol-independent packet processors[J]. ACM SIGCOMM Computer Communication Review, 2014,44(3): 87-95.
[14]	CORMODE G , MUTHUKRISHNAN S . An improved data stream summary:the count-min sketch and its applications[J]. Journal of Algorithms, 2005,55(1): 58-75.
[15]	SONG H , DHARMAPURIKAR S , TURNER J ,et al. Fast hash table lookup using extended Bloom filter:an aid to network processing[J]. ACM SIGCOMM Computer Communication Review, 2005,35(4): 181-192.
[16]	CARTER J L , WEGMAN M N . Universal classes of hash functions[C]// The Ninth Annual ACM Symposium on Theory of Computing. 1977: 106-112.

Metrics

Recommended 0

No Suggested Reading articles found!

sketch	散列函数	地址空间
count-min sketch	4	128k×4
Bloom filter	4	128k

数据统计量	Trace(450 s)	Trace(10 s)
分组数量	7 485 823	226 843
源IP数量	68 998	2 204
目的IP数量	72 620	2 445
(SIP＆SPort,DIP＆DPort) 数量	352 727	22 176

Sketch-based data plane hardware model for software-defined measurement

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 16

Related Articles 13

Metrics

Recommended 0

[1]	Bin LI, Qinglei ZHOU, Xiaojie CHEN, Feng FENG. Optimization of reconfigurable SM2 algorithm over prime filed [J]. Journal on Communications, 2022, 43(3): 30-41.
[2]	Bin LI, Xiaojie CHEN, Feng FENG, Qinglei ZHOU. FPGA multi-unit parallel optimization and implementation of post-quantum cryptography CRYSTALS-Kyber [J]. Journal on Communications, 2022, 43(2): 196-207.
[3]	Long-jun LIU,Hong-wei DING,Qian-lin LIU,Zheng-gang LIU. Design of polling access control protocol in WSN based on FPGA [J]. Journal on Communications, 2016, 37(10): 181-187.
[4]	Zhe WANG,Man-gui LIANG,Xiao-meng JI,MateusAbisai Fillipus. Source-controlled OpenFlow data plane [J]. Journal on Communications, 2015, 36(3): 195-201.
[5]	. Deep packet inspection oriented high speed packet parsing architecture [J]. Journal on Communications, 2013, 34(6): 19-164.
[6]	Yong-ji DONG,Yun-fei GUO,Wan-wei HUANG,Hui-qun HUANG. Deep packet inspection oriented high speed packet parsing architecture [J]. Journal on Communications, 2013, 34(6): 156-164.
[7]	Hui LI,Ming-long ZHANG,Fu-xing CHEN,Han-xu HOU,Kai PAN,Wei WANG,Hu-sheng YUAN,Tao SUN. Co-decode algorithm of network coding with hardware logic [J]. Journal on Communications, 2012, 33(7): 1-8.
[8]	Rui-jia YUAN,Bao-ming BAI. Efficient storage method for FPGA-based partially parallel QC-LDPC decoder [J]. Journal on Communications, 2012, 33(11): 165-170.
[9]	Hui-qun HUANG,Qin-rang LIU,You-jun BU,Feng-yu ZHANG. Reconfigurable buffer mechanism in switch fabric design [J]. Journal on Communications, 2012, 33(10): 126-131.
[10]	Yan DAI,Yan-chun SHEN. Algorithm design of the statellite attitute control based on FPGA [J]. Journal on Communications, 2009, 30(7): 136-140.
[11]	Jiang-qun NI,Cheng-pei TANG,Dong ZHANG,Guo-cong FENG. Design and hardware implementation of a CAN communication protocol [J]. Journal on Communications, 2008, 29(5): 107-113.
[12]	Jun YANG,Er-yang ZHANG. Structure for 300Mbit/s serial data recovery [J]. Journal on Communications, 2005, 26(8): 78-83.
[13]	Lu-feng QIAO,Zhi-gong WANG,Yuan-lin LU,Bin HUANG. Data structure design and performance analysis of 128 user PCI bridge [J]. Journal on Communications, 2005, 26(1): 74-79.