高性能网络协议栈兼容性研究

doi:10.11959/j.issn.1000-0801.2019096

Abstract

Abstract:

The massive data processing in artificial intelligence system requires the support of high-throughput network.As a bridge between the upper artificial intelligence applications and the underlying high-speed hardware network adapter,the network stack plays a crucial role in the performance of the whole network system.Through detailed analysis and comparison of the compatibility of mainstream network stacks,it is found that the compatibility of various network stacks is generally low,which leads to difficulties in transplantation of artificial intelligence applications.The idea of achieving both high-compatibility and high-performance of user-level network stack were proposed.In this way,legacy applications could directly attain the improvement of performance without modification of the source code.Path for the subsequent development of network stack was lit up.

Key words: compatibility, network stack, high-performance

CLC Number:

TP393

Huiyou JIANG,Junfeng LI,Dan LI. Research on compatibility of high-performance network stack[J]. Telecommunications Science, 2019, 35(5): 25-31.

Figures/Tables 4

References 26

[1]	ZHANG H , ZHENG Z , XU S ,et al. Poseidon:an efficient communication architecture for distributed deep learning on GPU clusters[C]// Annual Technical Conference,July 12-14,2017,Santa Clara,CA,USA.[S.l.:s.n]. 2017: 181-193.
[2]	KERRISKK M . The so_reuseport Socket option[EB]. 2013.
[3]	BARON J . Epoll:add EPOLLEXLUSIVE flag[EB]. 2015.
[4]	Epoll:add EPOLLEXLUSIVE flag[EB].2017.
[5]	PESTEREV A , STRAUSS J , ZELDOVICH N ,et al. Improving network connection locality on multicore systems[C]// The 7th ACM European Conference on Computer Systems,Apr 10-13,2012,Bem,Switzerland. New York:ACM Press, 2012: 337-350.
[6]	HAN S , MARSHALL S , CHUN B G ,et al. MegaPipe:a new programming interface for scalable network I/O[C]// The 10th USENIX Conference on Operating Systems Design and Implementation,Oct 8-10,2012,Hollywood,CA,USA. New York:ACM Press, 2012: 135-148.
[7]	LIN X , CHEN Y , LI X ,et al. Scalable kernel TCP design and implementation for short-lived connections[J]. ACM SIGPLAN Notices, 2016,51(4): 339-352.
[8]	THEKKATH C A , NGUYEN T D , MOY E ,et al. Implementing network protocols at user level[J]. IEEE/ACM Transactions on Networking, 1993,1(5): 554-565.
[9]	BASU A , . A user-level network interface for parallel and distributed computing[C]// The 15th ACM Symposium on Operating Systems Principles (SOSP),Dec 3-6,1995,Copper Mountain,Colorado,USA. New York:ACM Press, 1995: 40-53.
[10]	EDWARDS A , MUIR S . Experiences implementing a high performance TCP in user-space[J]. ACM SIGCOMM Computer Communication Review, 1995,25(4): 196-205.
[11]	MOGUL J , RASHID R , ACCETTA M . The packer filter:an efficient mechanism for user-level network code[C]// The Eleventh ACM Symposium on Operating Systems Principles,Nov 8-11,1987,Austin,USA. New York:ACM Press, 1987: 39-51.
[12]	Intel. Data plane development kit project page[EB]. 2012.
[13]	RIZZO L , . Netmap:a novel framework for fast packet I/O[C]// 21st USENIX Security Symposium,Aug 8-10,2012,Bellevue,WA,USA. New York:ACM Press, 2012: 101-112.
[14]	NTOP. Multi-10 Gbit RX/TX packet processing from hosts and virtual machines[EB]. 2016.
[15]	JEONG E Y , WOOD S , JANSHED M ,et al. mTCP:a highly scalable user-level TCP stack for multicore systems[C]// USENIX Conference on Netwoked Systems Design ＆Implentation,Apr 2-4,2014,Seattle,WA,USA. New York:ACM Press, 2014: 489-502.
[16]	BELAY A , PREKAS G , KLIMOVIC A ,et al. IX:a protected dataplane operating system for high throughput and low latency[C]// USENIX Conference on Operating Systems Design ＆Implementation,Oct 6-8,2014,Broomfield,CO,USA. New York:ACM Press, 2014: 49-65.
[17]	PREKAS G , KOGIAS M , BUGION E . ZygOS:achieving low tail latency for microsecond-scale networked tasks[C]// The 26th Symposium on Operating Systems Principles,Oct 28-31,2017,Shanghai,China. New York:ACM Press, 2017: 325-341.
[18]	PETER S , LI J , ZHANG I ,et al. Arrakis:the operating system is the control plane[J]. ACM Transactions on Computer Systems (TOCS), 2016,33(4):11.
[19]	HONDA M , HUICI F , RAICIU C ,et al. Rekindling network protocol innovation with user-level stacks[J]. ACM SIGCOMM Computer Communication Review, 2014,44(2): 52-58.
[20]	YASUKATA K , HONDA M , SANTRY D ,et al. StackMap:low-latency networking with the OSstack and dedicated NICs[C]// 2016 USENIX Annual Technical Conference,Jun 22-24,2016,Denver,CO,USA. New York:ACM Press, 2016: 43-56.
[21]	POPE S , RIDDOCH D . Introduction to OpenOnload—building application transparency and protocol conformance into application acceleration middleware[R]. 2011.
[22]	PKELSEY. A library version of FreeBSD’s TCP/IP stack plus extras[EB]. 2016.
[23]	TECENTE. F-stack[EB]. 2018.
[24]	SCYLLADB. High performance server-side application framework[EB]. 2014.
[25]	YULINTAO. Nginx with mTCP and DPDK[EB]. 2016.
[26]	SHALEV L , SATRAN J , BOROCIK E ,et al. IsoStack-highly efficient network processing on dedicated cores[C]// USENIX Annual Technical Conference,June 23-25,2010,Boston,MA,USA. New York:ACM Press, 2010:5.

Metrics

Recommended 0

No Suggested Reading articles found!

协议栈名称	是否支持POSIX API	是否需要修改应用源代码	高并发网络编程模型	具体已支持的API
Affinity- Accept^[5]	是	不需要	Epoll	Linux 2.6.35版本网络相关POSIX API
MegaPipe^[6]	否	需要	事件注册分发	基于事件注册的接口 mp_create、mp_register、mp_unregister、mp_accept、mp_dispatch、mp_read、mp_write等
FastSocket^[7]	是	不需要	Epoll	Linux 2.6.32版本网络相关POSIX API
mTCP^[15]	POSIX-Like	需要	Epoll	mtcp_Socket、mtcp_bind、mtcp_listen、mtcp_accept、mtcp_connect、mtcp_read、mtcp_write 等通用网络 API 以及 mtcp_epoll_wait、mtcp_epoll_ctl等epoll相关接口
IX^[16]	否	需要	重定义网络事件、弹性线程	批处理优化但语义改变的接口connect、accept、sendv、recv_done、close以及数据平面事件响应接口knock、connected、recv、sent、dead
F-stack^[23]	POSIX-Like	需要	Epoll、Kqueue	ff_Socket、ff_bind、ff_listen、ff_accept、ff_connect、ff_shutdown、ff_send、ff_writev、ff_sendto、ff_sendmsg、ff_dup等更丰富且同时支持 TCP 与 UDP 的通用网络 API 以及 ff_select、ff_poll、ff_kqueue、ff_epoll_wait等多种I/O多路复用机制接口
Seastar^[24]	否	无兼容性	异步I/O	事件驱动、非阻塞基于 future 的纯异步编程框架， seastar::make_ready_future、seastar::future、seastar::sleep().then()等

Research on compatibility of high-performance network stack

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 4

References 26

Related Articles 11

Metrics

Recommended 0

[1]	Xinxin TANG, Xuewen ZENG, Zhiyuan LING, Lei SONG. Overview of programmable data plane technology [J]. Telecommunications Science, 2023, 39(4): 1-16.
[2]	Shanzhi CHEN. Analysis of LEO satellite communication and suggestions for its development strategy in China [J]. Telecommunications Science, 2020, 36(6): 1-13.
[3]	Enming SHI,Xiaojun XIAO,Yu LU. Research and design of distributed high-performance network reptiles based on cloud platform [J]. Telecommunications Science, 2017, 33(8): 180-186.
[4]	Zhaojun QIAN,Tan WANG,Long KANG,Bo LI. Compatibility study between IMT and inter-satellite service systems in 25.25～27.5 GHz frequency band [J]. Telecommunications Science, 2016, 32(12): 86-92.
[5]	Zhilan HUANG,Yongbing FAN,Nan CHEN,Xiaowu HE. Key technologies of heterogeneous compatibility in overlay SDN [J]. Telecommunications Science, 2016, 32(11): 112-118.
[6]	Yiwei Gao,Yu Sun. Research on NFC End-to-End Compatibility Test [J]. Telecommunications Science, 2015, 31(3): 36-41.
[7]	Gao Yiwei and Sun Yu. Research on NFC End-to-End Compatibility Test [J]. Telecommunications Science, 2015, 31(3): 2015079-.
[8]	Jianxin Li,Wenhan Yang. Research on Protection Distances for Interference Between Earth Stations——Protection Distances for Interference from Fixed-SateIIite Earth Stations to Space Research Earth Stations [J]. Telecommunications Science, 2014, 30(6): 86-89.
[9]	Wang Cuie,Gu Yonggen,Wu Xiaohong and Tao Jie. Mechanism Design for Optimizing Response Time of SLA in Cloud Computing [J]. Telecommunications Science, 2012, 28(1): 42-46.
[10]	Cuie Wang,Yonggen Gu,Xiaohong Wu,Jie Tao. Mechanism Design for Optimizing Response Time of SLA in Cloud Computing [J]. Telecommunications Science, 2012, 28(1): 46-50.
[11]	Liang Zhao,Shuangping Liu,Liang Jin,Jinyu Chen. Research on the Power Spectral Density Limit in UWB Systems [J]. Telecommunications Science, 2011, 27(2): 34-39.