基于Telemetry架构的数据中心网络纳秒级时间同步

doi:10.11959/j.issn.1000-436x.2021147

Abstract

Abstract:

To solve the problems of the traditional local time synchronization architecture being disconnected from centralized management, requiring extra interaction overhead, meanwhile with less time data susceptible to outliers, the nanosecond level time synchronization system was proposed based on Telemetry for the high-precision time synchronization requirements of data center networks.Combined with the outlier factor detection algorithm, timestamp information within the background traffic of the data center was collected, the large amount of time information reported was processed and analyzed, and a centralized automatic synchronization with nanosecond level precision was eventually achieved, which was convenient for subsequent global network scheduling.The proposed system was implemented and evaluated on the programmable switch.Experimental results show that between multiple hops and at different link rates, the nodes can achieve high-precision time synchronization at the nanosecond level.

Key words: high-precision time synchronization, nanosecond level, datacenter network, Telemetry architecture

CLC Number:

TP393

Qianli ZHANG, Chaofan ZHANG, Jilong WANG, Xiangyu TANG, Zhengchen SHEN, Hui WANG. Nanosecond level time synchronization in datacenter network based on Telemetry architecture[J]. Journal on Communications, 2021, 42(10): 117-129.

Figures/Tables 18

端口额定速率-实际发送速率/(Gbit·s^-1)	用于计算Offset的数据包数量	Offset均值（同步误差）	Offset标准差
10-1	50 000	$38 . 678$	$128 . 622$
10-5	40 800	6.327	$167 . 035$
10-10	17 248	$16 . 037$	$137 . 436$
25-1	50 000	2.315	0.813
25-5	41 072	2.323	0.808
25-10	18 400	2.33	0.793
40-1	50 000	2.288	1.412
40-5	41 202	2.267	4.452
40-10	18 630	2.251	3.951
100-1	50 000	2.343	0.818
100-5	41 498	1.599	1.3
100-10	17 312	2.288	0.798

References 22

[1]	CORBETT J C , HOCHSCHILD P , HSIEH W ,et al. Spanner:Google’s globally distributed database[J]. ACM Transactions on Computer Systems, 2013,31(3): 1-22.
[2]	PERRY J , OUSTERHOUT A , BALAKRISHNAN H ,et al. Fastpass:a centralized “zero-queue” datacenter network[C]// Proceedings of the 2014 ACM Conference on SIGCOMM. New York:ACM Press, 2014: 307-318.
[3]	ZENG H Y , ZHANG S D , YE F ,et al. Libra:divide and conquer to verify forwarding tables in huge networks[C]// 11th USENIX Symposium on Networked Systems Design and Implementation. Berkeley:USENIX Association, 2014: 87-99.
[4]	MILLS D L . Internet time synchronization:the network time protocol[J]. IEEE Transactions on Communications, 1991,39(10): 1482-1493.
[5]	EIDSON J C , FISCHER M , WHITE J . IEEE-1588? standard for a precision clock synchronization protocol for networked measurement and control systems[C]// Proceedings of the 34th Annual Precise Time and Time Interval Systems and Applications Meeting. Piscataway:IEEE Press, 2002: 243-254.
[6]	LEE K S , WANG H , SHRIVASTAV V ,et al. Globally synchronized time via datacenter networks[C]// Proceedings of the 2016 ACM SIGCOMM Conference. New York:ACM Press, 2016: 454-467.
[7]	KANNAN P G , JOSHI R , CHAN M C . Precise time-synchronization in the data-plane using programmable switching ASICs[C]// Proceedings of the 2019 ACM Symposium on SDN Research. New York:ACM Press, 2019: 8-20.
[8]	GENG Y L , LIU S Y , YIN Z ,et al. Exploiting a natural network effect for scalable,fine-grained clock synchronization[C]// Proceedings of the 15th USENIX Conference on Networked Systems Design and Implementation. Berkeley:USENIX Association, 2018: 81-94.
[9]	KIRKPATRICK K . Software-defined networking[J]. Communications of the ACM, 2013,56(9): 16-19.
[10]	TOKUSASHI Y , DANG H T , PEDONE F ,et al. The case for in-network computing on demand[C]// Proceedings of the Fourteenth EuroSys Conference. New York:ACM Press, 2019: 1-16.
[11]	BOSSHART P , DALY D , GIBB G ,et al. P4:programming protocol-independent packet processors[J]. ACM SIGCOMM Computer Communication Review, 2014,44(3): 87-95.
[12]	MURTA C D , JR P R T , MOHAPATRA P . QRPp1-4:characterizing quality of time and topology in a time synchronization network[C]// IEEE Globecom. Piscataway:IEEE Press, 2006: 1-5.
[13]	PáSZTOR A , VEITCH D . PC based precision timing without GPS[C]// Proceedings of the 2002 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. New York:ACM Press, 2002: 1-10.
[14]	LEE K S , WANG H , WEATHERSPOON H . SoNIC:precise realtime software access and control of wired networks[C]// 10th USENIX Symposium on Networked Systems Design and Implementation. Berkeley:USENIX Association, 2013: 213-225.
[15]	DAVIS M , VILLAIN B , RIDOUX J ,et al. An IEEE-1588 compatible RADclock[C]// 2012 IEEE International Symposium on Precision Clock Synchronization for Measurement,Control and Communication Proceedings. Piscataway:IEEE Press, 2012: 1-6.
[16]	FREEDMAN D A , MARIAN T , LEE J H ,et al. Exact temporal characterization of 10 Gbps optical wide-area network[C]// Proceedings of the 10th Annual Conference on Internet Measurement. New York:ACM Press, 2010: 342-355.
[17]	LI H . IEEE 1588 time synchronization deployment for mobile backhaul in China Mobile[R]. 2014.
[18]	ZARICK R , HAGEN M , BARTO? R , . Transparent Clocks vs.Enterprise Ethernet switches[C]// 2011 IEEE International Symposium on Precision Clock Synchronization for Measurement,Control and Communication. Piscataway:IEEE Press, 2011: 62-68.
[19]	WATT S T , ACHANTA S , ABUBAKARI H ,et al. Understanding and applying precision time protocol[C]// 2015 Saudi Arabia Smart Grid (SASG). Piscataway:IEEE Press, 2015: 1-7.
[20]	BREUNIG M M , KRIEGEL H P , NG R T ,et al. LOF:identifying density-based local outliers[C]// Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data. New York:ACM Press, 2000: 93-104.
[21]	MCKEOWN N , ANDERSON T , BALAKRISHNAN H ,et al. OpenFlow[J]. ACM SIGCOMM Computer Communication Review, 2008,38(2): 69-74.
[22]	BOSSHART P , GIBB G , KIM H S ,et al. Forwarding metamorphosis[J]. ACM SIGCOMM Computer Communication Review, 2013,43(4): 99-110.

Metrics

Recommended 0

No Suggested Reading articles found!

交换机资源	原始P4程序stage0	原始P4程序stage1	对照P4程序stage0
8 bit Action Slots	0	0	0
16 bit Action Slots	6.25%	6.25%	6.25%
32 bit Action Slots	3.13%	3.13%	3.13%
Gateway	18.75%	0	6.25%
Hash Bit	4.57%	4.33%	4.57%
SRAM	1.25%	1.25%	1.25%
Stats ALU	0	0	0
TCAM	0	0	0
VLIW Instruction	6.25%	6.25%	3.13%
Exact Match Search Bus	12.50%	6.25%	6.25%

Nanosecond level time synchronization in datacenter network based on Telemetry architecture

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 18

References 22

Related Articles 2

Metrics

Recommended 0

端口速率/（Gbit.s^-1）	Offset均值/ns	Offset标准差/ns
25	2.315	0.813
40	2.288	1.412
100	2.343	0.818

[1]	Wenxue LIU,Shijun CHEN,Jian GE,Hong YUAN,Cuiling GONG. Research on nanosecond time synchronization technology for 5G base station based on GNSS neighborhood similarity [J]. Journal on Communications, 2020, 41(1): 180-190.
[2]	Ninghai BAO,Yuan YUAN,Ziqian LIU,Ming KUANG. Link-lifetime-based service restoration in optical datacenter network [J]. Journal on Communications, 2018, 39(8): 125-132.