面向确定性网络的按需智能路由技术

doi:10.11959/j.issn.1000-0801.2021245

Abstract

Abstract:

Deterministic network needs to ensure the deterministic transmission requirements of different applications in terms of delay, packet loss rate, jitter, throughput, and reliability.In response to the differentiated and deterministic network transmission requirements of applications, an on-demand intelligent routing framework OdR for deterministic network was proposed.Under the OdR framework, an on-demand intelligent routing algorithm named OdR-TD3 based on deep reinforcement learning was proposed, which generates routing strategies based on the deterministic QoS requirements of application traffic, to satisfy the applications’ requirements of deterministic network.The experimental evaluation results show the OdR-TD3 algorithm has a significant advantage over the DV algorithm and the SPF algorithm in terms of the achievement rate of deterministic QoS requirements.

Key words: deterministic network, deep reinforcement learning, on-demand intelligent routing, quality of service

CLC Number:

TP393

Zhongli WU, Yuanyuan CAO, Wenrui HUANG, Bin DAI, Yijun MO. On-demand intelligent routing technology for deterministic network[J]. Telecommunications Science, 2021, 37(11): 11-16.

Figures/Tables 4

References 12

[1]	KARAKUS M , DURRESI A . Quality of service (QoS) in software defined networking (SDN):a survey[J]. Journal of Network and Computer Applications, 2017(80): 200-218.
[2]	黄韬, 汪硕, 黄玉栋 ,等. 确定性网络研究综述[J]. 通信学报, 2019,40(6): 160-176.
	HUANG T , WANG S , HUANG Y D ,et al. Survey of the deterministic network[J]. Journal on Communications, 2019,40(6): 160-176.
[3]	LI Z M ， PENGC ， YUG ,et al. DetNet:abackbone network for object detection[J]. 2018.arXiv:1804.06215.
[4]	李季明, 张宁 . 具有随机性的确定性网络模型[J]. 复杂系统与复杂性科学, 2007,4(2): 56-61.
	LI J M , ZHANG N . Deterministic network model with randomness[J]. Complex Systems and Complexity Science, 2007,4(2): 56-61.
[5]	LUONG N C , HOANG D T , GONG S M ,et al. Applications of deep reinforcement learning in communications and networking:a survey[J]. IEEE Communications Surveys ＆ Tutorials, 2019,21(4): 3133-3174.
[6]	ROBINSON Y H , JULIE E G , SARAVANAN K ,et al. FD-AOMDV:fault-tolerant disjoint ad-hoc on-demand multipath distance vector routing algorithm in mobile ad-hoc networks[J]. Journal of Ambient Intelligence and Humanized Computing, 2019,10(11): 4455-4472.
[7]	WANG Z , CROWCROFT J . Analysis of shortest-path routing algorithms in a dynamic network environment[J]. ACM SIGCOMM Computer Communication Review, 1992,22(2): 63-71.
[8]	DAI B , CAO Y Y , WU Z L ,et al. Routing optimization meets machine intelligence:a perspective for the future network[J]. Neurocomputing, 2021,459: 44-58.
[9]	XIE J F , YU F R , HUANG T ,et al. A survey of machine learning techniques applied to software defined networking (SDN):research issues and challenges[J]. IEEE Communications Surveys ＆ Tutorials, 2019,21(1): 393-430.
[10]	MCKEOWNN , ANDERSONT , BALAKRISHNANH ,et al. OpenFlow[J]. ACM SIGCOMM Computer Communication Review, 2008,38(2): 69-74.
[11]	SCOTT F , HERKE H , DAVID M . Addressing function approximation error in actor-critic methods[C]// Proceedings of the 35th International Conference on Machine Learning.[S.l.:s.n.], 2018: 1587-1596.
[12]	UHLIG S , QUOITIN B , LEPROPRE J ,et al. Providing public intradomain traffic matrices to the research community[J]. ACM SIGCOMM Computer Communication Review, 2006,36(1): 83-86.

Metrics

Recommended 0

No Suggested Reading articles found!

应用流量	最大时延容忍	最大抖动容忍	最大丢包率容忍
α₁	100 ms	50 ms	0.01
α₂	200 ms	100 ms	0.02
α₃	1s	300 ms	0.05

	DV	SPF	OdR-TD3
奖励值	-2.335	-1.052	-0.538

QoS指标	应用类型	DV	SPF	OdR-TD3
平均时延/s	α₁	1.659	0.798	0.083
	α₂	1.754	0.857	0.157
	α₃	1.915	0.919	0.659
平均抖动/s	α₁	0.121	0.079	0.045
	α₂	0.134	0.085	0.076
	α₃	0.109	0.083	0.079
平均丢包率	α₁	0.057	0.026	0.005
	α₂	0.059	0.022	0.007
	α₃	0.067	0.019	0.006

[1]	Xiwen LIAO, Supeng LENG, Yujun MING, Tianyang LI. Digital twin based intelligent urban traffic forecasting and guidance strategy [J]. Telecommunications Science, 2023, 39(3): 70-79.
[2]	Yu KANG, Yaqiong LIU, Tongyu ZHAO, Guochu SHOU. A survey on AI algorithms applied in communication and computation in Internet of vehicles [J]. Telecommunications Science, 2023, 39(1): 1-19.
[3]	Jincan XIN, Sen XU, Hua ZHANG, Shangkun XIONG, Hua XU. Study on 5G wireless network enhancement technology for time sensitive networks [J]. Telecommunications Science, 2022, 38(5): 18-25.
[4]	Guangmin SONG, Qunqing WANG, Zhanbing HUANG, Xun SHI, Gaojian HAN. Research on the edge-end collaboration framework for deterministic network [J]. Telecommunications Science, 2022, 38(5): 26-37.
[5]	Cheng DING, Jinrong CHEN, Xiaodong CAO, Yi WANG. Quality of service based hierarchical resource allocation algorithm [J]. Telecommunications Science, 2022, 38(1): 102-111.
[6]	Peng LIU, Zongpeng DU, Yongjing LI, Lu LU, Xiaodong DUAN. End-to-end deterministic networking architecture and key technologies [J]. Telecommunications Science, 2021, 37(9): 64-73.
[7]	Yijun MO, Zihan YANG, Huiyu LIU, Tianliu HE. Global cyclic queuing and forwarding mechanism for large-scale deterministic networks [J]. Telecommunications Science, 2021, 37(10): 55-65.
[8]	Ziyu XIAO. A review of key technologies for the future of the 2030 network——Beyond 5G [J]. Telecommunications Science, 2020, 36(9): 114-121.
[9]	Fei GUI,Yang CHENG,Dan LI,Sihong HONG. Internet intelligent routing architecture and algorithm [J]. Telecommunications Science, 2020, 36(10): 12-20.
[10]	Li QIANG, Bingyang LIU, Delei ·U, Chuang WANG. Large-scale deterministic network forwarding technology [J]. Telecommunications Science, 2019, 35(9): 12-19.
[11]	Zhiwen LIAO,Ling ZHANG. A dynamic timeslot-based multicast bandwidth advance reservation algorithm for enterprise video conferencing systems [J]. Telecommunications Science, 2019, 35(7): 78-86.
[12]	Yaofeng TU,Hongzhang YANG,Yinjun HAN,Zhenghua CHEN. Research and optimization on quality of service in distributed block storage system [J]. Telecommunications Science, 2018, 34(4): 118-128.
[13]	Chong GUO,Wenqing YAN,Bin XU. Green energy management in internet of things based on quality of service composition [J]. Telecommunications Science, 2017, 33(10): 34-42.
[14]	Zhengjiang SONG,Xiaochen LI,Jiang CHEN. QoS boundary analysis of congestion control protocol based on stochastic network calculus in CRSN [J]. Telecommunications Science, 2016, 32(4): 44-51.
[15]	Tao Guo,Youming Li,Peng Lei,Biao Ji,Chengcheng Li. A Resource Allocation Scbeme Based on User's QoS in MIMO Relay System [J]. Telecommunications Science, 2015, 31(4): 114-119.

On-demand intelligent routing technology for deterministic network

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 4

References 12

Related Articles 15

Metrics

Recommended 0