基于Q-learning的跨域服务链映射机制

doi:10.11959/j.issn.1000-436x.2018283

Abstract

Abstract:

A virtual service resources controlling architecture with regional centralized management and global coordinated scheduling was proposed for the problem of cross-domain service chain mapping in SDNFV environment. On this basis, an effective mapping framework was built and the cross-domain mapping problem was modeled as an ILP with the purpose of minimizing mapping cost. A partitioning algorithm was designed to solve the problem based on Q-learning mechanism under this framework. Simulation results show that the performances of this method are better than other traditional methods on average partition time, average mapping cost, and acceptance ratioof service chain mapping request.

Key words: software defined network, network function virtualization, service chain, mapping, reinforcement learning

CLC Number:

TP393

Hongqi ZHANG,Rui HUANG,Yingjie YANG,Dexian CHANG,Liancheng ZHANG. Cross-domain service chain mapping mechanism based on Q-learning[J]. Journal on Communications, 2018, 39(12): 102-112.

Figures/Tables 9

References 24

[1]	KREUTZ D , RAMOS F M V , VERíSSIMO P E , et al. Software-defined networking: a comprehensive survey[J]. Proceedings of the IEEE, 2015,103(1):14-76.
[2]	黄韬，刘江，霍如，等. 未来网络体系架构研究综述[J]. 通信学报， 2014,35(8): 184-197.
	HUANG T , LIU J , HUO R , et al. Survey of research on future network architectures[J]. Journal on Communications, 2014,35(8): 184-197.
[3]	MIJUMBI R , SERRAT J , GORRICHO J L , et al. Network function virtualization: state-of-the-art and research challenges[J]. IEEE Communications Surveys & Tutorials, 2017,18(1):236-262.
[4]	SUN C , BI J , ZHENG Z , et al. NFP: enabling network function parallelism in NFV[C]// ACM Conference of the Special Interest Group on Data Communication. 2017:43-56.
[5]	LI Y , CHEN M . Software-defined network function virtualization: a survey[J]. IEEE Access, 2015,3(1):2542-2553.
[6]	BHAMARE D , JAIN R , SAMAKA M , et al. A survey on service function chaining[J]. Journal of Network and Computer Applications, 2016,75(3):138-155.
[7]	XIONG G , HU Y , LAN J , et al. A mechanism for configurable network service chaining and its implementation[J]. KSII Transactions on Internet and Information Systems, 2016,10(8):3701-3727.
[8]	ZHANG Q , XIAO Y , LIU F , et al. Joint optimization of chain placement and request scheduling for network function virtualization[C]// 2017 IEEE International Conference on Distributed Computing Systems. 2017:731-741.
[9]	YE Z , CAO X , WANG J , et al. Joint topology design and mapping of service function chains for efficient, scalable, and reliable network functions virtualization[J]. IEEE Network, 2016,30(3):81-87.
[10]	MOENS H , TURCK F D . Customizable function chains: managing service chain variability in hybrid NFV networks[J]. IEEE Transactions on Network and Service Management, 2016,13(4):711-724.
[11]	DIETRICH D , ABUJODA A , RIZK A , et al. Multi-provider service chain embedding with nestor[J]. IEEE Transactions on Network and Service Management, 2017,14(1):91-105.
[12]	LIN P , BI J , WANG Y . WEBridge: west-east bridge for distributed heterogeneous SDN NOSespeering[J]. Security and Communication Networks, 2015,8(10):1926-1942.
[13]	LIN P , BI J , WOLFF S , et al. A west-east bridge based SDN inter-domain testbed[J]. Communications Magazine IEEE, 2015,53(2):190-197.
[14]	WANG Y , BI J , LIN P , et al. SDI: a multi-domain SDN mechanism for fine-grained inter-domain routing[J]. Annals of Telecommunications, 2016,71(11-12):625-637.
[15]	HOUIDI I , LOUATI W , AMEUR W B , et al. Virtual network provisioning across multiple substrate networks[J]. Computer Networks, 2011,55(4):1011-1023.
[16]	GROSSMAN P . Introduction to algorithms[M]. MCGRAW: MIT press, 2011.
[17]	ZHANG Q , LIN M , YANG L T , et al. Energy-efficient scheduling for real-time systems based on deep Q-learning model[J]. IEEE Transactions on Sustainable Computing, 2017,12(9):41-49.
[18]	WATKINS C , DAYAN P . Q-learning[J]. Machine Learning, 1992,8(3-4):279-292.
[19]	WEI Q , LEWISF L , SUN Q , et al. Discrete-time deterministic Q-learning: a novel convergence analysis[J]. IEEE transactions on cybernetics, 2016:1-14.
[20]	DIETRICH D , RIZK A , APADIMITRIOU P . Multi-domain virtual network embedding with limited information disclosure[C]// The 16th IFTP Networking Conference, 2013:1-3.
[21]	贾伟，夏靖波 . 跨域虚拟网络映射问题研究[J]. 电子与信息学报， 2016,38(3): 728-734.
	JIA W , XIA J B . Research on virtual network embedding across multiple domains[J]. Journal of Electronics & Information Technology, 2016,38(3): 728-734.
[22]	WANG X , LOGUINOY D . Understanding and modeling the Internet topology: economics and evolution perspective[J]. IEEE/ACM Transactions on Networking, 2010,18(1): 257-270.
[23]	MECHTRI M , GHRIBI C , ZEGHLACHE D . A scalable algorithm for the placement of service function chains[J]. IEEE Transactions on Network and Service Management, 2016,13(3): 533-546.
[24]	CHOWDHURY M , SAMUEL F , BOUTABA R . PolyViNE: policy-based virtual network embedding acrossmultiple domains[C]// The 2nd ACM SIGCOMMVISA. 2010: 49-56.

Metrics

Recommended 0

No Suggested Reading articles found!

	n^{Sb 1}	n^{Sb 2}	n^{Sb 3}	n^{Sb 4}
a	1	?1	?1	?1
b	1	?1	?1	?1
c	?1	1	0	?1
d	?1	?1	?1	1

Cross-domain service chain mapping mechanism based on Q-learning

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 24

Related Articles 15

Metrics

Recommended 0

[1]	Ling MA, Qiliang FAN, Ting XU, Guanchen GUO, Shenglin ZHANG, Yongqian SUN, Yuzhi ZHANG. Scheduling framework based on reinforcement learning in online-offline colocated cloud environment [J]. Journal on Communications, 2023, 44(6): 90-102.
[2]	Haibo ZHANG, Kai LAN, Zhou CHEN, Ruyan WANG, Can ZOU, Mingyue WANG. Ring-based efficient batch authentication and group key agreement protocol with anonymity in Internet of vehicles [J]. Journal on Communications, 2023, 44(6): 103-116.
[3]	Biao JIN, Yikang LI, Zhiqiang YAO, Yulin CHEN, Jinbo XIONG. GenFedRL: a general federated reinforcement learning framework for deep reinforcement learning agents [J]. Journal on Communications, 2023, 44(6): 183-197.
[4]	Yuancheng LI, Yongtai QIN. Deep reinforcement learning based algorithm for real-time QoS optimization of software-defined security middle platform [J]. Journal on Communications, 2023, 44(5): 181-192.
[5]	Dacheng ZHOU, Hongchang CHEN, Weizhen HE, Guozhen CHENG, Hongchao HU. Research on multidimensional dynamic defense strategy for microservice based on deep reinforcement learning [J]. Journal on Communications, 2023, 44(4): 50-63.
[6]	Guoliang XU, Feng TAN, Yongyi RAN, Feng CHEN. Joint beam hopping and coverage control optimization algorithm for multibeam satellite system [J]. Journal on Communications, 2023, 44(4): 78-86.
[7]	Dongbin WANG, Dongzhe WU, Hui ZHI, Kun GUO, Xu ZHANG, Jinqiao SHI, Yu ZHANG, Yueming LU. Preventing flow table overflow against denial of service attack in software defined network [J]. Journal on Communications, 2023, 44(2): 1-11.
[8]	Caixia LIU, Xinsheng JI, Jiangxing WU. Endogenous security common problems and solutions of the mobile communication networks [J]. Journal on Communications, 2022, 43(9): 70-79.
[9]	Wenjun XU, Silei WU, Fengyu WANG, Lan LIN, Guojun LI, Zhi ZHANG. Large-scale post-disaster user distributed coverage optimization based on multi-agent reinforcement learning [J]. Journal on Communications, 2022, 43(8): 1-16.
[10]	Zongxuan SHA, Ru HUO, Chuang SUN, Shuo WANG, Tao HUANG. Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(8): 30-40.
[11]	Zexi XU, Lei ZHUANG, Kunli ZHANG, Mingyu GUI. Online placement algorithm of service function chain based on knowledge graph [J]. Journal on Communications, 2022, 43(8): 41-51.
[12]	Shuai MA, Bing LI, Haihong SHENG, Rongyan GU, Hui ZHOU, Hongmei WANG, Yue WANG, Shiyin LI. Research on power allocation of integrated VLPC based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(8): 121-130.
[13]	Yu ZHANG, Min CHENG. Joint optimization of edge computing and caching in NDN [J]. Journal on Communications, 2022, 43(8): 164-175.
[14]	Peiliang ZUO, Shaolong HOU, Chao GUO, Hua JIANG, Wenbo WANG. Security decision method for the edge of multi-layer satellite network based on reinforcement learning [J]. Journal on Communications, 2022, 43(6): 189-199.
[15]	Binghao YAN, Qinrang LIU, Jianliang SHEN, Xiantuo TANG, Dong LIANG. Fast loop-free path migration strategy in software defined network [J]. Journal on Communications, 2022, 43(5): 24-35.