星地融合网络智能路由技术综述

doi:10.11959/j.issn.2096-8930.2021015

摘要/Abstract

摘要：

针对星地融合网络面临的复杂路由问题，调研基于软件定义的星地融合网络及智能路由研究进展，探讨基于深度强化学习的星上路由机制的训练与部署方案，并结合空间智能计算平台进行具体分析。

Abstract:

In view of the complex routing problems faced by the integrated satellite-ground network, the research progress of softwaredefi ned integrated satellite-ground network and intelligent routing was investigated.The training and deployment schemes of on-orbit routing mechanisms based on deep reinforcement learning were discussed, and a specifi c analysis was made in conjunction with the space intelligent computing platform.

Key words: integrated satellite-ground network, software-defi ned network, intelligent routing, deep learning

中图分类号:

TP393

曹素芝, 孙雪, 王厚鹏, 韩佳蓉, 潘思妍, 闫蕾. 星地融合网络智能路由技术综述[J]. 天地一体化信息网络, 2021, 2(2): 11-19.

Suzhi CAO, Xue SUN, Houpeng WANG, Jiarong HAN, Siyan PAN, Lei YAN. Review of Intelligent Routing Technology in Integrated Satellite-Ground Network[J]. Space-Integrated-Ground Information Networks, 2021, 2(2): 11-19.

图/表 4

参考文献 45

[1]	刘辰屹, 徐明伟, 耿男 ,等. 基于机器学习的智能路由算法综述[J]. 计算机研究与发展, 2020,57(4): 671-687.
	LIU C Y , XU M W , GENG N ,et al. A survey on machine learning based routing algorithms[J]. Journal of Computer Research and Development, 2020,57(4): 671-687.
[2]	WANG F , JIANG D D , QI S . An adaptive routing algorithm for integrated information networks[J]. China Communication, 2019,16(7): 195-206.
[3]	ZHOU W , ZHU Y F , LI Y Y ,et al. Research on hierarchical architecture and routing of satellite constellation with IGSOGEO-MEO network[J]. International Journal of Satellite Communications and Networking, 2020,38(2): 162-176.
[4]	NA Z Y , DENG Z A , CHEN N ,et al. An active distributed QoS routing for LEO satellite communication network [C]// Proceedings of the 2015 10th International Conference on Communications and Networking in China (ChinaCom). Piscataway:IEEE Press, 2015.
[5]	ARANITI G , BEZIRGIANNIDIS N , BIRRANE E ,et al. Contact graph routing in DTN space networks:Overview,enhancements and performance[J]. IEEE Communications Magazine, 2015,53(3): 38-46.
[6]	MINGWEI X , ANQING X , YUAN Y ,et al. Intra-domain routing protocol OSPF+ for integrated terrestrial and space networks[J]. Journal of Tsinghua University (Science and Technology), 2017,57(1): 12-17.
[7]	DUDUKOVICH R , HYLTON A , PAPACHRISTOU C . A machine learning concept for DTN routing[C]// Proceedings of the 2017 IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE). Piscataway:IEEE Press, 2017.
[8]	WERNER M , DELUCCHI C . ATM-based routing in LEO/MEO satellite networks with intersatellite links[J]. IEEE Journal on Selected Areas in Communications, 1997,15(1): 69-82.
[9]	CHANG H S , KIM B W , LEE C G ,et al. FSA-based link assignment and routing in low-earth orbit satellite networks[J]. IEEE Transactions on Vehicular Technology, 1998,47(3): 10371048.
[10]	MAUGER R , ROSENBERG C . QoS guarantees for multimedia services on a TDMA-based satellite network[J]. IEEE Communications Magazine, 1997,35(7): 56-65.
[11]	UZUNALIO?LU H , AKYILDIZ I F , BENDER M D . A routing algorithm for connection-oriented Low Earth Orbit (LEO) satellite networks with dynamic connectivity[J]. Wireless Networks, 2000,6(3): 181-190.
[12]	YU Y , HAO Y , WEI J ,et al. A hierarchical planning method for the inter-satellite links network of navigation satellite constellations[C]// Proceedings of the China Satellite Navigation Conference. Springer, 2019.
[13]	EKICI E , AKYILDIZ I F , BENDER M D . Datagram routing algorithm for LEO satellite networks[C]// Proceedings IEEE INFOCOM 2000.Conference on Computer Communications.Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat.No.00CH37064). Piscataway:IEEE Press, 2000.
[14]	BAI J , LU X , LU Z ,et al. A distributed hierarchical routing protocol for non-GEO satellite networks[C]// Proceedings of the Workshops on Mobile and Wireless Networking/High Performance Scientific,Engineering Computing/Network Design and Architecture/Optical Networks Control and Management/AdHoc and Sensor Networks. Piscataway:IEEE Press, 2004.
[15]	LEE J W , LEE J W , KIM T W ,et al. Satellite over satellite (SOS) network:A novel concept of hierarchical architecture and routing in satellite network[C]// Proceedings 25th Annual IEEE Conference on Local Computer Networks LCN 2000. Piscataway:IEEE Press, 2000.
[16]	AKYILDIZ I F , EKICI E , BENDER M D . MLSR:A novel routing algorithm for multilayered satellite IP networks[J]. IEEE/ACM Transactions on networking, 2002,10(3): 411-424.
[17]	LIANG J , ZHANG J W , XIAO N . Research and simulation on an autonomous routing algorithm for GEO-LEO satellite networks[C]// Proceedings of the 2011 Fourth International Conference on Intelligent Computation Technology and Automation. Piscataway:IEEE Press, 2011.
[18]	YI X , SUN Z , YAO F ,et al. Satellite constellation of MEO and IGSO network routing with dynamic grouping[J]. International Journal of Satellite Communications and Networking, 2013,31(6): 277-302.
[19]	TSAI K , MA R P . DARTING:A cost-effective routing alternative for large space-based dynamic-topology networks[C]// Proceedings of MILCOM'95. Piscataway:IEEE Press, 1995.
[20]	RAINES R A , JANOSO R F , GALLAGHER D M ,et al. Simulation of two routing protocols operating in a low earth orbit satellite network environment[C]// Proceedings of the MILCOM 97 . Piscataway:IEEE Press, 1997.
[21]	EKICI E , AKYILDIZ I F , BENDER M D . A distributed routing algorithm for datagram traffic in LEO satellite networks[J]. IEEE/ACM Transactions on Networking, 2001,9(2): 137-147.
[22]	KAIDONG W , KECHU Y , BIN T ,et al. Packet routing algorithm for polar orbit LEO satellite constellation network[J]. Science in China Series F, 2006,49(1): 103-127.
[23]	HENDERSON T R , KATZ R H . On distributed,geographic-based packet routing for LEO satellite networks[C]// Proceedings of the Globecom'00-IEEE Global Telecommunications Conference Conference Record (Cat No 00CH37137) . Piscataway:IEEE Press, 2000.
[24]	LI T X , ZHOU H , LUO H B ,et al. SERvICE:A software defined framework for integrated space-terrestrial satellite communication[J]. IEEE Transactions on Mobile Computing, 2018,17(3): 703-716.
[25]	张然, 刘江, 杨丹 ,等. 基于软件定义网络的卫星通信网络综述[J]. 数据与计算发展前沿, 2020,2(3): 3-17.
	ZHANG R , LIU J , YANG D ,et al. A survey on satellite networks based on software-defined networking[J]. Frontiers of Data＆Computing, 2020,2(3): 3-17.
[26]	杨丹, 刘江, 张然 ,等. 基于 SDN 的卫星通信网络:现状，机遇与挑战 [J]. 天地一体化信息网络, 2020,1(2): 34-41.
	YANG D , LIU J , ZHANG R ,et al. SDN-based satellite networks:Progress,opportunities and challenges[J]. Space-IntegratedGround Information Networks, 2020,1(2): 34-41.
[27]	HUANG X Y , ZHAO Z F , MENG X J ,et al. Architecture and application of SDN/NFV-enabled space-terrestrial integrated network[J]. Communications in Computer and Information Science, 2017,688: 244-255.
[28]	陈晨, 谢珊珊, 张潇潇 ,等. 聚合SDN控制的新一代空天地一体化网络架构[J]. 中国电子科学研究院学报, 2015,10(5): 450-454,459.
	CHEN C , XIE S S , ZHANG X X ,et al. A new space and terrestrial integrated network architecture aggregated SDN[J]. Journal of China Academy of Electronics and Information Technology, 2015,10(5): 450-454,459.
[29]	GUO C , GUO J , YU C J ,et al. A safe and reliable routing mechanism of LEO satellite based on SDN[J]. Cmc-Computers Materials ＆ Continua, 2020,64(1): 439-454.
[30]	YANG L , YU L , SHI H F . A satellite network based on distributed SDN[J]. Advances in Engineering Research, 2017,61: 288-294.
[31]	韩珍珍, 赵国锋, 徐川 ,等. 基于时延的LEO卫星网络SDN控制器动态放置方法[J]. 通信学报, 2020,41(3): 126-135.
	HAN Z Z , ZHAO G F , XU C ,et al. Dynamic SDN controller placement based on latency in LEO satellite network[J]. Journal of Communications, 2020,41(3): 126-135.
[32]	梁俊, 孙伟超, 肖楠 ,等. 基于切比雪夫神经网络的软件定义卫星网络智能路由策略[J]. 国防科技大学学报, 2020,42(5): 23-30.
	LIANG J , SUN W C , XIAO N ,et al. Intelligent routing strategy for software-defined satellite network based on Chebyshev neural network[J]. Journal of National University of Defense Technology, 2020,42(5): 23-30.
[33]	XIAO S , HE D , GONG Z . Deep-q:Traffic-driven qos inference using deep generative network[C]// Proceedings of the 2018 Workshop on Network Meets AI ＆ ML. Piscataway:IEEE Press, 2018.
[34]	潘成胜, 王羽夫, 杨力 . 基于改进 LSTM 算法的天地一体化信息网络流量预测[J]. 天地一体化信息网络, 2020,1(2): 57-65.
	PAN C S , WANG Y F , YANG L . Traffic prediction of spaceintegrated-ground information network based on improved LSTM algorithm[J]. Space-Integrated-Ground Information Networks, 2020,1(2): 57-65.
[35]	RUSEK K , SUáREZ-VARELA J , MESTRES A ,et al. Unveiling the potential of Graph Neural Networks for network modeling and optimization in SDN[C]// Proceedings of the 2019 ACM Symposium on SDN Research. USA:ACM Press, 2019.
[36]	CASAS-VELASCO D M , RENDON O M C,DA-FONSECA N L . Intelligent routing based on reinforcement learning for softwaredefined networking[J]. IEEE Transactions on Network and Service Management, 2020,18(1): 870-881.
[37]	WANG P , WANG T . Adaptive routing for sensor networks using reinforcement learning[C]// Proceedings of the The Sixth IEEE International Conference on Computer and Information Technology (CIT'06). Piscataway:IEEE Press, 2006.
[38]	FORSTER A , MURPHY A L . FROMS:Feedback routing for optimizing multiple sinks in WSN with reinforcement learning[C]// Proceedings of the 2007 3rd International Conference on Intelligent Sensors,Sensor Networks and Information. Piscataway:IEEE Press, 2007.
[39]	ALKADHMI M , U?AN O N , ILYAS M . An efficient and reliable routing method for hybrid mobile Ad-Hoc networks using deep reinforcement learning[J]. Applied Bionics and Biomechanics, 2020.
[40]	DUDUKOVICH R , PAPACHRISTOU C . Delay tolerant network routing as a machine learning classification problem[C]// Proceedings of the 2018 NASA/ESA Conference on Adaptive Hardware and Systems (AHS). Piscataway:IEEE Press, 2018.
[41]	MAO Q , HU F , HAO Q . Deep learning for intelligent wireless networks:A comprehensive survey[J]. IEEE Communications Surveys ＆ Tutorials, 2018,20(4): 2595-2621.
[42]	WANG Z , ZHANG J , ZHANG X ,et al. Reinforcement learning based congestion control in satellite internet of things[C]// Proceedings of the 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP). Piscataway:IEEE Press, 2019.
[43]	LOWE R , WU Y I , TAMAR A ,et al. Multi-agent actor-critic for mixed cooperative-competitive environments[C]// Proceedings of the Advances in Neural Information Processing Systems. Piscataway:IEEE Press, 2017.
[44]	YU C , LAN J , GUO Z ,et al. DROM:Optimizing the routing in software-defined networks with deep reinforcement learning[J]. IEEE Access, 2018,6: 64533-64539.
[45]	STAMPA G , ARIAS M , SáNCHEZ-CHARLES D ,et al. A deepreinforcement learning approach for software-defined networking routing optimization[J]. arXiv preprint arXiv:170907080, 2017.

模型	深度学习算法	路由策略	训练模式	部署方式	参考文献
监督学习	切比雪夫神经网络	IRSCNN	离线训练	集中式	[32]
	长短期记忆网络	最短路径	离线训练	集中式	[34]
	深度生成网络	Deep-Q	离线训练	集中式	[33]
	图神经网络	RouteNet	离线训练	集中式	[35]
强化学习	RL	RSIR	在线训练	集中式	[36]
	最小二乘RL	AdaR	在线训练	集中式	[37]
	RL	FROMS	在线训练	分布式	[38]
	DQN	MANET	在线训练	分布式	[39]