空天地一体化网络技术：探索与展望

doi:10.11959/j.issn.2096-3750.2020.00142

Abstract

Abstract:

With the advance of the information technologies,the scale of the information services gradually expands,from ground services,to aerial,maritime,and spatial services,with the soaring requirements on multi-dimensional comprehensive information resources.The space-air-ground integrated networks (SAGINs) are envisioned to provide seamless network services to spatial,aerial,maritime,and ground users,satisfying the future network requirements on all-time,all-domain,and all-space communications and interconnected networking.Firstly,we reviewed the current research development of SAGINs,discussing the research trends on the low-earth orbiting (LEO) satellite constellation and space-ground network integration.Then,the reinforcement learning (RL) framework was proposed in SAGINs to address the problems of complex architecture,high dynamics,and resource constraints in SAGINs,which facilitated efficient and fast network design,analysis,optimization,and management.As a case study,the method of applying deep RL (DRL) was showed for the intelligent access network selection in SAGINs.To improve the RL training efficiency,a comprehensive SAGINs simulation platform was established,through which the agent-environments interaction was accelerated and training samples could be obtained more cost-effectively.Finally,some open research directions were presented.

Key words: space-air-ground integrated network, reinforcement learning, LEO constellation, simulation platform, Internet of vehicles

CLC Number:

TN92

Xuemin(Sherman) SHEN,Nan CHENG,Haibo ZHOU,Feng LYU,Wei QUAN,Weisen SHI,Huaqing WU,Conghao ZHOU. Space-air-ground integrated networks:review and prospect[J]. Chinese Journal on Internet of Things, 2020, 4(3): 3-19.

Figures/Tables 7

标准组织	标准编号	主要研究内容
3GPP	TR 38.913（2016.01—2018.07）	旨在开发下一代接入技术的部署场景和需求，并提出了将卫星网络作为地基网络扩展的场景
	TS 22.261（2016.10—2020.03）	研究了5G网络系统的新功能、市场需求以及满足上述需求所必需的性能指标和基本功能要求
	TR 22.891（2015.09—2016.09）	提出了使用卫星进行5G网络连接的场景，并指出当前地基网络技术需要进行的提升
	TR 23.799（2016.01—2016.12）	将通过卫星的5G网络连接列为下一代移动网络系统架构中的关键问题
	TR 38.811（2017.05—2019.10）	研究了5G卫星网络的作用、业务特性、网络结构、部署场景和非地基网络信道模型，并对卫星网络的潜在应用进行分析
	TR 22.822（2017.12—2018.07）	提出了基于5G卫星网络的架构，并确定了未来以及现有的服务需求以及卫星和地基网络之间切换的监管问题
ETSI	TR 103 124（2013.07）	确定了结合卫星网络和地基网络场景的定义和分类
	TR 102 641（2008.08—2013.08）	提出了卫星网络在灾害管理中的作用，并列出了不同卫星应用的资源需求
	TR 103 263（2014.07—2016.02）	确定了在卫星通信中引入CR技术时须遵守的法规，并强调了在Ka波段使用CR技术的不同场景
	TR 103 351（2017.07）	解决了无线接入网中的流量分配问题和乡郊地区的回程问题
	TR 103 293（2015.07）	细化了卫星网络与3G毫微微基站的合作，并提供了大量使用卫星地基网络的回程解决方案
	TS 102 357（2005.05—2015.05）	提出了SI-SAP并规范了卫星地基网络中宽带服务的物理空中接口
CEPT	ECC Report 280（2018.05）	报告了5G集成网络中卫星网络的功能定位以及基于卫星的几种典型用例
DVB	DVB规范	将卫星视为向地面提供数字电视和IP服务的广播者，提出了一系列技术标准
CCSDS	CCSD推荐标准	针对空间通信特点，制定了适合卫星通信的空间通信协议标准

References 53

[1]	3GPP.Study on New Radio (NR) to support non-terrestrial networks:TR 38.811 V15.2.0[S]. 2019.
[2]	科塔学术.天地一体化信息网络重大工程立项建议[EB/OL].
[3]	CHEN M Z , CHALLITA U , SAAD W ,et al. Artificial neural networks-based machine learning for wireless networks:a tutorial[J]. arXiv:1710.02913, 2017
[4]	LIOLIS K , SCHLUETER G , KRAUSE J ,et al. Cognitive radio scenarios for satellite communications:the CoRaSat approach[C]// 2013 Future Network and Mobile Summit. IEEE, 2013: 1-10.
[5]	European Union. SANSA[EB/OL]. .
[6]	European Union. VIrtualized hybrid satellite-TerrestriAl systems for resilient and flexible future networks[EB/OL]. .
[7]	European Space Agency. SATNEX IV[EB/OL]. .
[8]	European Union. SaT5G[EB/OL]. .
[9]	SATis5 Consortium. SATis5 Consortium.SATis5[EB/OL]. .
[10]	KOTA S , GIAMBENE G , KIM S . Satellite component of NGN:integrated and hybrid networks[J]. International Journal of Satellite Communications and Networking, 2011,29(3): 191-208.
[11]	WANG Y , XU Y C , ZHANG Y ,et al. Hybrid satellite-aerial-terrestrial networks in emergency scenarios:a survey[J]. China Communications, 2017,14(7): 1-13.
[12]	ZHANG N , ZHANG S , YANG P ,et al. Software defined space-airground integrated vehicular networks:challenges and solutions[J]. IEEE Communications Magazine, 2017,55(7): 101-109.
[13]	CHENG N , QUAN W , SHI W S ,et al. A comprehensive simulation platform for space-air-ground integrated network[J]. IEEE Wireless Communications, 2020,27(1): 178-185.
[14]	WANG P , ZHANG J X , ZHANG X ,et al. Convergence of satellite and terrestrial networks:a comprehensive survey[J]. IEEE Access, 2020,8: 5550-5588.
[15]	3GPP.Study on scenarios and requirements for next generation access technologies:TR 38.913 V15.0.0[S]. 2018.
[16]	3GPP.Service requirements for the 5G system:TS 22.261 V17.2.0[S]. 2020.
[17]	3GPP.Study on new services and markets technology enablers:TR 22.891 V14.2.0[S]. 2016.
[18]	3GPP.Study on architecture for next generation system:TR 23.799 V14.0.0[S]. 2016.
[19]	3GPP.Study on using satellite access in 5G:TR 22.822 V16.0.0[S]. 2018.
[20]	ETSI.Satellite earth stations and systems (SES); combined satellite and terrestrial networks scenarios:TR 103 124 V1.1.1[S]. 2013.
[21]	ETSI.Satellite earth stations and systems (SES); overview of present satellite emergency communications resources:TR 102 641 V1.2.2[S]. 2013.
[22]	ETSI.System reference document (SRdoc); cognitive radio techniques for satellite communications operating in Ka band:TR 103 263 V1.2.1[S]. 2016.
[23]	ETSI.Satellite earth stations and systems (SES); multi-link routing scheme in hybrid access network with heterogeneous links:TR 103 351 V1.1.1[S]. 2017.
[24]	ETSI.Broadband radio access networks (BRAN); broadband wireless access and backhauling for remote rural communities:TR 103 293 V1.1.1[S]. 2015.
[25]	ETSI.Satellite earth stations and systems (SES); broadband satellite multimedia (BSM); common air interface specification; satellite independent service access point (SI-SAP) interface:primitives:TS 102 357 V1.2.1[S]. 2015.
[26]	ECC Report 280.Satellite solutions for 5G[EB/OL]. .
[27]	ETSI, CENELEC, EBU, et al. DVB Specifications[EB/OL]. .
[28]	CCSDS. Blue books:recommended standards[EB/OL]. .
[29]	SUTTON R , BARTO A . Reinforcement learning:an introduction[M]. London: The MIT PressPress, 1998.
[30]	SILVER D , SCHRITTWIESER J , SIMONYAN K ,et al. Mastering the game of Go without human knowledge[J]. Nature, 2017,550(7676): 354-359.
[31]	LUONG N , HOANG D , GONG S ,et al. Applications of deep reinforcement learning in communications and networking:a survey[J]. IEEE Communications Surveys ＆ Tutorials, 2019,21(4): 3133-3174.
[32]	LIU J J , SHI Y P , FADLULLAH Z M ,et al. Space-air-ground integrated network:a survey[J]. IEEE Communications Surveys ＆ Tutorials, 2018,20(4): 2714-2741.
[33]	KATO N , FADLULLAH Z M , TANG F X ,et al. Optimizing space-airground integrated networks by artificial intelligence[J]. IEEE Wireless Communications, 2019,26(4): 140-147.
[34]	FOERSTER J , NARDELLI N , FARQUHAR G ,et al. Stabilising experience replay for deep multi-agent reinforcement learning[C]// International Conference on Machine Learning. 2017: 1146-1155.
[35]	KULKARNI T D , NARASIMHAN K R , SAEEDI A ,et al. Hierarchical deep reinforcement learning:integrating temporal abstraction and intrinsic motivation[C]// Conference and Workshop on Neural Information Processing Systems. 2016: 3675-3683.
[36]	YIN S X , ZHAO S , ZHAO Y F ,et al. Intelligent trajectory design in UAV-aided communications with reinforcement learning[J]. IEEE Transactions on Vehicular Technology, 2019,68(8): 8227-8231.
[37]	HU J Z , ZHANG H L , SONG L Y . Reinforcement learning for decentralized trajectory design in cellular UAV networks with sense-andsend protocol[J]. IEEE Internet of Things Journal, 2019,6(4): 6177-6189.
[38]	CHEN M T , ZHANG Y , TENG Y L ,et al. Reinforcement learning based signal quality aware handover scheme for LEO satellite communication networks[C]// International Conference on Human Centered Computing. Springer, 2019: 44-55.
[39]	LIU S J , HU X , WANG W D . Deep reinforcement learning based dynamic channel allocation algorithm in multibeam satellite systems[J]. IEEE Access, 2018,6: 15733-15742.
[40]	FERREIRA P V R , PAFFENROTH R , WYGLINSKI A M ,et al. Multi-objective reinforcement learning for cognitive satellite communications using deep neural network ensembles[J]. IEEE Journal on Selected Areas in Communications, 2018,36(5): 1030-1041.
[41]	CHEN M Z , SAAD W , YIN C C ,et al. Data correlation-aware resource management in wireless virtual reality (VR):an echo state transfer learning approach[J]. IEEE Transactions on Communications, 2019,67(6): 4267-4280.
[42]	FU S , GAO J , ZHAO L . Integrated resource management for terrestrial-satellite systems[J]. IEEE Transactions on Vehicular Technology, 2020,69(3): 3256-3266.
[43]	CAO Y , ZHANG L , LIANG Y C . Deep reinforcement learning for multi-user access control in UAV networks[C]// 2019 IEEE International Conference on Communications (ICC). IEEE, 2019: 1-6.
[44]	HU J Z , ZHANG H L , SONG L Y ,et al. Reinforcement learning for a cellular Internet of UAVs:protocol design,trajectory control,and resource management[J]. IEEE Wireless Communications, 2020,27(1): 116-123.
[45]	CHENG N , LYU F , QUAN W ,et al. Space/aerial-assisted computing offloading for IoT applications:a learning-based approach[J]. IEEE Journal on Selected Areas in Communications, 2019,37(5): 1117-1129.
[46]	CHEN M Z , SAAD W , YIN C C . Echo-liquid state deep learning for 360° content transmission and caching in wireless VR networks with cellular-connected UAVs[J]. IEEE Transactions on Communications, 2019,67(9): 6386-6400.
[47]	赵亚军, 郁光辉, 徐汉青 . 6G移动通信网络:愿景、挑战与关键技术[J]. 中国科学:信息科学, 2019: 963-987.
	ZHAO Y J , YU G H , XU H Q . 6G mobile communication network:vision,challenges and key technologies[J]. Scientia Sinica (Informationis), 2019: 963-987.
[48]	PAPA A , DECOLA T , VIZARRETA P ,et al. Dynamic SDN controller placement in a LEO constellation satellite network[C]// 2018 IEEE Global Communications Conference (GLOBECOM). IEEE, 2018: 206-212.
[49]	AHMED T , ALLEG A , FERRUS R ,et al. On-demand network slicing using SDN/NFV-enabled satellite ground segment systems[C]// 2018 4th IEEE Conference on Network Softwarization and Workshops (NetSoft). IEEE, 2018: 242-246.
[50]	KU H J , JUNG J H , KWON G I . A study on reinforcement learning based SFC path selection in SDN/NFV[J]. International Journal of Applied Engineering Research, 2017,12(12): 3439-3443.
[51]	XIAO Y , ZHANG Q , LIU F ,et al. NFVdeep:adaptive online service function chain deployment with deep reinforcement learning[C]// The International Symposium on Computer Science,Computer Engineering and Educational Technology. 2019: 1-10.
[52]	FOONG K C , . Mobility management for satellite/terrestrial multi-service convergence networks[C]// 2009 International Conference on Communication Software and Networks. IEEE, 2009: 362-366.
[53]	RUIZ DE AZUA J A , CALVERAS A , CAMPS A . Internet of satellites (IoSat):analysis of network models and routing protocol requirements[J]. IEEE Access, 2018,6: 20390-20411.

Metrics

Recommended 0

No Suggested Reading articles found!

车辆数目/辆	RL方法/ms	最优搜索方法（穷举法）/ms
5	3.25	292.34
6	3.42	1 436.87
7	3.63	3 773.59
8	3.78	13 720.94
9	4.24	51 829.38
10	4.26	518 910.16

Space-air-ground integrated networks:review and prospect

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 53

Related Articles 15

Metrics

Recommended 0

[1]	Zhihong WANG, Supeng LENG, Kai XIONG. Multi-agent resource allocation strategy for UAV swarm-based cooperative sensing [J]. Chinese Journal on Internet of Things, 2023, 7(1): 18-26.
[2]	Kai JIANG, Yue CAO, Huan ZHOU, Xuefeng REN, Yongdong ZHU, Hai LIN. Edge intelligence empowered internet of vehicles: concept, framework, issues, implementation, and prospect [J]. Chinese Journal on Internet of Things, 2023, 7(1): 37-48.
[3]	Cenhuishan LIAO, Junyan CHEN, Guanping LIANG, Xiaolan XIE, Xiaoye LU. Quality of service optimization algorithm based on deep reinforcement learning in software defined network [J]. Chinese Journal on Internet of Things, 2023, 7(1): 73-82.
[4]	Biao ZHANG, Ximing WANG, Yifan XU, Wen LI, Hao HAN, Songyi LIU, Xueqiang CHEN. Multi-domain collaborative anti-jamming based on multi-agent deep reinforcement learning [J]. Chinese Journal on Internet of Things, 2022, 6(4): 104-116.
[5]	Huanhuan ZHANG, Anfu ZHOU, Huadong MA. Reinforcement learning-based real-time video streaming control and on-device training research [J]. Chinese Journal on Internet of Things, 2022, 6(4): 1-13.
[6]	Xian LI, Suzhi BI, Hongru ZENG, Bin LIN, Xiaohui LIN. Collaborative task offloading and resource allocation optimization for intelligent edge devices [J]. Chinese Journal on Internet of Things, 2022, 6(4): 41-52.
[7]	Jiujiu CHEN, Caili GUO, Chunyan FENG, Chuanhong LIU. Resource allocation for the semantic communication in the intelligent networked environment [J]. Chinese Journal on Internet of Things, 2022, 6(3): 47-57.
[8]	Hanqing YU, Yan LIN, Linqiong JIA, Qiang LI, Yijin Zhang. A distributed strategy for the multi-target rescue using a UAV swarm under communication constraints [J]. Chinese Journal on Internet of Things, 2022, 6(3): 103-112.
[9]	Zihui LUO, Chengling JIANG, Liang LIU, Xiaolong ZHENG, Huadong MA. Research on deep reinforcement learning based intelligent shop scheduling method [J]. Chinese Journal on Internet of Things, 2022, 6(1): 53-64.
[10]	Yu YAO, Yanjie LI, Lenan WU, Pu MIAO, Xiaoyu TANG. Cognitive waveform design for radar-communication transceiver networks [J]. Chinese Journal on Internet of Things, 2021, 5(4): 71-80.
[11]	Xinxin FENG, Danying GUO, Zefeng LIU, Haifeng ZHENG. Task allocation in IoV-based crowdsensing combing clustering and CMAB [J]. Chinese Journal on Internet of Things, 2021, 5(3): 86-96.
[12]	Haibo MEI, Kun YANG, Xinyu FAN. Deep reinforcement learning to enhance the energy-efficient performance of UAV-enabled F-RAN [J]. Chinese Journal on Internet of Things, 2021, 5(2): 48-59.
[13]	Chunmin LIN, Liekang ZENG, Xu CHEN. Research on power efficient autonomous UAV navigation algorithm: an edge intelligence driven approach [J]. Chinese Journal on Internet of Things, 2021, 5(2): 87-96.
[14]	Caili GUO,Jiujiu CHEN,Yidi XUAN,He ZHANG. Research on the spectrum sensing and sharing technology in the dynamic spatiotemporal data driven cognitive Internet of vehicles [J]. Chinese Journal on Internet of Things, 2020, 4(3): 96-105.
[15]	Qicheng ZENG,Yuxuan SUN,Sheng ZHOU. Computation task offloading algorithm and system level simulation for vehicles [J]. Chinese Journal on Internet of Things, 2019, 3(3): 62-69.