基于5G无人机通信的多智能体异构网络选择方法

doi:10.11959/j.issn.1000-0801.2022239

Abstract

Abstract:

The combination of 5G UAV communication and different wireless access technologies makes wireless heterogeneous networks present a diversified development trend.However, various types of service requests by users have different requirements on the heterogeneous networks, which leads to the problem of network selection.A multi-agent heterogeneous network selection method based on 5G UAV communication was proposed.Specifically, the users were divided into multiple agents.From the two aspects of the user side and the network side, the delay and transmission rate requirements of the user side and the load balancing requirement of the network side were comprehensively considered as the relevant parameters of immediate reward.The simulation results show that the proposed heterogeneous network selection method can select the appropriate network according to the needs of users of different service types, balance the load of the network, and make full use of the resources of the heterogeneous wireless network.

Key words: UAV communication, heterogeneous network selection, Nash Q-Learning, load balancing

CLC Number:

TN925

Yu DING, Chenkai LI, Huimei HAN, Weidang LU, Yuanhong REN, Yuan GAO, Jiang CAO. Multi-agent heterogeneous network selection method based on 5G UAV communication[J]. Telecommunications Science, 2022, 38(8): 28-36.

Figures/Tables 8

References 19

[1]	贺子健, 艾元, 闫实 ,等. 无人机通信网络的容量与覆盖性能[J]. 电信科学, 2017,33(10): 65-70.
	HE Z J , AI Y , YAN S ,et al. Performance evaluation of capacity and coverage in UAV communication networks[J]. Telecommunications Science, 2017,33(10): 65-70.
[2]	LU W D , DING Y , GAO Y ,et al. Secure NOMA-based UAV-MEC network towards a flying eavesdropper[J]. IEEE Transactions on Communications, 2022,70(5): 3364-3376.
[3]	张祖凡, 张宇 . 基于3D-Markov链的异构网络用户QoE分析方法[J]. 中国科学:信息科学, 2016,46(1): 85-99.
	ZHANG Z F , ZHANG Y . QoE analysis method for heterogeneous network user based on 3D-Markov chain[J]. Scientia Sinica(Informationis), 2016,46(1): 85-99.
[4]	刘军, 李晓楠 . 基于层次分析法的 WLAN/蜂窝网络切换判决算法[J]. 通信学报, 2013,34(2): 65-72.
	LIU J , LI X N . Handover algorithm for WLAN/cellular networks with analytic hierarchy process[J]. Journal on Communications, 2013,34(2): 65-72.
[5]	盛洁, 马冬 . 异构无线网络业务接入多目标优化控制算法[J]. 电子学报, 2016,44(2): 282-288.
	SHENG J , MA D . Multi-objective optimal based service access control algorithm for heterogeneous wireless networks[J]. Acta Electronica Sinica, 2016,44(2): 282-288.
[6]	ZHOU W A , XU Y J , LIANG T ,et al. Optimal power allocation for heterogeneous network capacity maximization[J]. China Communications, 2013,10(9): 97-103.
[7]	CHANG B J , CHEN J F . Cross-layer-based adaptive vertical handoff with predictive RSS in heterogeneous wireless networks[J]. IEEE Transactions on Vehicular Technology, 2008,57(6): 3679-3692.
[8]	石文孝, 范绍帅, 王柟 ,等. 基于模糊神经网络的异构无线网络接入选择算法[J]. 通信学报, 2010,31(9): 151-156.
	SHI W X , FAN S S , WANG N ,et al. Fuzzy neural network based access selection algorithm in heterogeneous wireless networks[J]. Journal on Communications, 2010,31(9): 151-156.
[9]	MIAO J , HU Z , YANG K ,et al. Joint power and bandwidth allocation algorithm with QoS support in heterogeneous wireless networks[J]. IEEE Communications Letters, 2012,16(4): 479-481.
[10]	CHEN H N , WU H Y , KUMAR S ,et al. Minimum-cost data delivery in heterogeneous wireless networks[J]. IEEE Transactions on Vehicular Technology, 2007,56(6): 3511-3523.
[11]	LIU S M , PAN S , MI Z K ,et al. A simple additive weighting vertical handoff algorithm based on SINR and AHP for heterogeneous wireless networks[J]. 2010 International Conference on Intelligent Computation Technology and Automation, 2010,1: 347-350.
[12]	魏淑芝, 朱琦 . 基于网络选择的视频通信带宽博弈算法[J]. 通信学报, 2015,36(2): 216-224.
	WEI S Z , ZHU Q . Bandwidth allocation games based on network selection for video communication[J]. Journal on Communications, 2015,36(2): 216-224.
[13]	CHAMODRAKAS I , MARTAKOS D . A utility-based fuzzy TOPSIS method for energy efficient network selection in heterogeneous wireless networks[J]. Applied Soft Computing, 2011,11(4): 3734-3743.
[14]	GOYAL R K , KAUSHAL S , SANGAIAH A K . The utility based non-linear fuzzy AHP optimization model for network selection in heterogeneous wireless networks[J]. Applied Soft Computing, 2018,67: 800-811.
[15]	赵彦清, 朱琦 . 基于 Q 学习的异构网络选择新算法[J]. 计算机应用, 2011,31(6): 1461-1464,1479.
	ZHAO Y Q , ZHU Q . New Q-learning based heterogeneous network selection algorithm[J]. Journal of Computer Applications, 2011,31(6): 1461-1464,1479.
[16]	XIE J L , GAO W J , LI C R . Heterogeneous network selection optimization algorithm based on a Markov decision model[J]. China Communications, 2020,17(2): 40-53.
[17]	CHEN J L , YIN M X , DUAN X H ,et al. Q-learning based selection strategies for load balance and energy balance in heterogeneous networks[C]// Proceedings of 2020 5th International Conference on Computer and Communication Systems (ICCCS). Piscataway:IEEE Press, 2020: 728-732.
[18]	WANG X Q , SU X , LIU B . A novel network selection approach in 5G heterogeneous networks using Q-learning[C]// Proceedings of 2019 26th International Conference on Telecommunications (ICT). Piscataway:IEEE Press, 2019: 309-313.
[19]	YANG J , FENG L , JIN T . Enabling sector scheduling for 5G-CPE dense networks[J]. Security and Communication Networks, 2020(7): 1-18.

Metrics

Recommended 0

No Suggested Reading articles found!

负载占用率	量化等级
[0,0.5)	1
[0.5,0.75)	2
[0.75,0.875)	3
[0.875,1]	4

网络	时延/ms	传输速率/(Gbit·s^-1)
5G CPE	20～45	1.2～1.4
5G 无人机	10～30	1.4～1.6
Wi-Fi	40～70	1.7～1.9

Multi-agent heterogeneous network selection method based on 5G UAV communication

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 19

Related Articles 15

Metrics

Recommended 0

[1]	Zhaohui WANG, Jianliang SHEN, Xia ZHANG, Ting CHEN. FALB: a FC protocol link aggregation algorithm [J]. Telecommunications Science, 2021, 37(9): 105-111.
[2]	Zhenlei DAN,Xuewen WU,Jian OUYANG,Xiaoxiao WANG,Chenwei GU. Outage performance analysis for multi-UAV relay systems with threshold-based DF protocol [J]. Telecommunications Science, 2020, 36(8): 103-111.
[3]	Sining LUO,Hualong WANG,Hongyu LI,Wei PENG. Improved ant colony algorithm based cloud computing user task scheduling algorithm [J]. Telecommunications Science, 2020, 36(2): 95-100.
[4]	Guangxue YUE,Yasheng DAI,Xiaohui YANG,Youkang ZHU,Zhenxu YOU,Jiansheng LIU. Multi-constrained trusted cooperative task migration strategy for edge computing [J]. Telecommunications Science, 2019, 35(11): 36-50.
[5]	Wenbo WANG,Qingwei YE,Yu ZHOU,Zhihua LU. Dynamic load balancing algorithm based on queuing theory comprehensive index evaluation [J]. Telecommunications Science, 2018, 34(7): 86-91.
[6]	Haipeng LIU. A static MEH handover scheme based on load balancing [J]. Telecommunications Science, 2018, 34(7): 118-127.
[7]	Qiao SUN,Buqiao DENG,Zhiqiang WANG,Xubin PEI. A scalable load balancing strategy based on distributed server cluster [J]. Telecommunications Science, 2017, 33(9): 190-196.
[8]	Xiaoan BAO,Xue WEI,Lei CHEN,Guoheng HU,Na ZHANG. Load balancing method of service cluster based on mean-variance [J]. Telecommunications Science, 2017, 33(1): 1-8.
[9]	Nan Bao,Weiwei Xia,Xu Bao. Network Selection Algorithm Based on Weighted Bipartite Graph in Heterogeneous Network Environment [J]. Telecommunications Science, 2015, 31(9): 44-50.
[10]	Kai Liu,Jianye Zhao,Zhimin Liu. Power Efficient Load Balancing Algorithm in LTE-A Heterogenous Network Based on Assignment Model [J]. Telecommunications Science, 2015, 31(2): 22-28.
[11]	Zhendong Zhao,Weijiao Niu,Dongsheng Han,Shasha Ding. Cell Selection Algorithm for Edge Users in Heterogeneous Wireless Network [J]. Telecommunications Science, 2015, 31(12): 52-57.
[12]	Yue Liu,Xiaolei Guo,Xun Zhang. Network Optimization Algorithm Based on Power Control and Channel Assignment [J]. Telecommunications Science, 2015, 31(10): 93-98.
[13]	Jinfeng Xu,Yihong Dong,Shiyi Wang,Xianmang He,Huahui Chen. Summary of Large-Scale Grapb Partitioning Algoritbms [J]. Telecommunications Science, 2014, 30(7): 100-106.
[14]	Juanxiong Xu,Yisha Liu,Lun Tang,Qianbin Chen. Survey on Research Progress of Load Balancing in LTE-Advanced Heterogeneous Network [J]. Telecommunications Science, 2014, 30(10): 116-128.
[15]	Qing Li,Zhehong Tang,Afang Song,Faguang Wang. System Design for Media Server Based on Cloud Computing Technology and the Application Analysis [J]. Telecommunications Science, 2013, 29(6): 47-52.