无线网络多用户干扰下智能发射功率控制算法

doi:10.11959/j.issn.1000-436x.2022028

通信学报 ›› 2022, Vol. 43 ›› Issue (2): 15-21.doi: 10.11959/j.issn.1000-436x.2022028

无线网络多用户干扰下智能发射功率控制算法

张先超¹^,², 赵耀³, 叶海军⁴, 樊锐⁵

¹ 东南大学移动通信国家重点实验室，江苏南京 210096
² 嘉兴学院浙江省医学电子与数字健康重点实验室，浙江嘉兴 314001
³ 北京理工大学信息与电子学院，北京 100081
⁴ 北京邮电大学信息与通信工程学院，北京 100876
⁵ 中国电子科学研究院，北京 100041

修回日期:2021-12-17 出版日期:2022-02-25 发布日期:2022-02-01
作者简介:张先超（1984-），男，安徽合肥人，博士，东南大学在站博士后，嘉兴学院教授，主要研究方向为无线网络资源管理、人工智能等
赵耀（1996-），男，河南南乐人，北京理工大学博士生，主要研究方向为智能无线通信、无线资源管理等
叶海军（1979-），男，安徽池州人，中国电子科学研究院研究员，主要研究方向为空基网络化信息系统体系作战、总体设计与综合集成
樊锐（1989-），男，安徽滁州人，博士，中国电子科学研究院高级工程师，主要研究方向为网络信息体系、人工智能
基金资助:
国家自然科学基金资助项目(61941104);国家自然科学基金资助项目(U19B2015)

Intelligent transmit power control algorithm for the multi-user interference of wireless network

Xianchao ZHANG¹^,², Yao ZHAO³, Haijun YE⁴, Rui FAN⁵

¹ National Mobile Communications Research Laboratory, Southeast University, Nanjing 210096, China
² Key Laboratory of Medical Electronics and Digital Health of Zhejiang Province, Jiaxing University, Jiaxing 314001,China
³ School of Information and Electronics, Beijing Institute of Technology, Beijing 100081,China
⁴ School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
⁵ China Academic of Electronics and Information Technology, Beijing 100041,China

Revised:2021-12-17 Online:2022-02-25 Published:2022-02-01
Supported by:
The National Natural Science Foundation of China(61941104);The National Natural Science Foundation of China(U19B2015)

摘要/Abstract

摘要：

针对无线网络多用户互相干扰的问题，通过对发射功率进行智能控制，实现干扰管理，保证多用户通信服务质量。首先，考虑复杂动态无线信道环境，建立以无线通信系统加权数据速率最大化为目标的发射功率控制模型。其次，设计以深度强化学习“行动器-评判器”为基本架构的智能发射功率控制算法，缩短功率控制决策时间。仿真验证表明，所提算法收敛速度快，在10对收发机场景下，计算时间缩短到传统最优算法的 $\frac{1}{4}$ 。

关键词: 无线网络, 多用户干扰管理, 发射功率控制, 深度强化学习, 功率控制时间

Abstract:

To deal with the inter-user interference problem in wireless networks, an intelligent transmit power control scheme was proposed to manage the inter-user interference and guarantee multiple users' quality of service.Firstly, considering the complex dynamic wireless channel environment, a transmit power control model that aims to maximize the weighted sum-rate of the wireless communication system was established.Then, an intelligent power control algorithm based on the actor-critic framework in deep reinforcement learning was designed to shorten the power control decision time.Simulation results show that the proposed algorithm converges quickly, and when there are 10 pairs transceivers, the computation time consumed by the intelligent power control method is only a quarter of the time consumed by the traditional optimal algorithm.

Key words: wireless network, interference management of multiple users, transmit power control, deep reinforcement learning, power control time

中图分类号:

TN929.5

张先超, 赵耀, 叶海军, 樊锐. 无线网络多用户干扰下智能发射功率控制算法[J]. 通信学报, 2022, 43(2): 15-21.

Xianchao ZHANG, Yao ZHAO, Haijun YE, Rui FAN. Intelligent transmit power control algorithm for the multi-user interference of wireless network[J]. Journal on Communications, 2022, 43(2): 15-21.

图/表 9

图1

图2

表1

图3

图4

图5

图6

表2

表3

参考文献 24

[1]	ZHANG L , LIANG Y C , NIYATO D . 6G Visions:mobile ultra-broadband,super Internet-of-things,and artificial intelligence[J]. China Communications, 2019,16(8): 1-14.
[2]	SAAD W , BENNIS M , CHEN M Z . A vision of 6G wireless systems:applications,trends,technologies,and open research problems[J]. IEEE Network, 2020,34(3): 134-142.
[3]	ZHANG L , XIAO M , WU G ,et al. A survey of advanced techniques for spectrum sharing in 5G networks[J]. IEEE Wireless Communications, 2017,24(5): 44-51.
[4]	ASADI A , WANG Q , MANCUSO V . A survey on device-to-device communication in cellular networks[J]. IEEE Communications Surveys ＆ Tutorials, 2014,16(4): 1801-1819.
[5]	LIU J Y , SHENG M , LIU L ,et al. Interference management in ultra-dense networks:challenges and approaches[J]. IEEE Network, 2017,31(6): 70-77.
[6]	SHI Q J , RAZAVIYAYN M , LUO Z Q ,et al. An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel[J]. IEEE Transactions on Signal Processing, 2011,59(9): 4331-4340.
[7]	SHEN K M , YU W . Fractional programming for communication systems—part I:power control and beamforming[J]. IEEE Transactions on Signal Processing, 2018,66(10): 2616-2630.
[8]	LIU G , DENG H G , QIAN X W ,et al. Joint pilot allocation and power control to enhance max-min spectral efficiency in TDD massive MIMO systems[J]. IEEE Access, 2019,7: 149191-149201.
[9]	YANG R Z , LIN B , YU F R ,et al. A dynamic pilot and data power allocation for TDD massive MIMO systems[C]// Proceedings of 2018 IEEE Global Communications Conference. Piscataway:IEEE Press, 2018: 1-6.
[10]	CHENG H V , BJ?RNSON E , LARSSON E G . Uplink pilot and data power control for single cell massive MIMO systems with MRC[C]// Proceedings of 2015 International Symposium on Wireless Communication Systems (ISWCS). Piscataway:IEEE Press, 2015: 396-400.
[11]	ZAPPONE A , DI-RENZO M , DEBBAH M . Wireless networks design in the era of deep learning:model-based,AI-based,or both?[J]. IEEE Transactions on Communications, 2019,67(10): 7331-7376.
[12]	ABRARDO A , MORETTI M . Distributed power allocation for D2D communications underlaying/overlaying OFDMA cellular networks[J]. IEEE Transactions on Wireless Communications, 2017,16(3): 1466-1479.
[13]	LYU J B , CHEW Y H , WONG W C . A Stackelberg game model for overlay D2D transmission with heterogeneous rate requirements[J]. IEEE Transactions on Vehicular Technology, 2016,65(10): 8461-8475.
[14]	梁应敞, 谭俊杰, Dusit Niyato . 智能无线通信技术研究概况[J]. 通信学报, 2020,41(7): 1-17.
	LIANG Y C , TAN J J , NIYATO D . Overview on intelligent wireless communication technology[J]. Journal on Communications, 2020,41(7): 1-17.
[15]	SUN H R , CHEN X Y , SHI Q J ,et al. Learning to optimize:training deep neural networks for interference management[J]. IEEE Transactions on Signal Processing, 2018,66(20): 5438-5453.
[16]	NASIR Y S , GUO D N . Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks[J]. IEEE Journal on Selected Areas in Communications, 2019,37(10): 2239-2250.
[17]	ZOU Z Q , YIN R , CHEN X F ,et al. Deep reinforcement learning for D2D transmission in unlicensed bands[C]// Proceedings of 2019 IEEE/CIC International Conference on Communications Workshops in China (ICCC Workshops). Piscataway:IEEE Press, 2019: 42-47.
[18]	ZHANG H J , YANG N , HUANGFU W ,et al. Power control based on deep reinforcement learning for spectrum sharing[J]. IEEE Transactions on Wireless Communications, 2020,19(6): 4209-4219.
[19]	KIM T , LOVE D J , CLERCKX B . Does frequent low resolution feedback outperform infrequent high resolution feedback for multiple antenna beamforming systems?[J]. IEEE Transactions on Signal Processing, 2011,59(4): 1654-1669.
[20]	LILLICRAP T P , HUNT J J , PRITZEL A ,et al. Continuous control with deep reinforcement learning[J]. arXiv Preprint,arXiv:1509.02971, 2015.
[21]	WANG W , ZHANG F , LAU V K N . Dynamic power control for delay-aware device-to-device communications[J]. IEEE Journal on Selected Areas in Communications, 2015,33(1): 14-27.
[22]	SUTTON R S , BARTO A G . Reinforcement learning:an introduction[J]. IEEE Transactions on Neural Networks, 1998,9(5): 1054.
[23]	SCHMIDT D A , SHI C X , BERRY R A ,et al. Minimum mean squared error interference alignment[C]// Proceedings of 2009 Conference Record of the Forty-Third Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2009: 1106-1110.
[24]	HONG M Y , RAZAVIYAYN M , LUO Z Q ,et al. A unified algorithmic framework for block-structured optimization involving big data:with applications in machine learning and signal processing[J]. IEEE Signal Processing Magazine, 2016,33(1): 57-77.

超参数	数值
训练回合数EP	500
训练步长T	100
最小批次大小	64
折扣系数γ	0.9
评判器网络学习率LR_C	0.001
行动器网络学习率LR_A	0.001
回放缓存大小	10 000
优化器	Adam
激活函数	ELU
神经网络参数初始化	he_normal
评判器网络隐藏层层数	2
评判器网络隐藏层神经元个数	(128，64)
行动器网络隐藏层层数	2
行动器网络隐藏层神经元个数	(128，64)
目标网络更新系数τ	0.01

算法	运算时间/s
WMMSE算法	0.044 9
本文所提算法	0.030 9

算法	运算时间/s
WMMSE算法	0.131 6
本文所提算法	0.034 9

无线网络多用户干扰下智能发射功率控制算法

Intelligent transmit power control algorithm for the multi-user interference of wireless network

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 24

相关文章 15

Metrics

推荐阅读 0

[1]	金彪, 李逸康, 姚志强, 陈瑜霖, 熊金波. GenFedRL：面向深度强化学习智能体的通用联邦强化学习框架[J]. 通信学报, 2023, 44(6): 183-197.
[2]	李元诚, 秦永泰. 基于深度强化学习的软件定义安全中台QoS实时优化算法[J]. 通信学报, 2023, 44(5): 181-192.
[3]	许国良, 谭峰, 冉泳屹, 陈丰. 面向多波束卫星系统的波束跳变与覆盖控制联合优化算法[J]. 通信学报, 2023, 44(4): 78-86.
[4]	沙宗轩, 霍如, 孙闯, 汪硕, 黄韬. 基于深度强化学习的转发效能感知流量调度算法[J]. 通信学报, 2022, 43(8): 30-40.
[5]	张宇, 程旻. NDN中边缘计算与缓存的联合优化[J]. 通信学报, 2022, 43(8): 164-175.
[6]	苏新, 孟蕾蕾, 周一青, CELIMUGE Wu. 基于深度强化学习的海洋移动边缘计算卸载方法[J]. 通信学报, 2022, 43(10): 133-145.
[7]	杜丽娜, 卓力, 杨硕, 李嘉锋, 张菁. 基于强化学习的移动视频流业务码率自适应算法研究进展[J]. 通信学报, 2021, 42(9): 205-217.
[8]	贺文晨, 郭少勇, 邱雪松, 陈连栋, 张素香. 基于DRL的联邦学习节点选择方法[J]. 通信学报, 2021, 42(6): 62-71.
[9]	黄永明, 郑冲, 张征明, 尤肖虎. 大规模无线通信网络移动边缘计算和缓存研究[J]. 通信学报, 2021, 42(4): 44-61.
[10]	孙国林,欧睿杰,刘贵松. 基于深度强化学习的应急物联网切片资源预留算法[J]. 通信学报, 2020, 41(9): 8-20.
[11]	朱晓荣,张佩佩. 基于GAN的异构无线网络故障检测与诊断算法[J]. 通信学报, 2020, 41(8): 110-119.
[12]	梁应敞,谭俊杰,Dusit Niyato. 智能无线通信技术研究概况[J]. 通信学报, 2020, 41(7): 1-17.
[13]	刘婷婷,罗义南,杨晨阳. 基于多智能体深度强化学习的分布式干扰协调[J]. 通信学报, 2020, 41(7): 38-48.
[14]	钱志鸿, 冯一诺, 孙佳妮, 王雪. 基于DA优化模糊神经网络的异构无线网络接入选择算法[J]. 通信学报, 2020, 41(12): 118-127.
[15]	尹博南,彭木根,刘晨熙. 无人机无线网络覆盖与切换性能分析[J]. 通信学报, 2020, 41(11): 22-29.