无线网络多用户干扰下智能发射功率控制算法

doi:10.11959/j.issn.1000-436x.2022028

Abstract

Abstract:

To deal with the inter-user interference problem in wireless networks, an intelligent transmit power control scheme was proposed to manage the inter-user interference and guarantee multiple users' quality of service.Firstly, considering the complex dynamic wireless channel environment, a transmit power control model that aims to maximize the weighted sum-rate of the wireless communication system was established.Then, an intelligent power control algorithm based on the actor-critic framework in deep reinforcement learning was designed to shorten the power control decision time.Simulation results show that the proposed algorithm converges quickly, and when there are 10 pairs transceivers, the computation time consumed by the intelligent power control method is only a quarter of the time consumed by the traditional optimal algorithm.

Key words: wireless network, interference management of multiple users, transmit power control, deep reinforcement learning, power control time

CLC Number:

TN929.5

Xianchao ZHANG, Yao ZHAO, Haijun YE, Rui FAN. Intelligent transmit power control algorithm for the multi-user interference of wireless network[J]. Journal on Communications, 2022, 43(2): 15-21.

Figures/Tables 9

References 24

[1]	ZHANG L , LIANG Y C , NIYATO D . 6G Visions:mobile ultra-broadband,super Internet-of-things,and artificial intelligence[J]. China Communications, 2019,16(8): 1-14.
[2]	SAAD W , BENNIS M , CHEN M Z . A vision of 6G wireless systems:applications,trends,technologies,and open research problems[J]. IEEE Network, 2020,34(3): 134-142.
[3]	ZHANG L , XIAO M , WU G ,et al. A survey of advanced techniques for spectrum sharing in 5G networks[J]. IEEE Wireless Communications, 2017,24(5): 44-51.
[4]	ASADI A , WANG Q , MANCUSO V . A survey on device-to-device communication in cellular networks[J]. IEEE Communications Surveys ＆ Tutorials, 2014,16(4): 1801-1819.
[5]	LIU J Y , SHENG M , LIU L ,et al. Interference management in ultra-dense networks:challenges and approaches[J]. IEEE Network, 2017,31(6): 70-77.
[6]	SHI Q J , RAZAVIYAYN M , LUO Z Q ,et al. An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel[J]. IEEE Transactions on Signal Processing, 2011,59(9): 4331-4340.
[7]	SHEN K M , YU W . Fractional programming for communication systems—part I:power control and beamforming[J]. IEEE Transactions on Signal Processing, 2018,66(10): 2616-2630.
[8]	LIU G , DENG H G , QIAN X W ,et al. Joint pilot allocation and power control to enhance max-min spectral efficiency in TDD massive MIMO systems[J]. IEEE Access, 2019,7: 149191-149201.
[9]	YANG R Z , LIN B , YU F R ,et al. A dynamic pilot and data power allocation for TDD massive MIMO systems[C]// Proceedings of 2018 IEEE Global Communications Conference. Piscataway:IEEE Press, 2018: 1-6.
[10]	CHENG H V , BJ?RNSON E , LARSSON E G . Uplink pilot and data power control for single cell massive MIMO systems with MRC[C]// Proceedings of 2015 International Symposium on Wireless Communication Systems (ISWCS). Piscataway:IEEE Press, 2015: 396-400.
[11]	ZAPPONE A , DI-RENZO M , DEBBAH M . Wireless networks design in the era of deep learning:model-based,AI-based,or both?[J]. IEEE Transactions on Communications, 2019,67(10): 7331-7376.
[12]	ABRARDO A , MORETTI M . Distributed power allocation for D2D communications underlaying/overlaying OFDMA cellular networks[J]. IEEE Transactions on Wireless Communications, 2017,16(3): 1466-1479.
[13]	LYU J B , CHEW Y H , WONG W C . A Stackelberg game model for overlay D2D transmission with heterogeneous rate requirements[J]. IEEE Transactions on Vehicular Technology, 2016,65(10): 8461-8475.
[14]	梁应敞, 谭俊杰, Dusit Niyato . 智能无线通信技术研究概况[J]. 通信学报, 2020,41(7): 1-17.
	LIANG Y C , TAN J J , NIYATO D . Overview on intelligent wireless communication technology[J]. Journal on Communications, 2020,41(7): 1-17.
[15]	SUN H R , CHEN X Y , SHI Q J ,et al. Learning to optimize:training deep neural networks for interference management[J]. IEEE Transactions on Signal Processing, 2018,66(20): 5438-5453.
[16]	NASIR Y S , GUO D N . Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks[J]. IEEE Journal on Selected Areas in Communications, 2019,37(10): 2239-2250.
[17]	ZOU Z Q , YIN R , CHEN X F ,et al. Deep reinforcement learning for D2D transmission in unlicensed bands[C]// Proceedings of 2019 IEEE/CIC International Conference on Communications Workshops in China (ICCC Workshops). Piscataway:IEEE Press, 2019: 42-47.
[18]	ZHANG H J , YANG N , HUANGFU W ,et al. Power control based on deep reinforcement learning for spectrum sharing[J]. IEEE Transactions on Wireless Communications, 2020,19(6): 4209-4219.
[19]	KIM T , LOVE D J , CLERCKX B . Does frequent low resolution feedback outperform infrequent high resolution feedback for multiple antenna beamforming systems?[J]. IEEE Transactions on Signal Processing, 2011,59(4): 1654-1669.
[20]	LILLICRAP T P , HUNT J J , PRITZEL A ,et al. Continuous control with deep reinforcement learning[J]. arXiv Preprint,arXiv:1509.02971, 2015.
[21]	WANG W , ZHANG F , LAU V K N . Dynamic power control for delay-aware device-to-device communications[J]. IEEE Journal on Selected Areas in Communications, 2015,33(1): 14-27.
[22]	SUTTON R S , BARTO A G . Reinforcement learning:an introduction[J]. IEEE Transactions on Neural Networks, 1998,9(5): 1054.
[23]	SCHMIDT D A , SHI C X , BERRY R A ,et al. Minimum mean squared error interference alignment[C]// Proceedings of 2009 Conference Record of the Forty-Third Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2009: 1106-1110.
[24]	HONG M Y , RAZAVIYAYN M , LUO Z Q ,et al. A unified algorithmic framework for block-structured optimization involving big data:with applications in machine learning and signal processing[J]. IEEE Signal Processing Magazine, 2016,33(1): 57-77.

Metrics

Recommended 0

No Suggested Reading articles found!

超参数	数值
训练回合数EP	500
训练步长T	100
最小批次大小	64
折扣系数γ	0.9
评判器网络学习率LR_C	0.001
行动器网络学习率LR_A	0.001
回放缓存大小	10 000
优化器	Adam
激活函数	ELU
神经网络参数初始化	he_normal
评判器网络隐藏层层数	2
评判器网络隐藏层神经元个数	(128，64)
行动器网络隐藏层层数	2
行动器网络隐藏层神经元个数	(128，64)
目标网络更新系数τ	0.01

算法	运算时间/s
WMMSE算法	0.044 9
本文所提算法	0.030 9

算法	运算时间/s
WMMSE算法	0.131 6
本文所提算法	0.034 9

Intelligent transmit power control algorithm for the multi-user interference of wireless network

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 24

Related Articles 15

Metrics

Recommended 0

[1]	Biao JIN, Yikang LI, Zhiqiang YAO, Yulin CHEN, Jinbo XIONG. GenFedRL: a general federated reinforcement learning framework for deep reinforcement learning agents [J]. Journal on Communications, 2023, 44(6): 183-197.
[2]	Yuancheng LI, Yongtai QIN. Deep reinforcement learning based algorithm for real-time QoS optimization of software-defined security middle platform [J]. Journal on Communications, 2023, 44(5): 181-192.
[3]	Guoliang XU, Feng TAN, Yongyi RAN, Feng CHEN. Joint beam hopping and coverage control optimization algorithm for multibeam satellite system [J]. Journal on Communications, 2023, 44(4): 78-86.
[4]	Zongxuan SHA, Ru HUO, Chuang SUN, Shuo WANG, Tao HUANG. Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(8): 30-40.
[5]	Yu ZHANG, Min CHENG. Joint optimization of edge computing and caching in NDN [J]. Journal on Communications, 2022, 43(8): 164-175.
[6]	Xin SU, Leilei MENG, Yiqing ZHOU, Wu CELIMUGE. Maritime mobile edge computing offloading method based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(10): 133-145.
[7]	Li’na DU, Li ZHUO, Shuo YANG, Jiafeng LI, Jing ZHANG. Survey on reinforcement learning based adaptive bit rate algorithm for mobile video streaming services [J]. Journal on Communications, 2021, 42(9): 205-217.
[8]	Wenchen HE, Shaoyong GUO, Xuesong QIU, Liandong CHEN, Suxiang ZHANG. Node selection method in federated learning based on deep reinforcement learning [J]. Journal on Communications, 2021, 42(6): 62-71.
[9]	Yongming HUANG, Chong ZHENG, Zhengming ZHANG, Xiaohu YOU. Research on mobile edge computing and caching in massive wireless communication network [J]. Journal on Communications, 2021, 42(4): 44-61.
[10]	Guolin SUN,Ruijie OU,Guisong LIU. Deep reinforcement learning-based resource reservation algorithm for emergency Internet-of-things slice [J]. Journal on Communications, 2020, 41(9): 8-20.
[11]	Xiaorong ZHU,Peipei ZHANG. Fault detection and diagnosis method for heterogeneous wireless network based on GAN [J]. Journal on Communications, 2020, 41(8): 110-119.
[12]	Yingchang LIANG,Junjie TAN,Dusit Niyato. Overview on intelligent wireless communication technology [J]. Journal on Communications, 2020, 41(7): 1-17.
[13]	Tingting LIU,Yi’nan LUO,Chenyang YANG. Distributed interference coordination based on multi-agent deep reinforcement learning [J]. Journal on Communications, 2020, 41(7): 38-48.
[14]	Pei ZHANG,Shuaijun LIU,Zhiguo MA,Xiaohui WANG,Junde SONG. Improved satellite resource allocation algorithm based on DRL and MOP [J]. Journal on Communications, 2020, 41(6): 51-60.
[15]	Zhihong QIAN, Yinuo FENG, Jiani SUN, Xue WANG. Access selection algorithm for heterogeneous wireless network based on DA optimized fuzzy neural network [J]. Journal on Communications, 2020, 41(12): 118-127.