基于边缘计算的无人机通感融合网络波束成形与资源优化

doi:10.11959/j.issn.1000-436x.2023172

Abstract

Abstract:

To address the dependence of traditional integrated sensing and communication network mode on ground infrastructure, the unmanned aerial vehicle (UAV) with edge computing server and radar transceiver was proposed to solve the problems of high-power consumption, signal blocking, and coverage blind spots in complex scenarios.Firstly, under the conditions of satisfying the user’s transmission power, radar estimation information rate and task offloading proportion limit, the system energy consumption was minimized by jointly optimizing UAV radar beamforming, computing resource allocation, task offloading, user transmission power, and UAV flight trajectory.Secondly, the non-convex optimization problem was reformulated as a Markov decision process, and the proximal policy optimization method based deep reinforcement learning was used to achieve the optimal solution.Simulation results show that the proposed algorithm has a faster training speed and can reduce the system energy consumption effectively while satisfying the sensing and computing delay requirements.

Key words: integrated sensing-communication-computation network, UAV, deep reinforcement learning, resource allocation and optimization

CLC Number:

TN92

Bin LI, Sicong PENG, Zesong FEI. Beamforming and resource optimization in UAV integrated sensing and communication network with edge computing[J]. Journal on Communications, 2023, 44(9): 228-237.

Figures/Tables 7

References 24

[1]	LETAIEF K B , SHI Y M , LU J M ,et al. Edge artificial intelligence for 6G:vision,enabling technologies,and applications[J]. IEEE Journal on Selected Areas in Communications, 2021,40(1): 5-36.
[2]	ZHOU Y , LIU L , WANG L ,et al. Service-aware 6G:an intelligent and open network based on the convergence of communication,computing and caching[J]. Digital Communications and Networks, 2020,6(3): 253-260.
[3]	LIU Y Q , PENG M G , SHOU G C ,et al. Toward edge intelligence:multiaccess edge computing for 5G and Internet of things[J]. IEEE Internet of Things Journal, 2020,7(8): 6722-6747.
[4]	CHENG K J , FANG X M , WANG X B . Optimized resource allocation and time partitioning for integrated communication,sensing,and edge computing network[J]. Computer Communications, 2022,194: 240-249.
[5]	WANG Z L , MU X D , LIU Y W ,et al. NOMA-aided joint communication,sensing,and multi-tier computing systems[J]. IEEE Journal on Selected Areas in Communications, 2023,41(3): 574-588.
[6]	YU Z Y , HU X L , LIU C X ,et al. Location sensing and beamforming design for IRS-enabled multi-user ISAC systems[J]. IEEE Transactions on Signal Processing, 2022,70: 5178-5193.
[7]	DO-DUY T , NGUYEN L D , DUONG T Q ,et al. Joint optimisation of real-time deployment and resource allocation for UAV-aided disaster emergency communications[J]. IEEE Journal on Selected Areas in Communications, 2021,39(11): 3411-3424.
[8]	吴义豪, 齐彦丽, 周一青 ,等. 通感算协同的无人机群轨迹规划与功率分配[J]. 西安电子科技大学学报, 2023,50(3): 61-74.
	WU Y H , QI Y L , ZHOU Y Q ,et al. UAVs trajectory planning and power allocation based on the convergence of communication,sensing and computing[J]. Journal of Xidian University, 2023,50(3): 61-74.
[9]	LIU B Y , WAN Y Y , ZHOU F H ,et al. Resource allocation and trajectory design for MISO UAV-assisted MEC networks[J]. IEEE Transactions on Vehicular Technology, 2022,71(5): 4933-4948.
[10]	LU W D , DING Y , GAO Y ,et al. Secure NOMA-based UAV-MEC network towards a flying eavesdropper[J]. IEEE Transactions on Communications, 2022,70(5): 3364-3376.
[11]	WANG D , TIAN J , ZHANG H X ,et al. Task offloading and trajectory scheduling for UAV-enabled MEC networks:an optimal transport theory perspective[J]. IEEE Wireless Communications Letters, 2022,11(1): 150-154.
[12]	GAN Y H , HE Y J . Trajectory optimization and computing offloading strategy in UAV-assisted MEC system[C]// Proceedings of 2021 Computing,Communications and IoT Applications (ComComAp). Piscataway:IEEE Press, 2021: 132-137.
[13]	JEONG S , SIMEONE O , KANG J . Mobile edge computing via a UAV-mounted cloudlet:optimization of bit allocation and path planning[J]. IEEE Transactions on Vehicular Technology, 2018,67(3): 2049-2063.
[14]	HUANG N , WANG T S , WU Y ,et al. Integrated sensing and communication assisted mobile edge computing:an energy-efficient design via intelligent reflecting surface[J]. IEEE Wireless Communications Letters, 2022,11(10): 2085-2089.
[15]	QI Q , CHEN X M , KHALILI A ,et al. Integrating sensing,computing,and communication in 6G wireless networks:design and optimization[J]. IEEE Transactions on Communications, 2022,70(9): 6212-6227.
[16]	DING C F , WANG J B , ZHANG H ,et al. Joint MIMO precoding and computation resource allocation for dual-function radar and communication systems with mobile edge computing[J]. IEEE Journal on Selected Areas in Communications, 2022,40(7): 2085-2102.
[17]	ZHAO L D , WU D , ZHOU L ,et al. Radio resource allocation for integrated sensing,communication,and computation networks[J]. IEEE Transactions on Wireless Communications, 2022,21(10): 8675-8687.
[18]	QI Y L , ZHOU Y Q , LIU Y F ,et al. Traffic-aware task offloading based on convergence of communication and sensing in vehicular edge computing[J]. IEEE Internet of Things Journal, 2021,8(24): 17762-17777.
[19]	HUA M , WU Q Q , CHEN W ,et al. Secure intelligent reflecting surface aided integrated sensing and communication[J]. IEEE Transactions on Wireless Communications, 2023,PP(99): 1.
[20]	CHIRIYATH A R , PAUL B , JACYNA G M ,et al. Inner bounds on performance of radar and communications co-existence[J]. IEEE Transactions on Signal Processing, 2015,64(2): 464-474.
[21]	PENG H X , SHEN X M . Multi-agent reinforcement learning based resource management in MEC-and UAV-assisted vehicular networks[J]. IEEE Journal on Selected Areas in Communications, 2021,39(1): 131-141.
[22]	ZHAO N , YE Z Y , PEI Y Y ,et al. Multi-agent deep reinforcement learning for task offloading in UAV-assisted mobile edge computing[J]. IEEE Transactions on Wireless Communications, 2022,21(9): 6949-6960.
[23]	LIANG J B , ZHANG H H , JIANG C ,et al. Research progress of task offloading based on deep reinforcement learning in mobile edge computing[J]. Computer Science, 2021,48(7): 316-323.
[24]	ENGSTROM L , ILYAS A , SANTURKAR S ,et al. Implementation matters in deep policy gradients:a case study on PPO and TRPO[J]. arXiv Preprint,arXiv:2005.12729, 2020.

Metrics

Recommended 0

No Suggested Reading articles found!

参数	数值
最大训练集l_Me/episode	300
每一个训练集的长度l_El/step	200
学习率α	0.0005
折扣因子γ	0.98
截断参数ε	0.2
GAE因子λ	0.95
隐藏层大小	64和128
优化器	Adam

Beamforming and resource optimization in UAV integrated sensing and communication network with edge computing

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 24

Related Articles 15

Metrics

Recommended 0

[1]	Qiaoshou LIU, Xiong ZHOU, Shuang LIU, Yifeng DENG. Adaptive pilot design for OFDM based on deep reinforcement learning [J]. Journal on Communications, 2023, 44(9): 104-114.
[2]	Yaqun LIU, Jun XIE, Changyou XING, Bao’an NI. Comprehensive survey on topology control for flying ad-hoc network [J]. Journal on Communications, 2023, 44(8): 195-214.
[3]	Runzi LIU, Tianci MA, Weihua WU, Chenhong YAO, Qinghai YANG. Dynamic task scheduling method for relay satellite networks based on hierarchical reinforcement learning [J]. Journal on Communications, 2023, 44(7): 207-217.
[4]	Ningjiang CHEN, Linming LIAN, Pingjie OU, Xuemei YUAN. D2D cooperative caching strategy based on graph collaborative filtering model [J]. Journal on Communications, 2023, 44(7): 136-148.
[5]	Feng ZENG, Zheng ZHANG, Zhigang CHEN. Computation offloading and resource allocation strategy based on deep reinforcement learning [J]. Journal on Communications, 2023, 44(7): 124-135.
[6]	Lu BAI, Mingran SUN, Ziwei HUANG, Tao FENG, Xiang CHENG. Multi-UAV cooperative channel model for emergency communication [J]. Journal on Communications, 2023, 44(7): 38-50.
[7]	Yuming ZHANG, Lianming XU, Siyuan YIN, Linrun JIANG, Li WANG, Aiguo FEI. AoI-oriented low-energy-consumption information collection and transmission scheduling mechanism for emergency UAV networks [J]. Journal on Communications, 2023, 44(7): 1-13.
[8]	Biao JIN, Yikang LI, Zhiqiang YAO, Yulin CHEN, Jinbo XIONG. GenFedRL: a general federated reinforcement learning framework for deep reinforcement learning agents [J]. Journal on Communications, 2023, 44(6): 183-197.
[9]	Yuancheng LI, Yongtai QIN. Deep reinforcement learning based algorithm for real-time QoS optimization of software-defined security middle platform [J]. Journal on Communications, 2023, 44(5): 181-192.
[10]	Guoliang XU, Feng TAN, Yongyi RAN, Feng CHEN. Joint beam hopping and coverage control optimization algorithm for multibeam satellite system [J]. Journal on Communications, 2023, 44(4): 78-86.
[11]	Xueyong YU, Lixiang QIU, Jianing SONG, Hongbo ZHU. Security communication and energy efficiency optimization strategy in UAV-aided edge computing [J]. Journal on Communications, 2023, 44(3): 45-54.
[12]	Jingming XIA, Yufeng LIU, Ling TAN. Research on multi-UAV energy consumption optimization algorithm for cellular-connected network [J]. Journal on Communications, 2023, 44(2): 185-197.
[13]	Yu ZHANG, Min CHENG. Joint optimization of edge computing and caching in NDN [J]. Journal on Communications, 2022, 43(8): 164-175.
[14]	Zongxuan SHA, Ru HUO, Chuang SUN, Shuo WANG, Tao HUANG. Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning [J]. Journal on Communications, 2022, 43(8): 30-40.
[15]	Li WANG, Qing WEI, Lianming XU, Yuan SHEN, Ping ZHANG, Aiguo FEI. Research on low-energy-consumption deployment of emergency UAV network for integrated communication-navigating-sensing [J]. Journal on Communications, 2022, 43(7): 1-20.