通信学报 ›› 2021, Vol. 42 ›› Issue (2): 124-133.doi: 10.11959/j.issn.1000-436x.2021036
• 学术论文 • 上一篇
付澍1,2, 杨祥月1, 张海君3, 陈晨1, 喻鹏4, 简鑫1, 刘敏1
修回日期:
2020-11-20
出版日期:
2021-02-01
发布日期:
2021-02-01
作者简介:
付澍(1985- ),男,贵州贵阳人,博士,重庆大学副教授、硕士生导师,主要研究方向为星地通信、NOMA、物联网、网络一体化等。基金资助:
Shu FU1,2, Xiangyue YANG1, Haijun ZHANG3, Chen CHEN1, Peng YU4, Xin JIAN1, Min LIU1
Revised:
2020-11-20
Online:
2021-02-01
Published:
2021-02-01
Supported by:
摘要:
为解决无人机在数据收集过程中的路径规划问题,将其分为全局路径规划和局部路径规划。针对全局路径规划,将其建模为一个定向问题,定向问题是背包问题和旅行商问题2种经典优化问题的组合。采用指针网络深度学习对该模型进行求解,并在无人机能量约束下得到其服务节点集合及服务顺序。针对局部路径规划,基于无人机接收到节点的参考信号强度,通过深度Q网络学习对无人机局部飞行路径进行规划,使无人机逼近节点位置并服务各节点。仿真结果表明,所提方案能够在无人机能量约束下有效提升其数据收集的收益。
中图分类号:
付澍, 杨祥月, 张海君, 陈晨, 喻鹏, 简鑫, 刘敏. 物联网数据收集中无人机路径智能规划[J]. 通信学报, 2021, 42(2): 124-133.
Shu FU, Xiangyue YANG, Haijun ZHANG, Chen CHEN, Peng YU, Xin JIAN, Min LIU. UAV path intelligent planning in IoT data collection[J]. Journal on Communications, 2021, 42(2): 124-133.
[1] | LI C , ZHANG H , HAO B ,et al. A survey on routing protocols for large-scale wireless sensor networks[J]. Sensors, 2011,11(12): 3498-3526. |
[2] | ZENG Y , ZHANG R , LIM T J . Wireless communications with unmanned aerial vehicles:opportunities and challenges[J]. IEEE Communications Magazine, 2016,54(5): 36-42. |
[3] | WANG C , MA F , YAN J ,et al. Efficient aerial data collection with UAV in large-scale wireless sensor networks[J]. International Journal of Distributed Sensor Networks, 2015,2015: 1-19. |
[4] | UTKARSHA S.P , RAJIV K G . Clustering and compressive data gpthering in wireless sensor network[J]. Wireless Personal Communications, 2019,109(2): 1-21. |
[5] | JIE G , TSUNG-HUI C , CHAO S ,et al. Flight time minimization of UAV for data collection over wireless sensor networks[J]. IEEE Journal on Selected Areas in Communications, 2018,PP(99): 1. |
[6] | ZAIN A A , SUHAIB M , MUHAMMAD A . UAV based data gpthering in wireless sensor networks[J]. Wireless Personal Communications, 2019,106(4): 1-11. |
[7] | DUAN H , LI P . UAV path planning[M]. Berlin: Springer, 2014. |
[8] | ARVANITAKI A , PAPPAS N . Modeling of a UAV-based data collection system[C]// 2017 IEEE 22nd International Workshop on Computer Aided Modeling and Design of Communication Links and Networks. Piscataway:IEEE Press, 2017: 1-6. |
[9] | RAGI S , CHONG E K P . UAV path planning in a dynamic environment via partially observable markov decision process[J]. IEEE Transactions on Aerospace and Electronic Systems, 2013,49(4): 2397-2412. |
[10] | ZHAO Y J , ZHENG Z , ZHANG X Y ,et al. Q learning algorithm based UAV path learning and obstacle avoidence approach[C]// 2017 36th Chinese Control Conference. Piscataway:IEEE Press, 2017: 3397-3402. |
[11] | HUANG H , YANG Y , WANG H ,et al. Deep reinforcement learning for UAV navigption through massive MIMO technique[J]. IEEE Transactions on Vehicular Technology, 2020,69(1): 1117-1121. |
[12] | WANG C , WANG J , SHEN Y ,et al. Autonomous navigption of UAVs in large-scale complex environments:a deep reinforcement learning approach[J]. IEEE Transactions on Vehicular Technology, 2019,PP(99): 1. |
[13] | ZHANG B , LIU C H , TANG J ,et al. Learning-based energy-efficient data collection by unmanned vehicles in smart cities[J]. IEEE Transactions on Industrial Informatics, 2017,PP(99): 1. |
[14] | LIU C H , CHEN Z , TANG J ,et al. Energy-efficient UAV control for effective and fair communication coverage:a deep reinforcement learning approach[J]. IEEE Journal on Selected Areas in Communications, 2018,36(9): 2059-2070. |
[15] | NA L , SI-MING H , CHANG-QING G . UAV path planning based on adaptive weighted pigeon-inspired optimization algorithm[J]. Computer Simulation, 2018,35(1): 38-42,125. |
[16] | ARANTES J D S , MARCIO D S A , TOLEDO C F M ,et al. Heuristic and genetic algorithm approaches for UAV path planning under critical situation[J]. International Journal of Artificial Intelligence Tools, 2017,26(1): 1760008. |
[17] | 刘丽珏, 罗舒宁, 高琰 ,等. 基于回溯蚁群-粒子群混合算法的多点路径规划[J]. 通信学报, 2019,40(2): 102-110. |
LIU L J , LUO S N , GAO Y ,et al. Multi-point path planning based on the algorithm of colony-particle swarm optimization[J]. Journal on Communications, 2019,40(2): 102-110. | |
[18] | VANSTEENWEGEN P , SOUFFRIAU W , OUDHEUSDEN D V . The orienteering problem:a survey[J]. European Journal of Operational Research, 2011,209(1): 1-10. |
[19] | GUNAWAN A , LAU H C , VANSTEENWEGEN P . Orienteering problem:a survey of recent variants,solution approaches and applications[J]. European Journal of Operational Research, 2016,255(2): 315-332. |
[20] | ABBASPOUR R A , SAMADZADEGAN F . Time-dependent personal tour planning and scheduling in metropolises[J]. Expert Systems with Applications, 2011,38(10): 12439-12452. |
[21] | LI J , WU Q M , LI X Q ,et al. Study on the time-dependent orienteering problem[C]// International Conference on E-product E-service & E-entertainment. Piscataway:IEEE Press, 2010: 1-4. |
[22] | BRAHIM A , HASSAN E F . Iterated local search algorithm for solving the orienteering problem with soft time windows[J]. SpringerPlus, 2016,5(1): 1-36. |
[23] | VINYALS O , FORTUNATO M , JAITLY N . Pointer networks[C]// International Conference on Neural Information Processing Systems. Massachusetts:MIT Press, 2015: 2692-2700. |
[24] | BELLO I , PHAM H , LE Q V ,et al. Neural combinatorial optimization with reinforcement learning[J]. arXiv Preprint,arXiv:1611.09940v1, 2016. |
[25] | HU H , ZHANG X , YAN X ,et al. Solving a new 3D bin packing problem with deep reinforcement learning method[J]. arXiv Preprint,arXiv:1708.05930, 2017. |
[26] | 王天荆, 李秀琴, 白光伟 ,等. 无线传感器网络中基于自适应网格的多目标定位算法[J]. 通信学报, 2019,40(7): 197-207. |
WANG T J , LI X Q , BAI G W ,et al. Multi-target localization algorithm based on adaptive grid in wireless sensor network[J]. Journal on Communications, 2019,40(7): 197-207. | |
[27] | WU S . Illegal radio station localization with UAV-based Q-learning[J]. China Communications, 2018,15(12): 122-131. |
[28] | FARAJZADEH A , ERCETIN O . UAV data collection over NOMA backscatter networks:UAV altitude and trajectory optimization[J]. arXiv Preprint,arXiv:1902.03061, 2019. |
[29] | JAWHAR I , MOHAMED N , AL-JAROODI J . UAV-based data communication in wireless sensor networks:models and strategies[C]// International Conference on Unmanned Aircraft Systems. Piscataway:IEEE Press, 2015: 687-694. |
[30] | 王继红, 石文孝 . 认知无线传感器网络分簇路由协议综述[J]. 通信学报, 2018,39(11): 156-169. |
WANG J H , SHI W X . Survey on cluster-based routing protocols for cognitive radio sensor networks[J]. Journal on Communications, 2018,39(11): 156-169. | |
[31] | KOOL W , VAN H H , WELLING M . Attention,learn to solve routing problems[J]. arXiv Preprint,arXiv:1803.08475v3, 2018. |
[32] | 3GPP. Further advancements for E-UTRA physical layer aspects[S]. TR 36.814 (V9.0.0), 2010. |
[33] | PAN Y , DA X Y , HU H ,et al. Energy-efficiency optimization of UAV-based cognitive radio system[J]. IEEE Access, 2019,7: 155381-155391. |
[34] | YAO Y , ZHU Z , HUANG S ,et al. Energy efficiency characterization in heterogeneous IoT system with UAV swarms based on wireless power transfer[J]. IEEE Access, 2020,8: 967-979. |
[35] | ZHU Z , WANG N , HAO W ,et al. Robust beamforming designs in secure MIMO SWIPT IoT networks with a non-linear channel model[J]. IEEE Internet of Things Journal, 2020,PP(99): 1. |
[36] | VINCENT F O , RAPHAEL F , DAMIEN E . Playing atari with deep reinforcement learning[J]. arXiv Preprint,arXiv:1312.5602, 2013. |
[37] | SUTSKEVER I , VINYALS O , LE Q V . Sequence to Sequence Learning with Neural Networks[J]. Advances in Neural Information Processing Systems.Massachusetts:MIT Press, 2014: 3104-3112. |
[38] | VINYALS O , KAISER L , KOO T ,et al. Grammar as a foreign language[J]. arXiv Preprint,arXiv:1412.7449, 2014. |
[39] | HOCHREITER S , SCHMIDHUBER J . Long short-term memory[J]. Neural Computation, 1997,9(8): 1735-1780. |
[40] | 曾广贤 . 基于神经网络学习方法的单机调度问题研究[D]. 厦门:厦门大学, 2018. |
ZENG G X . Research on single machine scheduling problem based on neural network learning method[D]. Xiamen:Xiamen University, 2018. |
[1] | 张天魁,陈超,王子端,杨鼎成. 无人机辅助蜂窝网络中的无人机与用户协同缓存算法[J]. 通信学报, 2020, 41(9): 130-138. |
[2] | 李国权,林金朝,徐勇军,黄正文,刘挺. 无人机辅助的NOMA网络用户分组与功率分配算法[J]. 通信学报, 2020, 41(9): 21-28. |
[3] | 赵海涛,高士顺,王海军,雍婷,魏急波. 无人机自主通信和组网能力评估方法[J]. 通信学报, 2020, 41(8): 87-98. |
[4] | 任佳智,田辉,范绍帅,林远卓,聂高峰,李继龙. 基于用户偏好预测的无人机部署和缓存策略[J]. 通信学报, 2020, 41(6): 1-13. |
[5] | 范超琼,赵成林,李斌. 无人机网络中基于分层博弈的干扰对抗频谱接入优化[J]. 通信学报, 2020, 41(6): 26-33. |
[6] | 张治,熊天波,陈建侨,马楠. 无人机三维空地信道模型的空间特性研究[J]. 通信学报, 2020, 41(2): 123-130. |
[7] | 尹博南,彭木根,刘晨熙. 无人机无线网络覆盖与切换性能分析[J]. 通信学报, 2020, 41(11): 22-29. |
[8] | 赵海涛,张唐伟,陈跃,赵厚麟,朱洪波. 基于DQN的车载边缘网络任务分发卸载算法[J]. 通信学报, 2020, 41(10): 172-178. |
[9] | 吴启晖,吴伟. 无人机辅助边缘计算的能量效率最大化算法设计[J]. 通信学报, 2020, 41(10): 15-24. |
[10] | 范茜莹,黄传河,朱钧宇,文少杰. 无人机辅助车联网环境下干扰感知的节点接入机制[J]. 通信学报, 2019, 40(6): 90-101. |
[11] | 王楠,周红磊,李金宝,黎玲利. 基于用户需求的景点路线利益规划算法[J]. 通信学报, 2018, 39(5): 189-198. |
[12] | 张策,李鸥,童昕,杨延平. 基于压缩感知与矩阵补全技术的WSN数据收集算法[J]. 通信学报, 2018, 39(2): 164-173. |
[13] | 郑博,张衡阳,李勇,程伟. 空中骨干网覆盖策略[J]. 通信学报, 2018, 39(11): 36-43. |
[14] | 魏振春,孙仁浩,吕增威,韩江洪,石雷,徐俊逸. 联合充电和数据收集的WCE多目标路径规划算法[J]. 通信学报, 2018, 39(10): 22-33. |
[15] | 张策,张霞,李鸥,梅关林,韩哲,张大龙,刘广怡. 不可靠链路下基于压缩感知的WSN数据收集算法[J]. 通信学报, 2016, 37(9): 131-141. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||
|