通信学报 ›› 2023, Vol. 44 ›› Issue (11): 43-54.doi: 10.11959/j.issn.1000-436x.2023205
• 专题:面向泛在物联的普适感知与智能识别关键技术 • 上一篇
杨杰1,2, 黄艺璇3, 杜涛3, 阙杭3, 夏树强4,5, 金石1,3
修回日期:
2023-10-16
出版日期:
2023-11-01
发布日期:
2023-11-01
作者简介:
杨杰(1993− ),女,安徽六安人,博士,东南大学讲师、硕士生导师,主要研究方向为移动通信、智能感知、通信感知一体化等基金资助:
Jie YANG1,2, Yixuan HUANG3, Tao DU3, Hang QUE3, Shuqiang XIA4,5, Shi JIN1,3
Revised:
2023-10-16
Online:
2023-11-01
Published:
2023-11-01
Supported by:
摘要:
针对技术落地面临的实际挑战,对通信感知一体化原型验证的研究现状和发展趋势进行了阐述和总结。首先,概括基于单节点的通信感知一体化原型系统在定位、环境制图、成像、波形设计和波束追踪等方面的研究进展和实测性能。接着,从车联网和物联网场景入手,分析基于多点协作的通信感知一体化原型系统的实际增益。然后,聚焦基于跨设备的通信感知一体化原型验证,总结各传感器的优劣势和实测融合效果。最后,针对现有原型验证遇到的问题和挑战,指出通信感知一体化系统实现和技术验证的研究趋势。
中图分类号:
杨杰, 黄艺璇, 杜涛, 阙杭, 夏树强, 金石. 通信感知一体化原型验证的研究现状与发展趋势[J]. 通信学报, 2023, 44(11): 43-54.
Jie YANG, Yixuan HUANG, Tao DU, Hang QUE, Shuqiang XIA, Shi JIN. Prototype verification for integrated sensing and communications:current status and development trends[J]. Journal on Communications, 2023, 44(11): 43-54.
表1
通信和定位一体化系统实现文献总结"
文献 | 工作频段/GHz | 工作带宽/MHz | 天线配置 | 波形 | 工作方式 | 实测参数 | 平均定位误差 |
文献[ | 5.1 | 80 | 4 × 1均匀线阵 | 啁啾 | 自发自收 | 角度 | — |
文献[ | 2.35 | 40 | BS:单天线 | 任意 | 上行定位 | TDOA | 0.42 m(100 m2暗室) |
UE:矢量信号分析仪 | |||||||
文献[ | 77 | 2 000 | les[J].IEEE Internet 单喇叭天线模拟29天线) | 单载波Zadoff-Chu | 自发自收 | 距离角度图 | — |
文献[ | 27.2 | 400 | BS:16×24均匀面阵 | OFDM | 下行定位 | AOA AOD TOA | 24.82 m(105m2室外) |
UE:2 × 8均匀面阵 |
表4
单一传感器设备辅助文献总结"
设备类型 | 输出数据 | 特点 | 文献 | 实现功能 | 所提方案 | 预测效果 |
毫米波通信系统 | 毫米波接收信号 | 与电磁波传输环境高度耦合,但路径损耗高且易受阻挡 | 文献[ | 阻隔预测 | 无线指纹提取+RNN | 20 ms内阻隔遮挡预测成功率高于85% |
GPS | 目标经纬坐标 | 室外实现粗略定位,但室内通常失效 | 文献[ | 波束预测 | 神经网络 | 相比穷举算法,波束训练开销降低70% |
文献[ | 阻隔预测 | MIRNet+深度神经网络 | 1 s内阻隔遮挡预测成功率约为80% | |||
相机 | RGB图像 | 包含丰富环境信息,但易受光线条件影响 | 文献[ | 波束预测 | 自编码器网络 | 相比穷举算法,波束训练开销降低99% |
文献[ | 波束预测 | 语义信息提取+神经网络 | 相比直接使用RGB图像,网络参数量降低约83% | |||
文献[ | 波束预测 | 离线预测+在线追踪 | 相比使用离线方案,波束预测精度提升约15% | |||
FMCW雷达 | 雷达回波信号 | 检测目标范围广,但易受射频干扰影响 | 文献[ | 阻隔预测 | CNN | 1 s内阻隔遮挡预测成功率高于90% |
文献[ | 波束预测 | 深度神经网络 | 相比穷举算法,波束训练开销降低93% | |||
LiDAR | 激光点云 | 检测目标精度高,但易受雨雾天气影响 | 文献[ | 阻隔预测 | CNN | 1 s内阻隔遮挡预测成功率相比无LiDAR提升45% |
文献[ | 波束预测 | RNN | 相比穷举算法,波束训练开销降低90% |
[1] | IMT-2030(6G)推进组. 6G前沿关键技术研究报告[R]. 2022. |
IMT-2030 (6G) Propulsion Group. 6G frontier key technology research report[R]. 2022. | |
[2] | 童文, 朱佩英 . 6G 无线通信新征程:跨越人联 物联 迈向万物智联[M]. 北京: 机械工业出版社, 2021. |
TONG W , ZHU P Y . 6G the next horizon:from connected people and things to connected intelligence[J]. Beijing:China Machine Press, 2021. | |
[3] | CUI Y H , LIU F , JING X J ,et al. Integrating sensing and communications for ubiquitous IoT:applications,trends,and challenges[J]. IEEE Network, 2021,35(5): 158-167. |
[4] | PIN T D K , HE J , LI Y C ,et al. Integrated sensing and communication in 6G:motivations,use cases,requirements,challenges and future directions[C]// Proceedings of 1st IEEE International Online Symposium on Joint Communications & Sensing. Piscataway:IEEE Press, 2021: 1-6. |
[5] | LIU F , CUI Y H , MASOUROS C ,et al. Integrated sensing and communications:toward dual-functional wireless networks for 6G and beyond[J]. IEEE Journal on Selected Areas in Communications, 2022,40(6): 1728-1767. |
[6] | LIU A , HUANG Z , LI M ,et al. A survey on fundamental limits of integrated sensing and communication[J]. IEEE Communications Surveys & Tutorials, 2022,24(2): 994-1034. |
[7] | ZHANG J A , LIU F , MASOUROS C ,et al. An overview of signal processing techniques for joint communication and radar sensing[J]. IEEE Journal of Selected Topics in Signal Processing, 2021,15(6): 1295-1315. |
[8] | YANG J , XU J , LI X ,et al. Integrated communication and localization in millimeter-wave systems[J]. Frontiers of Information Technology &Electronic Engineering, 2021,22(4): 457-470. |
[9] | MA D Y , SHLEZINGER N , HUANG T Y ,et al. Spatial modulation for joint radar-communications systems:design,analysis,and hardware prototype[J]. IEEE Transactions on Vehicular Technology, 2021,70(3): 2283-2298. |
[10] | KESKIN M F , SEZGIN I C , BAO H ,et al. Localization with distributed MIMO using a high-speed sigma-delta-over-fiber testbed[J]. IEEE Microwave and Wireless Components Letters, 2022,32(7): 923-926. |
[11] | KUMARI P , MEZGHANI A , HEATH R W . JCR70:a low-complexity millimeter-wave proof-of-concept platform for a fully-digital SIMO joint communication-radar[J]. IEEE Open Journal of Vehicular Technology, 2021,2: 218-234. |
[12] | GE Y , CHEN H , JIANG F ,et al. Experimental validation of single base station 5G mmWave positioning:initial findings[C]// Proceedings of 25th International Conference on Information Fusion. Piscataway:IEEE Press, 2022: 1-8. |
[13] | GE Y , KHOSRAVI H , JIANG F ,et al. Experimental validation of single BS 5G mmWave positioning and mapping for intelligent transport[J]. arXiv Preprint,arXiv:2303.11995, 2023. |
[14] | BARNETO C B , RASTORGUEVA-FOI E , KESKIN M F ,et al. Millimeter-wave mobile sensing and environment mapping:models,algorithms and validation[J]. IEEE Transactions on Vehicular Technology, 2022,71(4): 3900-3916. |
[15] | LEITINGER E , MEYER F , HLAWATSCH F ,et al. A belief propagation algorithm for multipath-based SLAM[J]. IEEE Transactions on Wireless Communications, 2019,18(12): 5613-5629. |
[16] | LI X H , LEITINGER E , OSKARSSON M ,et al. Massive MIMO-based localization and mapping exploiting phase information of multipath components[J]. IEEE Transactions on Wireless Communications, 2019,18(9): 4254-4267. |
[17] | YANG J , WEN C K , YANG X ,et al. Multi-domain cooperative SLAM:the enabler for integrated sensing and communications[J]. IEEE Wireless Communications, 2023,30(1): 40-49. |
[18] | YANG J , WEN C K , XU J ,et al. Angle-based SLAM on 5G mmWave systems:design,implementation,and measurement[J]. IEEE Internet of Things Journal, 2023,10(20): 17755-17771. |
[19] | ALADSANI M , ALKHATEEB A , TRICHOPOULOS G C . Leveraging mmWave imaging and communications for simultaneous localization and mapping[C]// Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing. Piscataway:IEEE Press, 2019: 4539-4543. |
[20] | ZHUGE X D , YAROVOY A G . Three-dimensional near-field MIMO array imaging using range migration techniques[J]. IEEE Transactions on Image Processing:a Publication of the IEEE Signal Processing Society, 2012,21(6): 3026-3033. |
[21] | GAO J K , DENG B , QIN Y L ,et al. An efficient algorithm for MIMO cylindrical millimeter-wave holographic 3-D imaging[J]. IEEE Transactions on Microwave Theory and Techniques, 2018,66(11): 5065-5074. |
[22] | LI O P , HE J , ZENG K ,et al. Integrated sensing and communication in 6G A prototype of high resolution THz sensing on portable device[C]// Proceedings of Joint European Conference on Networks and Communications & 6G Summit. Piscataway:IEEE Press, 2021: 544-549. |
[23] | GUAN J F , PAIDIMARRI A , VALDES-GARCIA A , ,et al. 3-D imaging using millimeter-wave 5G signal reflections[J]. IEEE Transactions on Microwave Theory and Techniques, 2021,69(6): 2936-2948. |
[24] | LI Y B , LI L L , XU B B ,et al. Transmission-type 2-bit programmable metasurface for single-sensor and single-frequency microwave imaging[J]. Scientific Reports, 2016,6:23731. |
[25] | HU J Z , ZHANG H L , BIAN K G ,et al. MetaSketch:wireless semantic segmentation by reconfigurable intelligent surfaces[J]. IEEE Transactions on Wireless Communications, 2022,21(8): 5916-5929. |
[26] | ZHANG Q X , JI K J , FENG Z Y ,et al. Vehicle behavior-cognition-based particle-filter-enabled mmWave beam tracking for connected automated vehicles[J]. IEEE Internet of Things Journal, 2022,9(21): 21292-21304. |
[27] | LIYANAARACHCHI S D , RIIHONEN T , BARNETO C B ,et al. Optimized waveforms for 5G-6G communication with sensing:theory,simulations and experiments[J]. IEEE Transactions on Wireless Communications, 2021,20(12): 8301-8315. |
[28] | XU T Y , LIU F , MASOUROS C ,et al. An experimental proof of concept for integrated sensing and communications waveform design[J]. IEEE Open Journal of the Communications Society, 2022,3: 1643-1655. |
[29] | ZHANG Q X , SUN H Z , GAO X Y ,et al. Time-division ISAC enabled connected automated vehicles cooperation algorithm design and performance evaluation[J]. IEEE Journal on Selected Areas in Communications, 2022,40(7): 2206-2218. |
[30] | JI K J , ZHANG Q X , WEI Z Q ,et al. Networking based ISAC hardware testbed and performance evaluation[J]. IEEE Communications Magazine, 2023,61(5): 76-82. |
[31] | TEAGUE B , LIU Z Y , MEYER F ,et al. Network localization and navigation with scalable inference and efficient operation[J]. IEEE Transactions on Mobile Computing, 2022,21(6): 2072-2087. |
[32] | DONG H L , YU J C , XU Y F ,et al. MR-GMMapping:communication efficient multi-robot mapping system via Gaussian mixture model[J]. IEEE Robotics and Automation Letters, 2022,7(2): 3294-3301. |
[33] | WU S Y , ALRABEIAH M , CHAKRABARTI C ,et al. Blockage prediction using wireless signatures:deep learning enables real-world demonstration[J]. IEEE Open Journal of the Communications Society, 2022,3: 776-796. |
[34] | WU S Y , CHAKRABARTI C , ALKHATEEB A . LiDAR-aided mobile blockage prediction in real-world millimeter wave systems[C]// Proceedings of IEEE Wireless Communications and Networking Conference. Piscataway:IEEE Press, 2022: 2631-2636. |
[35] | DEMIRHAN U , ALKHATEEB A . Radar aided proactive blockage prediction in real-world millimeter wave systems[C]// Proceedings of IEEE International Conference on Communications. Piscataway:IEEE Press, 2022: 4547-4552. |
[36] | CHARAN G , ALKHATEEB A . Computer vision aided blockage prediction in real-world millimeter wave deployments[C]// Proceedings of IEEE Globecom Workshops. Piscataway:IEEE Press, 2023: 1711-1716. |
[37] | MORAIS J , BEHBOODI A , PEZESHKI H ,et al. Position aided beam prediction in the real world:how useful GPS locations actually are[J]. arXiv Preprint,arXiv:2205.09054, 2022. |
[38] | DEMIRHAN U , ALKHATEEB A . Radar aided 6G beam prediction:deep learning algorithms and real-world demonstration[C]// Proceedings of IEEE Wireless Communications and Networking Conference. Piscataway:IEEE Press, 2022: 2655-2660. |
[39] | JIANG S F , CHARAN G , ALKHATEEB A . LiDAR aided future beam prediction in real-world millimeter wave V2I communications[J]. IEEE Wireless Communications Letters, 2023,12(2): 212-216. |
[40] | JIANG S F , ALKHATEEB A . Computer vision aided beam tracking in a real-world millimeter wave deployment[C]// Proceedings of IEEE Globecom Workshops. Piscataway:IEEE Press, 2023: 142-147. |
[41] | IMRAN S , CHARAN G , ALKHATEEB A . Environment semantic aided communication:a real world demonstration for beam prediction[J]. arXiv Preprint,arXiv:2302.06736, 2023. |
[42] | ZHANG Q X , ZHANG X Q , YANG C . Camera-sensing-assisted fast mmWave beam tracking for connected automated vehicles[J]. IEEE Internet of Things Journal, 2022,9(20): 20630-20639. |
[43] | WANG Y Q , WANG Z Q , ZHANG J A ,et al. Vital sign monitoring in dynamic environment via mmWave radar and camera fusion[J]. IEEE Transactions on Mobile Computing, 2023,PP(99): 1-17. |
[44] | FANG X Y , LIU J W , CHEN Y K ,et al. Nowhere to hide:detecting live video forgery via vision-WiFi silhouette correspondence[C]// Proceedings of IEEE Conference on Computer Communications. Piscataway:IEEE Press, 2023: 1-10. |
[45] | BHAT N N , SAMERI J , STRUYE J ,et al. Multi-modal pose estimation in XR applications leveraging integrated sensing and communication[C]// Proceedings of the 1st ACM Workshop on Mobile Immersive Computing,Networking,and Systems. New York:ACM Press, 2023: 261-267. |
[46] | ZHOU F J , ZHU G X , LI X Y ,et al. Towards pervasive sensing:a multimodal approach via CSI and RGB image modalities fusion[C]// Proceedings of the 3rd ACM MobiCom Workshop on Integrated Sensing and Communications Systems. New York:ACM Press, 2023: 25-30. |
[47] | CUI Y H , NIE J L , YU T K ,et al. Sensing-assisted communication beamforming based on multi-modal feature extraction for high-reliable IoV[C]// Proceedings of the 3rd ACM MobiCom Workshop on Integrated Sensing and Communications Systems. New York:ACM Press, 2023: 19-24. |
[48] | ZHANG T Y , LIU J , GAO F F . Vision aided beam tracking and frequency handoff for mmWave communications[C]// Proceedings of IEEE Conference on Computer Communications Workshops. Piscataway:IEEE Press, 2022: 1-2. |
[49] | WU S Y , CHAKRABARTI C , ALKHATEEB A . Proactively predicting dynamic 6G link blockages using LiDAR and In-band signatures[J]. IEEE Open Journal of the Communications Society, 2023,4: 392-412. |
[50] | CHARAN G , OSMAN T , HREDZAK A ,et al. Vision-position multi-modal beam prediction using real millimeter wave datasets[C]// Proceedings of IEEE Wireless Communications and Networking Conference. Piscataway:IEEE Press, 2022: 2727-2731. |
[51] | CHARAN G , HREDZAK A , STODDARD C ,et al. Towards real-world 6G drone communication:position and camera aided beam prediction[C]// Proceedings of IEEE Global Communications Conference. Piscataway:IEEE Press, 2023: 2951-2956. |
[52] | ALKHATEEB A , CHARAN G , OSMAN T ,et al. DeepSense 6G:a large-scale real-world multi-modal sensing and communication dataset[J]. arXiv Preprint,arXiv:2211.09769, 2022. |
[53] | YUE S C , HE H , CAO P ,et al. CornerRadar:RF-based indoor localization around corners[C]// Proceedings of the ACM on Interactive,Mobile,Wearable and Ubiquitous Technologies. New York:ACM Press, 2022: 1-24. |
[54] | LI X Y , CUI Y H , ZHANG J A ,et al. Integrated human activity sensing and communications[J]. IEEE Communications Magazine, 2023,61(5): 90-96. |
[55] | CHANG Z X , ZHANG F S , XIONG J ,et al. Sensor-free soil moisture sensing using LoRa signals[C]// Proceedings of the ACM on Interactive,Mobile,Wearable and Ubiquitous Technologies. New York:ACM Press, 2022: 1-27. |
[56] | LI S J , LIU Z P , ZHANG Y ,et al. WiBorder:precise Wi-Fi based boundary sensing via through-wall discrimination[C]// Proceedings of the ACM on Interactive,Mobile,Wearable and Ubiquitous Technologies. New York:ACM Press, 2020: 1-30. |
[57] | KEYKHOSRAVI K , DENIS B , ALEXANDROPOULOS G C ,et al. Leveraging RIS-enabled smart signal propagation for solving infeasible localization problems[J]. arXiv Preprint,arXiv:2204.11538, 2022. |
[58] | CUI Y P , FENG Z Y , ZHANG Q X ,et al. Toward trusted and swift UAV communication:ISAC-enabled dual identity mapping[J]. IEEE Wireless Communications, 2023,30(1): 58-66. |
[1] | 王志恒, 徐彦彦. 室内定位隐私保护综述[J]. 通信学报, 2023, 44(9): 188-204. |
[2] | 雒明世, 张蒙蒙, 方阳. PE管道的近场微波成像及缺陷定量表征[J]. 通信学报, 2023, 44(9): 139-148. |
[3] | 韦娟, 贺雨涛, 宁方立. 基于互质位置非同步测量的低频声源成像方法[J]. 通信学报, 2023, 44(9): 93-103. |
[4] | 龚晨, 潘昱宸, 徐正元. 紫外通信与感知一体化:建模与系统优化[J]. 通信学报, 2023, 44(9): 1-11. |
[5] | 卢小峰, 董晔, 李越杰. 基于深度优先多径参数估计的NLOS定位增强算法[J]. 通信学报, 2023, 44(8): 99-110. |
[6] | 马帅, 裴科, 祁华艳, 李航, 曹雯, 王洪梅, 熊海良, 李世银. 基于生成模型的地磁室内高精度定位算法研究[J]. 通信学报, 2023, 44(6): 211-222. |
[7] | 夏楠, 高丹阳, 邢宝辉, 王亚宁. 基于外辐射源的空中目标直接定位算法[J]. 通信学报, 2023, 44(6): 117-124. |
[8] | 周炳朋, 马珊珊. 面向6G毫米波通信感知一体化的机动目标联合定位与测速[J]. 通信学报, 2023, 44(3): 81-92. |
[9] | 周牧, 张靖, 王勇, 杨小龙, 李玲霞. 基于散射自由程随机重采样的光量子定位方法[J]. 通信学报, 2023, 44(3): 55-65. |
[10] | 王晓云, 张小舟, 马良, 王亚娟, 楼梦婷, 姜涛, 金婧, 王启星, 刘光毅. 6G通信感知一体化网络的感知算法研究与优化[J]. 通信学报, 2023, 44(2): 219-230. |
[11] | 赵越, 李赞, 李冰, 郝本建. TDoA定位盲区分析与节点部署策略研究[J]. 通信学报, 2023, 44(1): 1-13. |
[12] | 程翔, 张浩天, 杨宗辉, 黄子蔚, 李思江, 余安澜. 车联网通信感知一体化研究:现状与发展趋势[J]. 通信学报, 2022, 43(8): 188-202. |
[13] | 马帅, 李兵, 盛海鸿, 谷荣妍, 周辉, 王洪梅, 王悦, 李世银. 基于深度强化学习的可见光定位通信一体化功率分配研究[J]. 通信学报, 2022, 43(8): 121-130. |
[14] | 谢良波, 李宇洋, 王勇, 周牧, 聂伟. 基于自适应蝙蝠算法的室内RFID定位算法[J]. 通信学报, 2022, 43(8): 90-99. |
[15] | 赵增华, 童跃凡, 崔佳洋. 基于域自适应的Wi-Fi指纹设备无关室内定位模型[J]. 通信学报, 2022, 43(4): 143-153. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||
|