语义在通信中的应用综述

doi:10.11959/j.issn.1000-0801.2022107

摘要/Abstract

摘要：

随着人工智能技术与无线通信技术的发展，面向万物智联的未来通信网络对语义分割、语义网络等技术的使用越来越频繁，基于语义信息的技术也逐渐被应用到各个领域。语义通信是一种面向多智能体交互的通信方式，通过提取智能体的需求和信息特征并编码传输，从而实现智能体语义的准确传递。首先，回顾了语义相关技术在人工智能中的发展；接着，归纳总结了语义在通信方面的应用；最后，对语义与其他领域的结合进行了梳理，并浅谈语义在其他领域的发展趋势。

关键词: 语义, 语义通信, 人工智能

Abstract:

With the development of artificial intelligence technology and wireless communication technology, the future communication networks for all things intelligent connected uses semantic segmentation, semantic network and other technologies more and more frequently, and the semantic information-based technologies are applied to various fields.Semantic communication is a communication method for multi-agent interaction.By extracting the requirements and information characteristics of agents, coding and transmission, the accurate transmission of semantics from agents can be realized.Firstly, the development of semantic related technology in artificial intelligence was analyzed.And then the application of semantics in communication was summarized.Finally, the application of semantic information in other fields was analyzed, and the development trend of semantics in other fields was discussed.

Key words: semantics, semantic communication, AI

中图分类号:

TP393

徐英姿, 刘原, 时梦然, 韩书君, 董辰, 王碧舳. 语义在通信中的应用综述[J]. 电信科学, 2022, 38(Z1): 43-59.

Yingzi XU, Yuan LIU, Mengran SHI, Shujun HAN, Chen DONG, Bizhu WANG. A survey of semantic applications in communications[J]. Telecommunications Science, 2022, 38(Z1): 43-59.

图/表 12

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

图12

参考文献 80

[1]	中国工业互联网研究院. 中国工业互联网产业经济发展白皮书[R]. 2020.
	China Industrial Internet Research Institute. Economic development of China's industrial internet industry white paper[R]. 2020.
[2]	石光明语义通信变革现代通信模式远望智库预见未来[EB]. 2020.
	SHI G M . Semantic communication changes the modern communication mode and looks forward to the future[EB]. 2020.
[3]	石光明, 肖泳, 李莹玉 ,等. 面向万物智联的语义通信网络[J]. 物联网学报, 2021,5(2): 26-36.
	SHI G M , XIAO Y , LI Y Y ,et al. Semantic communication networking for the intelligence of everything[J]. Chinese Journal on Internet of Things, 2021,5(2): 26-36.
[4]	张亦弛, 张平, 魏急波赵海涛, 熊俊, 张姣, . 面向智能体的语义通信:架构与范例[EB]. 2021.
	ZHANG Y C , ZHANG P , WEI J B ,et al. Agent oriented semantic communication:Architecture and paradigm[EB]. 2021.
[5]	牛凯, 戴金晟, 张平 ,等. 面向6G的语义通信[J]. 移动通信, 2021,45(4): 85-90.
	NIU K , DAI J C , ZHANG P ,et al. 6G-oriented semantic communications[J]. Mobile Communications, 2021,45(4): 85-90.
[6]	石光明, 李莹玉, 谢雪梅 . 语义通讯:智能时代的产物[J]. 模式识别与人工智能, 2018,31(1): 91-99.
	SHI G M , LI Y Y , XIE X M . Semantic communications:outcome of the intelligence era[J]. Pattern Recognition and Artificial Intelligence, 2018,31(1): 91-99.
[7]	CORDTS M , OMRAN M , RAMOS S ,et al. The cityscapes dataset for semantic urban scene understanding[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2016: 3213-3223.
[8]	NEUHOLD G , OLLMANN T , BULO S R ,et al. The mapillary vistas dataset for semantic understanding of street scenes[C]// Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). Piscataway:IEEE Press, 2017: 5000-5009.
[9]	LONG J , SHELHAMER E , DARRELL T . Fully convolutional networks for semantic segmentation[C]// Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2015: 3431-3440.
[10]	RONNEBERGER O , FISCHER P , BROX T ,et al. U-net:convolutional networks for biomedical image segmentation[EB]. 2015.
[11]	BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017,39(12): 2481-2495.
[12]	FISHER Y , VLADLEN KOLTUN . Multi-scale context aggregation by dilated convolutions[EB]. 2015.
[13]	LIANG-CHIEH CHEN , GEORGE P , IASONAS K ,et al. Semantic image segmentation with deep convolutional nets and fully connected crfs[EB]. 2014.
[14]	CHEN L C , PAPANDREOU G , KOKKINOS I ,et al. DeepLab:semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018,40(4): 834-848.
[15]	CHEN L C , PAPANDREOU G , SCHROFF F ,et al. Rethinking atrous convolution for semantic image segmentation[EB]. 2017.
[16]	LIN G S , MILAN A , SHEN C H ,et al. RefineNet:multi-path refinement networks for high-resolution semantic segmentation[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 1925-1934.
[17]	PENG C , ZHANG X Y , YU G ,et al. Large kernel matters—improve semantic segmentation by global convolutional network[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 4353-4361.
[18]	WANG W G , ZHOU T , PORIKLI F ,et al. A survey on deep learning technique for video segmentation[EB]. 2021.
[19]	SULTANA F , SUFIAN A , DUTTA P . Evolution of image segmentation using deep convolutional neural network:a survey[J]. Knowledge-Based Systems, 2020,201/202:106062.
[20]	TOLDO M , MARACANI A , MICHIELI U ,et al. Unsupervised domain adaptation in semantic segmentation:a review[EB]. 2020.
[21]	MARCO T , ANDREA M , UMBERTO M ,et al. Unsupervised domain adaptation in semantic segmentation:a review[EB]. 2020.
[22]	HAFIZ A M , BHAT G M . A survey on instance segmentation:state of the art[J]. International Journal of Multimedia Information Retrieval, 2020,9(3): 171-189.
[23]	TAKOS G . A survey on deep learning methods for semantic image segmentation in real-time[EB]. 2020.
[24]	HENDLER J . Agents and the semantic web[J]. IEEE Intelligent Systems, 2001,16(2): 30-37.
[25]	CHEN J P , YANG F X , MA H Y ,et al. Text watermarking algorithm based on semantic role labeling[C]// Proceedings of 2016 Third International Conference on Digital Information Processing,Data Mining,and Wireless Communications (DIPDMWC). Piscataway:IEEE Press, 2016: 117-120.
[26]	DING Z M , SHAO M , LI S ,et al. Generic embedded semantic dictionary for robust multi-label classification[C]// Proceedings of 2018 IEEE International Conference on Big Knowledge (ICBK). Piscataway:IEEE Press, 2018: 282-289.
[27]	HAN B N , YIN J H , LUO X Y ,et al. Multibranch spatial-channel attention for semantic labeling of very high-resolution remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2021,18(12): 2167-2171.
[28]	SONG S R , YU F , ZENG A ,et al. Semantic scene completion from a single depth image[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 190-198.
[29]	BOZA-QUISPE G , MONTALVAN-FIGUEROA J , ROSALES-HUAMANI J ,et al. A friendly speech user interface based on Google cloud platform to access a tourism semantic website[C]// Proceedings of 2017 CHILEAN Conference on Electrical,Electronics Engineering,Information and Communication Technologies (CHILECON). Piscataway:IEEE Press, 2017: 1-4.
[30]	XIE H Q , QIN Z J . A lite distributed semantic communication system for Internet of Things[J]. IEEE Journal on Selected Areas in Communications, 2021,39(1): 142-153.
[31]	XIE H Q , QIN Z J , LI G Y ,et al. Deep learning enabled semantic communication systems[J]. IEEE Transactions on Signal Processing, 2021,69: 2663-2675.
[32]	XIE H Q , QIN Z J , LI G Y ,et al. Deep learning based semantic communications:an initial investigation[C]// Proceedings of GLOBECOM 2020 - 2020 IEEE Global Communications Conference. Piscataway:IEEE Press, 2020: 1-6.
[33]	WANG Y N , CHEN M Z , SAAD W ,et al. Performance optimization for semantic communications:an attention-based learning approach[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[34]	ZHOU Q Y , LI R P , ZHAO Z F ,et al. Semantic communication with adaptive universal transformer[J]. IEEE Wireless Communications Letters, 2022,11(3): 453-457.
[35]	WENG Z Z , QIN Z J . Semantic communication systems for speech transmission[J]. IEEE Journal on Selected Areas in Communications, 2021,39(8): 2434-2444.
[36]	ZHENG Z , ZHONG Y F , WANG J J . Pop-net:encoder-dual decoder for semantic segmentation and single-view height estimation[C]// Proceedings of IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2019: 4963-4966.
[37]	KODIROV E , XIANG T , GONG S G . Semantic autoencoder for zero-shot learning[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE Press, 2017: 4447-4456.
[38]	YANG W , LIEW Z Q , LIM W Y B ,et al. Semantic communication meets edge intelligence[J]. arXiv preprint arXiv:2202.06471, 2022.
[39]	BOURTSOULATZE E , BURTH KURKA D , GüNDüZ D , . Deep joint source-channel coding for wireless image transmission[J]. IEEE Transactions on Cognitive Communications and Networking, 2019,5(3): 567-579.
[40]	KRIZHEVSKY A . Learning multiple layers of features from tiny images[EB]. 2009.
[41]	DAI J C , WANG S X , TAN K L et al ,et al. Nonlinear transform source-channel coding for semantic communications[EB]. 2021.
[42]	HUANG D L , TAO X M , GAO F F ,et al. Deep learning-based image semantic coding for semantic communications[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[43]	TONG H N , YANG Z H , WANG S H ,et al. Federated learning based audio semantic communication over wireless networks[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[44]	TANG T , LI L , WU X Y ,et al. TSA-SCC:text semantic-aware screen content coding with ultra low bitrate[J]. IEEE Transactions on Image Processing, 2022,31: 2463-2477.
[45]	LU C G , . Semantic channel and Shannon channel mutually match and iterate fortests and estimations with maximum mutual information and maximum likelihood[C]// Proceedings of 2018 IEEE International Conference on Big Data and Smart Computing (BigComp). Piscataway:IEEE Press, 2018: 227-234.
[46]	ZHYVOTOVSKYI R , SHYSHATSKYI A , PETRUK S . Structural-semantic model of communication channel[C]// Proceedings of 2017 4th International Scientific-Practical Conference Problems of Infocommunications.Science and Technology (PIC S＆T). Piscataway:IEEE Press, 2017: 524-529.
[47]	DOMMEL J , WIERUCH D , UTKOVSKI Z ,et al. A semantics-aware communication scheme to estimate the empirical measure of A quantity of interest via multiple access fading channels[C]// Proceedings of 2021 IEEE Statistical Signal Processing Workshop. Piscataway:IEEE Press, 2021: 521-525.
[48]	SHI G M , XIAO Y , LI Y Y ,et al. From semantic communication to semantic-aware networking:model,architecture,and open problems[J]. IEEE Communications Magazine, 2021,59(8): 44-50.
[49]	PILLER T C , MERZ D M , KHELIL A . MQTT-4EST:rule-basEd WEb editor for semantic-aware topic Naming in MQTT[C]// Proceedings of 2022 IEEE 19th Annual Consumer Communications ＆ Networking Conference. Piscataway:IEEE Press, 2022: 1-8.
[50]	WYNER A D . The wire-tap channel[J]. Bell System Technical Journal, 1975,54(8): 1355-1387.
[51]	A. Bunin ， Z. Goldfeld ， Goldfeld ， H.H. Permuter ,et al. A.Bunin,Z.Goldfeld,H.H.Permuter,et al.Key and message semantic-security over state-dependent channels[EB]. 2020.
[52]	BALDI M , SENIGAGLIESI L , CHIARALUCE F . Achieving semantic security without keys through coding and all-or-nothing transforms over wireless channels[C]// Proceedings of 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP). Piscataway:IEEE Press, 2016: 964-969.
[53]	BOCHE H , CAI M L , WIESE M ,et al. Semantic security for quantum wiretap channels[C]// Proceedings of 2020 IEEE International Symposium on Information Theory. Piscataway:IEEE Press, 2020: 1990-1995.
[54]	GOLDFELD Z , CUFF P , PERMUTER H H . Semantic-security capacity for wiretap channels of type II[J]. IEEE Transactions on Information Theory, 2016,62(7): 3863-3879.
[55]	ZHANG P , XU W J , GAO H ,et al. Toward wisdom-evolutionary and primitive-concise 6G:a new paradigm of semantic communication networks[J]. Engineering, 2022,8: 60-73.
[56]	NIU K , DAI J C , YAO S S ,et al. Towards semantic communications:a paradigm shift[EB]. 2022.
[57]	Mohammad Karimzadeh Farshbafan , Walid Saad , Merouane Debbah ,et al. Mohammad Karimzadeh Farshbafan,Walid Saad,Merouane Debbah[EB]. 2021.
[58]	HU Q Y , ZHANG G Y , QIN Z J ,et al. Robust semantic communications against semantic noise[EB]. 2022.
[59]	SHANNON C E . A mathematical theory of communication[J]. Bell System Technical Journal, 1948,27(3): 379-423.
[60]	W. Weaver . Recent contributions to the mathematical theory of communication， ETC:a review of general semantics,pp. 261-281,1953.
[61]	SANA M , STRINATI E C . Learning semantics:an opportunity for effective 6G communications[C]// Proceedings of 2022 IEEE 19th Annual Consumer Communications ＆ Networking Conference. Piscataway:IEEE Press, 2022: 631-636.
[62]	ZAAROUR T , BHATTACHARYA A , CURRY E . OpenPubSub:supporting large semantic content spaces in peer-to-peer publish/subscribe systems for the Internet of multimedia things[J]. IEEE Internet of Things Journal, 2022,PP(99):1.
[63]	XU C Y , ZHANG Y . Ontology based P2P semantic search routing algorithm[C]// Proceedings of 2010 International Conference on Networking,Sensing and Control (ICNSC). Piscataway:IEEE Press, 2010: 689-692.
[64]	XIONG Q X , CHEN C H , WANG J B ,et al. A novel application semantics based routing algorithm in wireless sensor networks[C]// Proceedings of 2014 Fourth International Conference on Communication Systems and Network Technologies. Piscataway:IEEE Press, 2014: 143-146.
[65]	JIN S Y , ZHU G M . SCQR - A P2P query routing algorithm based on semantic cluster[C]// Proceedings of 2009 International Symposium on Intelligent Ubiquitous Computing and Education. Piscataway:IEEE Press, 2009: 92-96.
[66]	LUO X W , CHEN H H , GUO Q . Semantic communications:overview,open issues,and future research directions[J]. IEEE Wireless Communications, 2022,29(1): 210-219.
[67]	XIE H Q , QIN Z J , LI G Y . Task-oriented multi-user semantic communications for VQA[J]. IEEE Wireless Communications Letters, 2022,11(3): 553-557.
[68]	LUO Y M , WEI B , JIN Z G . SIP-based WIMAX wireless video surveillance system[C]// Proceedings of 2012 International Conference on Computer Science and Service System. Piscataway:IEEE Press, 2012: 1170-1173.
[69]	KARDA? K . Usage of semantic methods in surveillance videos[C]// Proceedings of 2018 26th Signal Processing and Communications Applications Conference (SIU). Piscataway:IEEE Press, 2018: 1-4.
[72]	HU J , LIU M C , ZHANG J C . A semantic model for academic social network analysis[C]// Proceedings of 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014). Piscataway:IEEE Press, 2014: 310-313.
[73]	LIANG M Y , DU J P , YANG C X ,et al. Cross-media semantic correlation learning based on deep hash network and semantic expansion for social network cross-media search[J]. IEEE Transactions on Neural Networks and Learning Systems, 2020,31(9): 3634-3648.
[74]	HATTAB G , IBNKAHLA M . Multiband spectrum access:great promises for future cognitive radio networks[J]. Proceedings of the IEEE, 2014,102(3): 282-306.
[75]	CHEN S J , SONG B , FAN L H ,et al. Multi-modal data semantic localization with relationship dependencies for efficient signal processing in EH CRNs[J]. IEEE Transactions on Cognitive Communications and Networking, 2019,5(2): 347-357.
[76]	JANGAL F , SAILLANT S , HELIER M . Wavelet contribution to remote sensing of the sea and target detection for a high-frequency surface wave radar[J]. IEEE Geoscience and Remote Sensing Letters, 2008,5(3): 552-556.
[77]	KAMPFFMEYER M , SALBERG A B , JENSSEN R . Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Piscataway:IEEE Press, 2016: 680-688.
[78]	LIU Y F , ZHONG Y F , FEI F ,et al. Scene semantic classification based on random-scale stretched convolutional neural network for high-spatial resolution remote sensing imagery[C]// Proceedings of 2016 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2016: 763-766.
[79]	CHEN G Z , ZHANG X D , WANG Q ,et al. Symmetrical dense-shortcut deep fully convolutional networks for semantic segmentation of very-high-resolution remote sensing images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018,11(5): 1633-1644.
[80]	SCHENKEL F , MIDDELMANN W . Domain adaptation for semantic segmentation of aerial imagery using cycle-consistent adversarial networks[C]// Proceedings of IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2020: 1448-1451.