语义在通信中的应用综述

doi:10.11959/j.issn.1000-0801.2022107

Abstract

Abstract:

With the development of artificial intelligence technology and wireless communication technology, the future communication networks for all things intelligent connected uses semantic segmentation, semantic network and other technologies more and more frequently, and the semantic information-based technologies are applied to various fields.Semantic communication is a communication method for multi-agent interaction.By extracting the requirements and information characteristics of agents, coding and transmission, the accurate transmission of semantics from agents can be realized.Firstly, the development of semantic related technology in artificial intelligence was analyzed.And then the application of semantics in communication was summarized.Finally, the application of semantic information in other fields was analyzed, and the development trend of semantics in other fields was discussed.

Key words: semantics, semantic communication, AI

CLC Number:

TP393

Yingzi XU, Yuan LIU, Mengran SHI, Shujun HAN, Chen DONG, Bizhu WANG. A survey of semantic applications in communications[J]. Telecommunications Science, 2022, 38(Z1): 43-59.

Figures/Tables 12

References 80

[1]	中国工业互联网研究院. 中国工业互联网产业经济发展白皮书[R]. 2020.
	China Industrial Internet Research Institute. Economic development of China's industrial internet industry white paper[R]. 2020.
[2]	石光明语义通信变革现代通信模式远望智库预见未来[EB]. 2020.
	SHI G M . Semantic communication changes the modern communication mode and looks forward to the future[EB]. 2020.
[3]	石光明, 肖泳, 李莹玉 ,等. 面向万物智联的语义通信网络[J]. 物联网学报, 2021,5(2): 26-36.
	SHI G M , XIAO Y , LI Y Y ,et al. Semantic communication networking for the intelligence of everything[J]. Chinese Journal on Internet of Things, 2021,5(2): 26-36.
[4]	张亦弛, 张平, 魏急波赵海涛, 熊俊, 张姣, . 面向智能体的语义通信:架构与范例[EB]. 2021.
	ZHANG Y C , ZHANG P , WEI J B ,et al. Agent oriented semantic communication:Architecture and paradigm[EB]. 2021.
[5]	牛凯, 戴金晟, 张平 ,等. 面向6G的语义通信[J]. 移动通信, 2021,45(4): 85-90.
	NIU K , DAI J C , ZHANG P ,et al. 6G-oriented semantic communications[J]. Mobile Communications, 2021,45(4): 85-90.
[6]	石光明, 李莹玉, 谢雪梅 . 语义通讯:智能时代的产物[J]. 模式识别与人工智能, 2018,31(1): 91-99.
	SHI G M , LI Y Y , XIE X M . Semantic communications:outcome of the intelligence era[J]. Pattern Recognition and Artificial Intelligence, 2018,31(1): 91-99.
[7]	CORDTS M , OMRAN M , RAMOS S ,et al. The cityscapes dataset for semantic urban scene understanding[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2016: 3213-3223.
[8]	NEUHOLD G , OLLMANN T , BULO S R ,et al. The mapillary vistas dataset for semantic understanding of street scenes[C]// Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). Piscataway:IEEE Press, 2017: 5000-5009.
[9]	LONG J , SHELHAMER E , DARRELL T . Fully convolutional networks for semantic segmentation[C]// Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2015: 3431-3440.
[10]	RONNEBERGER O , FISCHER P , BROX T ,et al. U-net:convolutional networks for biomedical image segmentation[EB]. 2015.
[11]	BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017,39(12): 2481-2495.
[12]	FISHER Y , VLADLEN KOLTUN . Multi-scale context aggregation by dilated convolutions[EB]. 2015.
[13]	LIANG-CHIEH CHEN , GEORGE P , IASONAS K ,et al. Semantic image segmentation with deep convolutional nets and fully connected crfs[EB]. 2014.
[14]	CHEN L C , PAPANDREOU G , KOKKINOS I ,et al. DeepLab:semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018,40(4): 834-848.
[15]	CHEN L C , PAPANDREOU G , SCHROFF F ,et al. Rethinking atrous convolution for semantic image segmentation[EB]. 2017.
[16]	LIN G S , MILAN A , SHEN C H ,et al. RefineNet:multi-path refinement networks for high-resolution semantic segmentation[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 1925-1934.
[17]	PENG C , ZHANG X Y , YU G ,et al. Large kernel matters—improve semantic segmentation by global convolutional network[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 4353-4361.
[18]	WANG W G , ZHOU T , PORIKLI F ,et al. A survey on deep learning technique for video segmentation[EB]. 2021.
[19]	SULTANA F , SUFIAN A , DUTTA P . Evolution of image segmentation using deep convolutional neural network:a survey[J]. Knowledge-Based Systems, 2020,201/202:106062.
[20]	TOLDO M , MARACANI A , MICHIELI U ,et al. Unsupervised domain adaptation in semantic segmentation:a review[EB]. 2020.
[21]	MARCO T , ANDREA M , UMBERTO M ,et al. Unsupervised domain adaptation in semantic segmentation:a review[EB]. 2020.
[22]	HAFIZ A M , BHAT G M . A survey on instance segmentation:state of the art[J]. International Journal of Multimedia Information Retrieval, 2020,9(3): 171-189.
[23]	TAKOS G . A survey on deep learning methods for semantic image segmentation in real-time[EB]. 2020.
[24]	HENDLER J . Agents and the semantic web[J]. IEEE Intelligent Systems, 2001,16(2): 30-37.
[25]	CHEN J P , YANG F X , MA H Y ,et al. Text watermarking algorithm based on semantic role labeling[C]// Proceedings of 2016 Third International Conference on Digital Information Processing,Data Mining,and Wireless Communications (DIPDMWC). Piscataway:IEEE Press, 2016: 117-120.
[26]	DING Z M , SHAO M , LI S ,et al. Generic embedded semantic dictionary for robust multi-label classification[C]// Proceedings of 2018 IEEE International Conference on Big Knowledge (ICBK). Piscataway:IEEE Press, 2018: 282-289.
[27]	HAN B N , YIN J H , LUO X Y ,et al. Multibranch spatial-channel attention for semantic labeling of very high-resolution remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2021,18(12): 2167-2171.
[28]	SONG S R , YU F , ZENG A ,et al. Semantic scene completion from a single depth image[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2017: 190-198.
[29]	BOZA-QUISPE G , MONTALVAN-FIGUEROA J , ROSALES-HUAMANI J ,et al. A friendly speech user interface based on Google cloud platform to access a tourism semantic website[C]// Proceedings of 2017 CHILEAN Conference on Electrical,Electronics Engineering,Information and Communication Technologies (CHILECON). Piscataway:IEEE Press, 2017: 1-4.
[30]	XIE H Q , QIN Z J . A lite distributed semantic communication system for Internet of Things[J]. IEEE Journal on Selected Areas in Communications, 2021,39(1): 142-153.
[31]	XIE H Q , QIN Z J , LI G Y ,et al. Deep learning enabled semantic communication systems[J]. IEEE Transactions on Signal Processing, 2021,69: 2663-2675.
[32]	XIE H Q , QIN Z J , LI G Y ,et al. Deep learning based semantic communications:an initial investigation[C]// Proceedings of GLOBECOM 2020 - 2020 IEEE Global Communications Conference. Piscataway:IEEE Press, 2020: 1-6.
[33]	WANG Y N , CHEN M Z , SAAD W ,et al. Performance optimization for semantic communications:an attention-based learning approach[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[34]	ZHOU Q Y , LI R P , ZHAO Z F ,et al. Semantic communication with adaptive universal transformer[J]. IEEE Wireless Communications Letters, 2022,11(3): 453-457.
[35]	WENG Z Z , QIN Z J . Semantic communication systems for speech transmission[J]. IEEE Journal on Selected Areas in Communications, 2021,39(8): 2434-2444.
[36]	ZHENG Z , ZHONG Y F , WANG J J . Pop-net:encoder-dual decoder for semantic segmentation and single-view height estimation[C]// Proceedings of IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2019: 4963-4966.
[37]	KODIROV E , XIANG T , GONG S G . Semantic autoencoder for zero-shot learning[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE Press, 2017: 4447-4456.
[38]	YANG W , LIEW Z Q , LIM W Y B ,et al. Semantic communication meets edge intelligence[J]. arXiv preprint arXiv:2202.06471, 2022.
[39]	BOURTSOULATZE E , BURTH KURKA D , GüNDüZ D , . Deep joint source-channel coding for wireless image transmission[J]. IEEE Transactions on Cognitive Communications and Networking, 2019,5(3): 567-579.
[40]	KRIZHEVSKY A . Learning multiple layers of features from tiny images[EB]. 2009.
[41]	DAI J C , WANG S X , TAN K L et al ,et al. Nonlinear transform source-channel coding for semantic communications[EB]. 2021.
[42]	HUANG D L , TAO X M , GAO F F ,et al. Deep learning-based image semantic coding for semantic communications[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[43]	TONG H N , YANG Z H , WANG S H ,et al. Federated learning based audio semantic communication over wireless networks[C]// Proceedings of 2021 IEEE Global Communications Conference. Piscataway:IEEE Press, 2021: 1-6.
[44]	TANG T , LI L , WU X Y ,et al. TSA-SCC:text semantic-aware screen content coding with ultra low bitrate[J]. IEEE Transactions on Image Processing, 2022,31: 2463-2477.
[45]	LU C G , . Semantic channel and Shannon channel mutually match and iterate fortests and estimations with maximum mutual information and maximum likelihood[C]// Proceedings of 2018 IEEE International Conference on Big Data and Smart Computing (BigComp). Piscataway:IEEE Press, 2018: 227-234.
[46]	ZHYVOTOVSKYI R , SHYSHATSKYI A , PETRUK S . Structural-semantic model of communication channel[C]// Proceedings of 2017 4th International Scientific-Practical Conference Problems of Infocommunications.Science and Technology (PIC S＆T). Piscataway:IEEE Press, 2017: 524-529.
[47]	DOMMEL J , WIERUCH D , UTKOVSKI Z ,et al. A semantics-aware communication scheme to estimate the empirical measure of A quantity of interest via multiple access fading channels[C]// Proceedings of 2021 IEEE Statistical Signal Processing Workshop. Piscataway:IEEE Press, 2021: 521-525.
[48]	SHI G M , XIAO Y , LI Y Y ,et al. From semantic communication to semantic-aware networking:model,architecture,and open problems[J]. IEEE Communications Magazine, 2021,59(8): 44-50.
[49]	PILLER T C , MERZ D M , KHELIL A . MQTT-4EST:rule-basEd WEb editor for semantic-aware topic Naming in MQTT[C]// Proceedings of 2022 IEEE 19th Annual Consumer Communications ＆ Networking Conference. Piscataway:IEEE Press, 2022: 1-8.
[50]	WYNER A D . The wire-tap channel[J]. Bell System Technical Journal, 1975,54(8): 1355-1387.
[51]	A. Bunin ， Z. Goldfeld ， Goldfeld ， H.H. Permuter ,et al. A.Bunin,Z.Goldfeld,H.H.Permuter,et al.Key and message semantic-security over state-dependent channels[EB]. 2020.
[52]	BALDI M , SENIGAGLIESI L , CHIARALUCE F . Achieving semantic security without keys through coding and all-or-nothing transforms over wireless channels[C]// Proceedings of 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP). Piscataway:IEEE Press, 2016: 964-969.
[53]	BOCHE H , CAI M L , WIESE M ,et al. Semantic security for quantum wiretap channels[C]// Proceedings of 2020 IEEE International Symposium on Information Theory. Piscataway:IEEE Press, 2020: 1990-1995.
[54]	GOLDFELD Z , CUFF P , PERMUTER H H . Semantic-security capacity for wiretap channels of type II[J]. IEEE Transactions on Information Theory, 2016,62(7): 3863-3879.
[55]	ZHANG P , XU W J , GAO H ,et al. Toward wisdom-evolutionary and primitive-concise 6G:a new paradigm of semantic communication networks[J]. Engineering, 2022,8: 60-73.
[56]	NIU K , DAI J C , YAO S S ,et al. Towards semantic communications:a paradigm shift[EB]. 2022.
[57]	Mohammad Karimzadeh Farshbafan , Walid Saad , Merouane Debbah ,et al. Mohammad Karimzadeh Farshbafan,Walid Saad,Merouane Debbah[EB]. 2021.
[58]	HU Q Y , ZHANG G Y , QIN Z J ,et al. Robust semantic communications against semantic noise[EB]. 2022.
[59]	SHANNON C E . A mathematical theory of communication[J]. Bell System Technical Journal, 1948,27(3): 379-423.
[60]	W. Weaver . Recent contributions to the mathematical theory of communication， ETC:a review of general semantics,pp. 261-281,1953.
[61]	SANA M , STRINATI E C . Learning semantics:an opportunity for effective 6G communications[C]// Proceedings of 2022 IEEE 19th Annual Consumer Communications ＆ Networking Conference. Piscataway:IEEE Press, 2022: 631-636.
[62]	ZAAROUR T , BHATTACHARYA A , CURRY E . OpenPubSub:supporting large semantic content spaces in peer-to-peer publish/subscribe systems for the Internet of multimedia things[J]. IEEE Internet of Things Journal, 2022,PP(99):1.
[63]	XU C Y , ZHANG Y . Ontology based P2P semantic search routing algorithm[C]// Proceedings of 2010 International Conference on Networking,Sensing and Control (ICNSC). Piscataway:IEEE Press, 2010: 689-692.
[64]	XIONG Q X , CHEN C H , WANG J B ,et al. A novel application semantics based routing algorithm in wireless sensor networks[C]// Proceedings of 2014 Fourth International Conference on Communication Systems and Network Technologies. Piscataway:IEEE Press, 2014: 143-146.
[65]	JIN S Y , ZHU G M . SCQR - A P2P query routing algorithm based on semantic cluster[C]// Proceedings of 2009 International Symposium on Intelligent Ubiquitous Computing and Education. Piscataway:IEEE Press, 2009: 92-96.
[66]	LUO X W , CHEN H H , GUO Q . Semantic communications:overview,open issues,and future research directions[J]. IEEE Wireless Communications, 2022,29(1): 210-219.
[67]	XIE H Q , QIN Z J , LI G Y . Task-oriented multi-user semantic communications for VQA[J]. IEEE Wireless Communications Letters, 2022,11(3): 553-557.
[68]	LUO Y M , WEI B , JIN Z G . SIP-based WIMAX wireless video surveillance system[C]// Proceedings of 2012 International Conference on Computer Science and Service System. Piscataway:IEEE Press, 2012: 1170-1173.
[69]	KARDA? K . Usage of semantic methods in surveillance videos[C]// Proceedings of 2018 26th Signal Processing and Communications Applications Conference (SIU). Piscataway:IEEE Press, 2018: 1-4.
[72]	HU J , LIU M C , ZHANG J C . A semantic model for academic social network analysis[C]// Proceedings of 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014). Piscataway:IEEE Press, 2014: 310-313.
[73]	LIANG M Y , DU J P , YANG C X ,et al. Cross-media semantic correlation learning based on deep hash network and semantic expansion for social network cross-media search[J]. IEEE Transactions on Neural Networks and Learning Systems, 2020,31(9): 3634-3648.
[74]	HATTAB G , IBNKAHLA M . Multiband spectrum access:great promises for future cognitive radio networks[J]. Proceedings of the IEEE, 2014,102(3): 282-306.
[75]	CHEN S J , SONG B , FAN L H ,et al. Multi-modal data semantic localization with relationship dependencies for efficient signal processing in EH CRNs[J]. IEEE Transactions on Cognitive Communications and Networking, 2019,5(2): 347-357.
[76]	JANGAL F , SAILLANT S , HELIER M . Wavelet contribution to remote sensing of the sea and target detection for a high-frequency surface wave radar[J]. IEEE Geoscience and Remote Sensing Letters, 2008,5(3): 552-556.
[77]	KAMPFFMEYER M , SALBERG A B , JENSSEN R . Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Piscataway:IEEE Press, 2016: 680-688.
[78]	LIU Y F , ZHONG Y F , FEI F ,et al. Scene semantic classification based on random-scale stretched convolutional neural network for high-spatial resolution remote sensing imagery[C]// Proceedings of 2016 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2016: 763-766.
[79]	CHEN G Z , ZHANG X D , WANG Q ,et al. Symmetrical dense-shortcut deep fully convolutional networks for semantic segmentation of very-high-resolution remote sensing images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018,11(5): 1633-1644.
[80]	SCHENKEL F , MIDDELMANN W . Domain adaptation for semantic segmentation of aerial imagery using cycle-consistent adversarial networks[C]// Proceedings of IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium. Piscataway:IEEE Press, 2020: 1448-1451.

Metrics

Recommended 0

No Suggested Reading articles found!

A survey of semantic applications in communications

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 80

Related Articles 15

Metrics

Recommended 0

[1]	Kaihui GAO, Dan LI. Data center networks with performance guarantee: a survey [J]. Telecommunications Science, 2023, 39(6): 1-21.
[2]	Zehua GUO, Haowen ZHU, Tongwen XU. Network modal innovation for distributed machine learning [J]. Telecommunications Science, 2023, 39(6): 44-51.
[3]	Yaoyu HE, Chao ZHANG. Airworthiness analysis of low earth orbit satellite communication technology for UAV application [J]. Telecommunications Science, 2023, 39(6): 96-104.
[4]	Sihong ZHANG, Jian ZHANG. Impact and countermeasures of generative AI represented by ChatGPT on the telecom industry [J]. Telecommunications Science, 2023, 39(5): 67-75.
[5]	Xiaoliang MA, Ying LIU, Dequan DU, Lingling AN. Key technologies and development trends of intelligent customer service for operators [J]. Telecommunications Science, 2023, 39(5): 76-89.
[6]	Qingfeng DING, Song WANG. Distributed IOS-SM transmission scheme with joint antenna and IOS unit selection for high-speed railway scenario [J]. Telecommunications Science, 2023, 39(4): 31-42.
[7]	Xiaoyun WANG, Wei DENG, Long ZHANG, Qi SUN. Research on multi-domain collaboration based method of TDD large-scale networking [J]. Telecommunications Science, 2023, 39(4): 43-51.
[8]	Liang XU, Ye WANG, Ran ZHENG, Jiheng ZHANG, Ping YUAN, Xinyang LI, Yu TIAN. Design and application of multi-dimensional evaluation model of telecommunication network operations and maintenance [J]. Telecommunications Science, 2023, 39(4): 142-151.
[9]	Haoshuang LIU, Yong ZHANG, Yingbo CAO. Substructure correlation adaptation transfer learning method based on K-means clustering [J]. Telecommunications Science, 2023, 39(3): 124-134.
[10]	Yuming GE, Qiqi MAO. Research on cross-domain cooperation deployment of V2X infrastructure [J]. Telecommunications Science, 2023, 39(3): 24-31.
[11]	Yaqiong LIU, Zhe LYU, Yafei ZHAO, Guochu SHOU. A survey on AI techniques applied in the satellite communication/satellite Internet field [J]. Telecommunications Science, 2023, 39(2): 10-24.
[12]	Yudi SUN. A prediction model of massive 5G network users’ revisit behavior based on telecom big data [J]. Telecommunications Science, 2023, 39(2): 157-162.
[13]	Yu KANG, Yaqiong LIU, Tongyu ZHAO, Guochu SHOU. A survey on AI algorithms applied in communication and computation in Internet of vehicles [J]. Telecommunications Science, 2023, 39(1): 1-19.
[14]	Yulong LU, Haiyan SHEN, Junyao ZHANG, Xinglei YANG, Yalong XIE, Lingling YANG. Exploration and prospect of the key technologies of the new generation mobile communication of intelligent railway [J]. Telecommunications Science, 2023, 39(1): 30-41.
[15]	Mingrui XU, Yucai YAO, Xiaorong ZHU. A Fisco-Bcos platform based accurate performance analysis model of blockchain system [J]. Telecommunications Science, 2023, 39(1): 79-91.