可扩展分层次编译码的语义通信系统

doi:10.11959/j.issn.1000-436x.2023157

通信学报 ›› 2023, Vol. 44 ›› Issue (8): 49-60.doi: 10.11959/j.issn.1000-436x.2023157

• 学术论文 • 上一篇

可扩展分层次编译码的语义通信系统

张聿远, 赵海涛, 魏急波, 曹阔, 张亦弛, 罗鹏, 刘月玲, 梅锴

国防科技大学电子科学学院，湖南长沙 410073

修回日期:2023-08-09 出版日期:2023-08-01 发布日期:2023-08-01
作者简介:张聿远（1997- ），男，山西长治人，国防科技大学博士生，主要研究方向为语义通信、智能信号处理等
赵海涛（1981- ），男，山东昌乐人，博士，国防科技大学教授、博士生导师，主要研究方向为认知无线网络、自组织网络、协同通信等
魏急波（1967- ），男，湖北汉川人，博士，国防科技大学教授、博士生导师，主要研究方向为无线通信网络协议、通信信号处理、协同通信、认知无线网络等
曹阔（1990- ），男，湖南汨罗人，博士，国防科技大学讲师，主要研究方向为协同通信、无线物理层安全等
张亦弛（1995- ），女，北京人，博士，国防科技大学讲师，主要研究方向为认知无线网络、语义通信等
罗鹏（1995- ），男，四川金阳人，国防科技大学博士生，主要研究方向为语义通信、大规模MIMO信道建模等
刘月玲（1999- ），女，湖南常德人，国防科技大学博士生，主要研究方向为语义通信等
梅锴（1993- ），男，四川仁寿人，国防科技大学博士生，主要研究方向为机器学习、物理层传输技术等
基金资助:
国家自然科学基金资助项目(62201584);国家自然科学基金资助项目(61931020);国家自然科学基金资助项目(U19B2024)

Extensible hierarchical codec semantic communication system

Yuyuan ZHANG, Haitao ZHAO, Jibo WEI, Kuo CAO, Yichi ZHANG, Peng LUO, Yueling LIU, Kai MEI

College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China

Revised:2023-08-09 Online:2023-08-01 Published:2023-08-01
Supported by:
The National Natural Science Foundation of China(62201584);The National Natural Science Foundation of China(61931020);The National Natural Science Foundation of China(U19B2024)

摘要/Abstract

摘要：

针对目前文本语义通信大部分研究主要依靠仿真系统进行理论验证的问题，利用分层次编译码架构在语义层次和语法层次上的分离性，提出了一种可扩展分层次的语义通信系统。该系统通过语义和语法层次相分离的模式有效兼容香农信息框架下的可靠通信技术，实现语义通信与传统通信的嵌套结合。进一步，基于软件无线电平台搭建了一个通用可扩展的验证系统，对所提语义通信系统架构进行实用化验证。该验证系统以语义通信软件平台作为硬件驱动和算法调用的驱动核心，集成了信号产生、信息发送、接收端数据采集、译码和评估的全过程，并且能够面向语义和语法层次进一步扩展。最后，基于该验证系统进行了文本语义通信的测试，验证了其相较于传统通信方式具有更高的有效性和可靠性。

关键词: 语义通信, 分层次编译码, 语义层次, 语法层次, 验证系统

Abstract:

Aiming at the problem that most current researches on text semantic communication mainly rely on simulation system for theoretical verification, an extensible hierarchical semantic communication system was proposed by taking advantage of the separation of hierarchical encoding and decoding architecture in semantic level and grammatical level.The system was compatible with the reliable communication technology under the framework of Shannon information through the mode of semantic and syntactic separation, and realized the nested combination of semantic communication and traditional communication.Furthermore, a universal and extensible verification system was built based on the software radio platform to verify the proposed semantic communication system architecture.The verification system took semantic communication software platform as the driving core of hardware drive and algorithm call, integrated the whole process of signal generation, information transmission, data acquisition, decoding and evaluation at the receiving end, and could be further extended for semantic and syntactic level.Finally, the text semantic communication was tested based on this verification system, which verified that it had higher validity and reliability than the traditional communication mode.

Key words: semantic communication, hierarchical codec, semantic level, syntactic level, verification system

中图分类号:

TN914

张聿远, 赵海涛, 魏急波, 曹阔, 张亦弛, 罗鹏, 刘月玲, 梅锴. 可扩展分层次编译码的语义通信系统[J]. 通信学报, 2023, 44(8): 49-60.

Yuyuan ZHANG, Haitao ZHAO, Jibo WEI, Kuo CAO, Yichi ZHANG, Peng LUO, Yueling LIU, Kai MEI. Extensible hierarchical codec semantic communication system[J]. Journal on Communications, 2023, 44(8): 49-60.

图/表 11

图1

图2

表1

图3

图4

图5

图6

图7

图8

图9

表2

2种通信方式的译码文本对比"

不同通信方式	译码文本
原始文本	The Fulton County Grand Jury said Friday an investigation of Atlanta＇s recent primary election produced no evidence that any irregularities took place.
	The jury further said in term-end presentments that the City Executive Committee which had over-all charge of the election deserves the praise and thanks of the City of Atlanta for the manner in which the election was conducted.
传统Huffman通信	$\underline{A m a s k}$ $\underline{A m a s k}$ County Grand Jury said Friday $\underline{a t}$ investigation of $\underline{F u l t o n}$ $\underline{o n}$ primary election produced no evidence that any irregularities took place.
	The jury further said in term-end presentments that the City Executive Committee $\underline{a}$ had over-all $\underline{A m a s k}$ of the election $\underline{l i b r a r i e s}$ the $\underline{h e}$ $\underline{t o}$ thanks of the City of Atlanta for $\underline{A m a s k}$ manner in which the election to conducted.
分层次语义通信	$\underline{w i t h}$ $r o u n d$ County Grand Jury said Friday an investigation of Atlanta＇s recent primary election produced no evidence that any irregularities took place.
	The jury further said in term-end presentments that the City Executive Committee which had over-all charge of the election deserves the praise to thanks of the City of Atlanta for the manner in which the election was conducted.

表2

参考文献 33

[1]	WEAVER W . Recent contributions to the mathematical theory of communication[J]. ETC:A Review of General Semantics, 1953,10(4): 261-281.
[2]	SHANNON C E . A mathematical theory of communication[J]. The Bell System Technical Journal, 1948,27(3): 379-423.
[3]	SUDAN M . Communication amid uncertainty[C]// Proceedings of 2012 IEEE Information Theory Workshop. Piscataway:IEEE Press, 2012: 158-161.
[4]	石光明, 李莹玉, 谢雪梅 . 语义通讯:智能时代的产物[J]. 模式识别与人工智能, 2018,31(1): 91-99.
	SHI G M , LI Y Y , XIE X M . Semantic communications:outcome of the intelligence era[J]. Pattern Recognition and Artificial Intelligence, 2018,31(1): 91-99.
[5]	徐文伟, 张弓, 白铂 ,等. 后香农时代ICT领域的十大挑战问题[J]. 中国科学(数学), 2021,51(7): 1095-1138.
	XU W W , ZHANG G , BAI B ,et al. Ten key ICT challenges in the post-Shannon era[J]. Scientia Sinica (Mathematica), 2021,51(7): 1095-1138.
[6]	张平, 牛凯, 田辉 ,等. 6G 移动通信技术展望[J]. 通信学报, 2019,40(1): 141-148.
	ZHANG P , NIU K , TIAN H ,et al. Technology prospect of 6G mobile communications[J]. Journal on Communications, 2019,40(1): 141-148.
[7]	张亦弛, 张平, 魏急波 ,等. 面向智能体的语义通信:架构与范例[J]. 中国科学(信息科学), 2022,52(5): 907-921.
	ZHANG Y C , ZHANG P , WEI J B ,et al. Semantic communication for intelligent devices:architectures and a paradigm[J]. Scientia Sinica (Informationis), 2022,52(5): 907-921.
[8]	刘传宏, 郭彩丽, 杨洋 ,等. 面向智能任务的语义通信:理论、技术和挑战[J]. 通信学报, 2022,43(6): 41-57.
	LIU C H , GUO C L , YANG Y ,et al. Intelligent task-oriented semantic communications:theory,technology and challenges[J]. Journal on Communications, 2022,43(6): 41-57.
[9]	WENG Z Z , QIN Z J , TAO X M ,et al. Deep learning enabled semantic communications with speech recognition and synthesis[J]. IEEE Transactions on Wireless Communications, 2022:doi.10.1109/TWC.2023.3240969.
[10]	石光明, 肖泳, 李莹玉 ,等. 面向万物智联的语义通信网络[J]. 物联网学报, 2021,5(2): 26-36.
	SHI G M , XIAO Y , LI Y Y ,et al. Semantic communication networking for the intelligence of everything[J]. Chinese Journal on Internet of Things, 2021,5(2): 26-36.
[11]	QIN Z J , TAO X M , LU J H ,et al. Semantic communications:principles and challenges[J]. arXiv Preprint,arXiv:2201.01389, 2022.
[12]	LONG O , JEFF W , XU J ,et al. Training language models to follow instructions with human feedback[J]. arXiv Preprint,arXiv:2203.02155, 2022.
[13]	ZHANG Y C , ZHAO H T , WEI J B ,et al. Context-based semantic communication via dynamic programming[J]. IEEE Transactions on Cognitive Communications and Networking, 2022,8(3): 1453-1467.
[14]	YAO S S , NIU K , WANG S X ,et al. Semantic coding for text transmission:an iterative design[J]. IEEE Transactions on Cognitive Communications and Networking, 2022,8(4): 1594-1603.
[15]	XIE H Q , QIN Z J , LI G Y ,et al. Deep learning enabled semantic communication systems[J]. IEEE Transactions on Signal Processing, 2021,69: 2663-2675.
[16]	XIE H Q , QIN Z J . A lite distributed semantic communication system for Internet of things[J]. IEEE Journal on Selected Areas in Communications, 2021,39(1): 142-153.
[17]	HU H , ZHU X W , ZHOU F H ,et al. One-to-many semantic communication systems:design,implementation,performance evaluation[J]. IEEE Communications Letters, 2022,26(12): 2959-2963.
[18]	WENG Z Z , QIN Z J . Semantic communication systems for speech transmission[J]. IEEE Journal on Selected Areas in Communications, 2021,39(8): 2434-2444.
[19]	HAN T X , YANG Q Q , SHI Z G ,et al. Semantic-preserved communication system for highly efficient speech transmission[J]. IEEE Journal on Selected Areas in Communications, 2023,41(1): 245-259.
[20]	ZHANG Z G , YANG Q Q , HE S B ,et al. Wireless transmission of images with the assistance of multi-level semantic information[C]// Proceedings of 2022 International Symposium on Wireless Communication Systems (ISWCS). Piscataway:IEEE Press, 2022: 1-6.
[21]	HU Q Y , ZHANG G Y , QIN Z J ,et al. Robust semantic communications against semantic noise[C]// Proceedings of 2022 IEEE 96th Vehicular Technology Conference (VTC2022-Fall). Piscataway:IEEE Press, 2022: 1-6.
[22]	XIE H Q , QIN Z J , LI G Y . Task-oriented multi-user semantic communications for VQA[J]. IEEE Wireless Communications Letters, 2022,11(3): 553-557.
[23]	XIE H Q , QIN Z J , TAO X M ,et al. Task-oriented multi-user semantic communications[J]. IEEE Journal on Selected Areas in Communications, 2022,40(9): 2584-2597.
[24]	ZHANG H W , SHAO S , TAO M X ,et al. Deep learning-enabled semantic communication systems with task-unaware transmitter and dynamic data[J]. IEEE Journal on Selected Areas in Communications, 2023,41(1): 170-185.
[25]	DAI J C , WANG S X , TAN K L ,et al. Nonlinear transform source-channel coding for semantic communications[J]. IEEE Journal on Selected Areas in Communications, 2022,40(8): 2300-2316.
[26]	WANG J , WANG S X , DAI J C ,et al. Perceptual learned source-channel coding for high-fidelity image semantic transmission[C]// Proceedings of 2022 IEEE Global Communications Conference. Piscataway:IEEE Press, 2022: 3959-3964.
[27]	WANG S X , DAI J C , LIANG Z J ,et al. Wireless deep video semantic transmission[J]. IEEE Journal on Selected Areas in Communications, 2023,41(1): 214-229.
[28]	XU X D , XIONG H C , WANG Y N ,et al. Knowledge-enhanced semantic communication system with OFDM transmissions[J]. Science China Information Sciences, 2022:doi.10.1007/s11432-022-3624-4.
[29]	JIANG P W , WEN C K , JIN S ,et al. Deep source-channel coding for sentence semantic transmission with HARQ[J]. IEEE Transactions on Communications, 2022,70(8): 5225-5240.
[30]	ZHOU Q Y , LI R P , ZHAO Z F ,et al. Semantic communication with adaptive universal transformer[J]. IEEE Wireless Communications Letters, 2022,11(3): 453-457.
[31]	PAPINENI K , ROUKOS S , WARD T ,et al. BLEU:a method for automatic evaluation of machine translation[C]// Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. Stroudsburg:ACL Press, 2002: 311-318.
[32]	BANERJEE S , LAVIE A . METEOR:an automatic metric for MT evaluation with improved correlation with human judgments[C]// Proceedings of 2005 ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization. Stroudsburg:ACL Press, 2005: 65-72.
[33]	DEVLIN J , CHANG M W , LEE K ,et al. BERT:pre-training of deep bidirectional transformers for language understanding[C]// Proceedings of 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies (NAACL-HLT). Stroudsburg:NAACL Press, 2019: 4171-4186.

序号	名词类n	动词类v	形容词类a	其他类o	叶子节点权重
⋮	⋮	⋮	⋮	⋮	⋮
i	(boy, 1054)	(be, 6374)	(own, 750)	(and, 28850)	37028
i+1	(news, 973)	(are, 4394)	(good, 732)	(to, 26154)	32253
⋮	⋮	⋮	⋮	⋮	⋮

可扩展分层次编译码的语义通信系统

Extensible hierarchical codec semantic communication system

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献 33

相关文章 10

Metrics

推荐阅读 0

[1]	罗鹏, 刘月玲, 张聿远, 曹阔, 赵海涛, 魏急波. 高效融合全局和局部上下文特征的语义通信系统[J]. 通信学报, 2023, 44(7): 14-25.
[2]	李荣鹏, 汪丙炎, 张宏纲, 赵志峰. 知识增强的语义通信接收端设计[J]. 通信学报, 2023, 44(6): 70-76.
[3]	秦志金, 赵菼菼, 李凡, 陶晓明. 多模态语义通信研究综述[J]. 通信学报, 2023, 44(5): 28-41.
[4]	石光明, 杨旻曦, 高大化, 柴靖轩. 面向语义信息直传的通信架构[J]. 通信学报, 2023, 44(5): 15-27.
[5]	张平, 牛凯, 姚圣时, 戴金晟. 面向未来的语义通信：基本原理与实现方法[J]. 通信学报, 2023, 44(5): 1-14.
[6]	张平, 戴金晟, 张育铭, 王思贤, 秦晓琦, 牛凯. 面向语义通信的非线性变换编码[J]. 通信学报, 2023, 44(4): 1-14.
[7]	江沸菠, 彭于波, 董莉. 面向6G的深度图像语义通信模型[J]. 通信学报, 2023, 44(3): 198-208.
[8]	张海君, 陈安琪, 李亚博, 隆克平. 6G移动网络关键技术[J]. 通信学报, 2022, 43(7): 189-202.
[9]	刘传宏, 郭彩丽, 杨洋, 陈九九, 朱美逸, 孙鲁楠. 面向智能任务的语义通信：理论、技术和挑战[J]. 通信学报, 2022, 43(6): 41-57.
[10]	刘传宏, 郭彩丽, 杨洋, 冯春燕, 孙启政, 陈九九. 人工智能物联网中面向智能任务的语义通信方法[J]. 通信学报, 2021, 42(11): 97-108.