通信学报 ›› 2023, Vol. 44 ›› Issue (5): 42-51.doi: 10.11959/j.issn.1000-436x.2023099

• 专题:多/跨模态语义通信 • 上一篇    下一篇

面向机器识别-人类感知的联合振动触觉编码

房颖, 徐艺文, 赵铁松   

  1. 福州大学福建省媒体信息智能处理与无线传输重点实验室,福建 福州 350001
  • 修回日期:2023-04-18 出版日期:2023-05-25 发布日期:2023-05-01
  • 作者简介:房颖(1981- ),女,福建福州人,博士,福州大学讲师,主要研究方向为多媒体通信、计算机触觉
    徐艺文(1976- ),男,福建漳州人,博士,福州大学教授、硕士生导师,主要研究方向为媒体信息智能处理与传输
    赵铁松(1984- ),男,河北衡水人,博士,福州大学教授、博士生导师,主要研究方向为多媒体通信、计算机视觉、计算机触觉等
  • 基金资助:
    国家自然科学基金资助项目(62171134);福建省自然科学基金资助项目(2022J02015)

Joint vibrotactile coding for machine recognition and human perception

Ying FANG, Yiwen XU, Tiesong ZHAO   

  1. Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, Fuzhou University, Fuzhou 350001, China
  • Revised:2023-04-18 Online:2023-05-25 Published:2023-05-01
  • Supported by:
    The National Natural Science Foundation of China(62171134);The Natural Science Foundation of Fujian Province(2022J02015)

摘要:

为了精确地传输信号内容含义,实现智能识别与信号重建,针对振动触觉信号,提出了一种面向机器识别-人类感知的联合编码方案。在编码端,将三维振动信号转化为一维信号,采用短时傅里叶变换提取信号的语义信息,并实现语义信息高效压缩与表征。在解码端,基于语义信息采用全卷积神经网络实现触觉的智能识别;同时,将原始信号与基于语义信息的重构信号的残差值作为语义信息的补偿,逐步提高重构信号的质量,满足人类感知需求。实验结果表明,所提方案用较低比特率的语义信息实现触觉识别,同时在满足人类感知需求情况下,触觉数据的压缩效率有所提高。

关键词: 触觉, 语义信息, 感知质量, 联合编码, 智能识别, 振动触觉

Abstract:

In order to accurately transmit the content meaning of vibrotactile signals and achieve intelligent recognition and signal reconstruction, a joint vibrotactile coding scheme for machine recognition and human perception was proposed.At the encoding end, the original three-dimensional vibrotactile signals were converted into one-dimensional signals.Then the semantic information of the signals was extracted using a short-time Fourier transform before being effectively compressed and transmitted.At the decoding end, a fully convolutional neural network was used to intelligently recognize based on the semantic information.The difference between the original signals and the reconstructed signals based on semantic information was used as compensation for the semantic information, and the quality of the reconstructed signals was gradually improved to meet human perceptual needs.The experimental results show that the proposed scheme achieve tactile recognition with semantic information at a lower bit rate while improving the compression efficiency of tactile data, thus satisfying human perceptual needs.

Key words: haptic, semantic information, perceptual quality, joint coding, intelligent recognition, vibrotactile

中图分类号: 

No Suggested Reading articles found!