通信学报 ›› 2024, Vol. 45 ›› Issue (1): 152-166.doi: 10.11959/j.issn.1000-436x.2024015
• 学术论文 • 上一篇
唐述, 杨鹏, 谢显中, 周广义, 李佳庆, 赵瑜
修回日期:
2023-07-03
出版日期:
2024-01-01
发布日期:
2024-01-01
作者简介:
唐述(1981- ),男,重庆人,博士,重庆邮电大学副教授、博士生导师,主要研究方向为信号处理、图像无线传输、计算机视觉等基金资助:
Shu TANG, Peng YANG, Xianzhong XIE, Guangyi ZHOU, Jiaqing LI, Yu ZHAO
Revised:
2023-07-03
Online:
2024-01-01
Published:
2024-01-01
Supported by:
摘要:
提出了一种新颖的混合数模无线传输方法来实现高质量的图像传输。首先,从原始图像中减去先下采样后上采样的图像来得到残差层图像。其次,提出了一种自适应聚类的块分级离散余弦变换算法来有效去除残差层图像像素之间的相关性。最后,提出了一种基于图像块等级的不等功率分配策略来进一步提升接收端的图像质量。大量的实验结果表明,所提方法在定性评估和定量度量两方面都明显优于现有较成功的混合数模图像无线传输方法。
中图分类号:
唐述, 杨鹏, 谢显中, 周广义, 李佳庆, 赵瑜. 自适应聚类的图像块分级DCT混合数模无线传输方法[J]. 通信学报, 2024, 45(1): 152-166.
Shu TANG, Peng YANG, Xianzhong XIE, Guangyi ZHOU, Jiaqing LI, Yu ZHAO. Adaptive-clustered image-block hierarchical DCT hybrid digital-analog wireless transmission method[J]. Journal on Communications, 2024, 45(1): 152-166.
表2
不同信道噪声环境与带宽条件下,100幅自然图像的平均PSNR和平均SSIM"
Bw | 方法 | SNR=0 | SNR=5 dB | SNR=10 dB | SNR=15 dB | SNR=20 dB | SNR=25 dB | SNR=30 dB | |||||||||||||
PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | ||||||||
1.00 | 本文方法 | 29.13 | 0.769 9 | 32.92 | 0.879 4 | 37.38 | 0.948 2 | 42.05 | 0.980 4 | 47.03 | 0.993 0 | 51.95 | 0.997 2 | 56.93 | 0.998 7 | ||||||
BlockSoftCast | 27.04 | 0.716 2 | 30.75 | 0.837 6 | 35.14 | 0.9242 | 39.90 | 0.970 4 | 44.80 | 0.989 4 | 49.78 | 0.996 3 | 54.76 | 0.998 7 | |||||||
LayerdSoftCast | 28.05 | 0.709 9 | 31.71 | 0.833 6 | 36.08 | 0.922 5 | 40.82 | 0.9696 | 45.73 | 0.989 0 | 50.69 | 0.995 8 | 55.69 | 0.998 2 | |||||||
SoftCast | 24.87 | 0.694 3 | 28.84 | 0.817 8 | 33.25 | 0.910 4 | 38.05 | 0.963 6 | 42.97 | 0.9868 | 47.88 | 0.995 2 | 52.90 | 0.998 2 | |||||||
SoftCast-IDCT | 29.07 | 0.769 8 | 32.88 | 0.879 3 | 37.01 | 0.947 8 | 41.77 | 0.980 1 | 46.67 | 0.992 0 | 51.78 | 0.997 1 | 56.59 | 0.998 3 | |||||||
EV-SoftCast | 28.87 | 0.769 7 | 32.64 | 0.879 0 | 37.05 | 0.947 8 | 41.51 | 0.978 1 | 46.45 | 0.991 8 | 51.59 | 0.997 0 | 56.40 | 0.998 2 | |||||||
0.75 | 本文方法 | 29.06 | 0.766 7 | 32.70 | 0.875 1 | 36.65 | 0.936 1 | 40.28 | 0.960 1 | 43.02 | 0.977 8 | 44.73 | 0.981 5 | 45.52 | 0.982 5 | ||||||
BlockSoftCast | 26.98 | 0.710 2 | 30.54 | 0.827 2 | 34.37 | 0.909 0 | 37.80 | 0.951 8 | 40.24 | 0.969 3 | 41.59 | 0.975 5 | 42.18 | 0.977 5 | |||||||
LayerdSoftCast | 27.98 | 0.706 9 | 31.40 | 0.826 3 | 35.03 | 0.909 5 | 38.12 | 0.952 2 | 40.18 | 0.969 1 | 41.25 | 0.974 9 | 41.69 | 0.976 9 | |||||||
SoftCast | 24.79 | 0.689 6 | 28.63 | 0.808 8 | 32.67 | 0.897 1 | 36.30 | 0.945 7 | 39.04 | 0.966 3 | 40.66 | 0.973 7 | 41.45 | 0.976 1 | |||||||
SoftCast-IDCT | 28.66 | 0.766 2 | 32.31 | 0.874 2 | 36.35 | 0.935 8 | 39.98 | 0.959 7 | 42.74 | 0.977 6 | 44.49 | 0.981 1 | 45.14 | 0.982 0 | |||||||
EV-SoftCast | 28.59 | 0.766 4 | 32.19 | 0.874 0 | 36.18 | 0.935 5 | 39.76 | 0.959 4 | 42.59 | 0.977 5 | 44.20 | 0.979 8 | 44.96 | 0.981 8 | |||||||
0.50 | 本文方法 | 28.93 | 0.754 5 | 32.25 | 0.854 1 | 35.33 | 0.911 6 | 37.59 | 0.937 4 | 38.82 | 0.946 5 | 39.33 | 0.949 6 | 39.52 | 0.950 7 | ||||||
BlockSoftCast | 26.84 | 0.697 9 | 29.97 | 0.806 6 | 32.84 | 0.880 8 | 34.77 | 0.918 4 | 35.71 | 0.933 0 | 36.08 | 0.938 2 | 36.20 | 0.939 9 | |||||||
LayerdSoftCast | 27.79 | 0.698 1 | 30.80 | 0.812 2 | 33.46 | 0.887 7 | 35.18 | 0.924 6 | 35.99 | 0.938 9 | 36.30 | 0.943 6 | 36.41 | 0.945 2 | |||||||
SoftCast | 24.70 | 0.6824 | 28.34 | 0.795 1 | 31.69 | 0.875 1 | 34.13 | 0.918 0 | 35.52 | 0.935 3 | 36.12 | 0.941 5 | 36.33 | 0.943 5 | |||||||
SoftCast-IDCT | 28.79 | 0.754 3 | 32.01 | 0.853 9 | 35.11 | 0.911 3 | 37.27 | 0.937 0 | 38.53 | 0.946 1 | 39.01 | 0.949 2 | 39.19 | 0.9504 | |||||||
EV-SoftCast | 28.55 | 0.754 1 | 31.77 | 0.853 7 | 35.05 | 0.911 3 | 36.96 | 0.936 3 | 38.21 | 0.945 7 | 38.78 | 0.949 0 | 39.01 | 0.950 3 | |||||||
0.25 | 本文方法 | 28.47 | 0.724 2 | 30.90 | 0.806 8 | 32.56 | 0.851 1 | 33.37 | 0.869 8 | 33.67 | 0.876 1 | 33.76 | 0.878 1 | 33.82 | 0.878 8 | ||||||
BlockSoftCast | 26.30 | 0.668 7 | 28.51 | 0.760 8 | 29.93 | 0.819 4 | 30.58 | 0.846 4 | 30.82 | 0.856 8 | 30.90 | 0.860 3 | 30.93 | 0.861 4 | |||||||
LayerdSoftCast | 27.30 | 0.680 8 | 29.38 | 0.777 4 | 30.71 | 0.837 0 | 31.31 | 0.863 8 | 31.53 | 0.874 0 | 31.60 | 0.877 2 | 31.63 | 0.878 3 | |||||||
SoftCast | 24.45 | 0.6639 | 27.48 | 0.762 8 | 29.71 | 0.827 8 | 30.87 | 0.859 0 | 31.35 | 0.870 7 | 31.53 | 0.874 7 | 31.58 | 0.876 0 | |||||||
SoftCast-IDCT | 28.22 | 0.724 0 | 30.56 | 0.806 4 | 32.23 | 0.850 8 | 33.09 | 0.869 7 | 33.33 | 0.875 8 | 33.42 | 0.877 8 | 33.49 | 0.878 4 | |||||||
EV-SoftCast | 28.10 | 0.723 9 | 30.39 | 0.806 3 | 32.10 | 0.850 7 | 32.87 | 0.869 5 | 33.09 | 0.875 6 | 33.19 | 0.877 6 | 33.29 | 0.878 3 |
表3
不同信道噪声环境以及带宽受限的条件下,48幅遥感图像的平均PSNR"
方法 | 平均PSNR | ||||
SNR=5 dB | SNR=10 dB | SNR=15 dB | SNR=20 dB | SNR=25 dB | |
本文方法 | 33.77 | 37.79 | 41.49 | 44.12 | 45.47 |
ComPaTS | 32.22 | 36.68 | 40.35 | 42.57 | 43.95 |
BlockSoftCast | 32.91 | 36.68 | 39.92 | 41.95 | 42.89 |
LayerdSoftCast | 32.25 | 34.88 | 36.57 | 37.33 | 37.61 |
SoftCast | 29.79 | 33.20 | 35.72 | 37.04 | 37.58 |
SoftCast-IDCT | 33.59 | 37.60 | 41.22 | 44.01 | 45.24 |
EV-SoftCast | 33.31 | 37.41 | 41.09 | 43.89 | 45.09 |
表4
不同方法的计算时间"
方法 | 计算时间/s | |||||
第1次 | 第2次 | 第3次 | 第4次 | 第5次 | 平均 | |
本文方法 | 0.377 | 0.447 | 0.379 | 0.378 | 0.388 | 0.394 |
BlockSoftCast | 0.520 | 0.513 | 0.530 | 0.537 | 0.515 | 0.523 |
LayerdSoftCast | 0.227 | 0.225 | 0.222 | 0.228 | 0.229 | 0.226 |
SoftCast | 0.198 | 0.183 | 0.176 | 0.177 | 0.176 | 0.182 |
SoftCast-IDCT | 0.490 | 0.501 | 0.515 | 0.506 | 0.485 | 0.4994 |
EV-SoftCast | 0.202 | 0.209 | 0.201 | 0.198 | 0.211 | 0.2042 |
[1] | WIEGAND T , SULLIVAN G J , BJONTEGAARD G ,et al. Overview of the H.264/AVC video coding standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003,13(7): 560-576. |
[2] | STOCKHAMMER T , HANNUKSELA M M , WIEGAND T . H.264/AVC in wireless environments[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003,13(7): 657-673. |
[3] | SULLIVAN G J , OHM J R , HAN W J ,et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1649-1668. |
[4] | KATABI D , RAHUL H , JAKUBCZAK S . SoftCast:one video to serve all wireless receivers[C]// Proceedings of the Eighth ACM Sigcomm HotNets Workshop. New York:ACM Press, 2009: 1-6. |
[5] | JAKUBCZAK S , KATABI D . One-size-fits-all wireless video[J]. ACM Sigcomm Computer Communication Review, 2010,40(4): 449-450. |
[6] | LAN C L , LUO C , ZENG W J ,et al. A practical hybrid digital-analog scheme for wireless video transmission[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018,28(7): 1634-1647. |
[7] | ZHAO J , XIE J Y , XIONG R Q . Residual signals modeling for layered image/video SoftCast with hybrid digital-analog transmission[C]// Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP). Piscataway:IEEE Press, 2018: 3284-3288. |
[8] | YU L , LI H Q , LI W P . Wireless scalable video coding using a hybrid digital-analog scheme[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014,24(2): 331-345. |
[9] | WANG Y D , ALAJAJI F , LINDER T . Design of VQ-based hybrid digital-analog joint source-channel codes for image communication[C]// Proceedings of the Data Compression Conference. Piscataway:IEEE Press, 2005: 193-202. |
[10] | KOZINTSEV I , RAMCHANDRAN K . A wavelet zerotree-based hybrid compressed/uncompressed framework for wireless image transmission[C]// Proceedings of the Conference Record of the Thirty-First Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2002: 1023-1027. |
[11] | SONG Z H , XIONG R Q , MA S W ,et al. Layered image/video SoftCast with hybrid digital-analog transmission for robust wireless visual communication[C]// Proceedings of the 2014 IEEE International Conference on Multimedia and Expo (ICME). Piscataway:IEEE Press, 2014: 1-6. |
[12] | PRABHAKARAN V M , PURI R , RAMCHANDRAN K . Hybrid digital-analog codes for source-channel broadcast of Gaussian sources over Gaussian channels[J]. IEEE Transactions on Information Theory, 2011,57(7): 4573-4588. |
[13] | CUI H , SONG Z H , YANG Z ,et al. Cactus:a hybrid digital-analog wireless video communication system[C]// Proceedings of the 16th ACM International Conference on Modeling,Analysis & Simulation of Wireless and Mobile Systems. New York:ACM Press, 2013: 273-278. |
[14] | YU L , LI H Q , LI W P . Hybrid digital-analog scheme for video transmission over wireless[C]// Proceedings of the 2013 IEEE International Symposium on Circuits and Systems (ISCAS). Piscataway:IEEE Press, 2013: 1163-1166. |
[15] | TUNG T Y , GüNDüZ D . SparseCast:hybrid digital-analog wireless image transmission exploiting frequency-domain sparsity[J]. IEEE Communications Letters, 2018,22(12): 2451-2454. |
[16] | ZHANG J , WANG A H , LIANG J ,et al. Distortion estimation-based adaptive power allocation for hybrid digital–analog video transmission[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019,29(6): 1806-1818. |
[17] | SCHIERL T , HANNUKSELA M M , WANG Y K ,et al. System layer integration of high efficiency video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1871-1884. |
[18] | WU F , LI S P , ZHANG Y Q . A framework for efficient progressive fine granularity scalable video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2001,11(3): 332-344. |
[19] | SCHWARZ H , MARPE D , WIEGAND T.Overview of the scalable video coding extension of the H . 264/AVC standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007,17(9): 1103-1120. |
[20] | JAKUBCZAK S , KATABI D . A cross-layer design for scalable mobile video[C]// Proceedings of the 17th Annual International Conference on Mobile Computing and Networking. New York:ACM Press, 2011: 289-300. |
[21] | SONG X D , PENG X L , XU J Z ,et al. Distributed compressive sensing for cloud-based wireless image transmission[J]. IEEE Transactions on Multimedia, 2017,19(6): 1351-1364. |
[22] | YAMI A S , HADIZADEH H . Visual attention-driven wireless multicasting of images using adaptive compressed sensing[C]// Proceedings of the 2017 Artificial Intelligence and Signal Processing Conference (AISP). Piscataway:IEEE Press, 2017: 37-42. |
[23] | TRIOUX A , COUDOUX F X , CORLAY P ,et al. A reduced complexity/side information preprocessing method for high quality SoftCastbased video delivery[C]// Proceedings of the 2019 8th European Workshop on Visual Information Processing (EUVIP). Piscataway:IEEE Press, 2019: 205-210. |
[24] | TRIOUX A , COUDOUX F X , CORLAY P ,et al. A comparative preprocessing study for SoftCast video transmission[C]// Proceedings of the 2018 9th International Symposium on Signal,Image,Video and Communications (ISIVC). Piscataway:IEEE Press, 2018: 54-59. |
[25] | ZHANG T C , MAO S W . Metadata reduction for soft video delivery[J]. IEEE Networking Letters, 2019,1(2): 84-88. |
[26] | YANG T H , LUO L , ZHU C ,et al. Block DCT based optimization for wireless SoftCast of depth map[J]. IEEE Access, 2019,7: 29484-29494. |
[27] | KANJ H , TRIOUX A , COUDOUX F X ,et al. A comparative study of the whitening methods in linear video coding and transmission schemes[C]// Proceedings of the 11th International Symposium on Signal,Image,Video and Communications (ISIVC). Piscataway:IEEE Press, 2022: 1-6. |
[28] | LU Q J , LU H C , YANG X Y ,et al. MDUcast:multi-device uplink uncoded video transmission in Internet of video things[C]// Proceedings of the 2023 IEEE Wireless Communications and Networking Conference (WCNC). Piscataway:IEEE Press, 2023: 1-6. |
[29] | WU J J , CHENG B P , LUO L ,et al. Efficient video SoftCast for intelligent reflective surfaces assisted symbiotic radio network[C]// Proceedings of the 2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). Piscataway:IEEE Press, 2023: 1-3. |
[30] | XIONG R Q , LIU H F , MA S W ,et al. G-CAST:gradient based image SoftCast for perception-friendly wireless visual communication[C]// Proceedings of the 2014 Data Compression Conference. Piscataway:IEEE Press, 2014: 133-142. |
[31] | LIU H F , XIONG R Q , FAN X P ,et al. CG-cast:scalable wireless image SoftCast using compressive gradient[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019,29(6): 1832-1843. |
[32] | TANG X W , HUANG X L , HU F ,et al. Human-perception-oriented pseudo analog video transmissions with deep learning[J]. IEEE Transactions on Vehicular Technology, 2020,69(9): 9896-9909. |
[33] | TRIOUX A , VALENZISE G , CAGNAZZO M ,et al. A perceptual study of the decoding process of the SoftCast wireless video broadcast scheme[C]// Proceedings of the 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP). Piscataway:IEEE Press, 2021: 1-6. |
[34] | HUANG X L , WU J , HU F . Knowledge-enhanced mobile video broadcasting framework with cloud support[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2017,27(1): 6-18. |
[35] | LUO L , YANG T H , ZHU C ,et al. Joint texture/depth power allocation for 3-D video SoftCast[J]. IEEE Transactions on Multimedia, 2019,21(12): 2973-2984. |
[36] | THABET S K S , OSEI-MENSAH E , AHMED O ,et al. Resource optimization for 3D video SoftCast with joint texture/depth power allocation[J]. Applied Sciences, 2022,12(10): 5047. |
[37] | THABET S K S , OSEI-MENSAH E , HASSAN J N A , et al . Low complexity joint power and bandwidth allocation for 3D video SoftCast[C]// Proceedings of the 2022 4th International Conference on Computer Communication and the Internet (ICCCI). Piscataway:IEEE Press, 2022: 136-141. |
[38] | WANG Y L , LU H C , LI Z X ,et al. Robust satellite image transmission over bandwidth-constrained wireless channels[C]// Proceedings of the 2017 IEEE International Conference on Communications (ICC). Piscataway:IEEE Press, 2017: 1-6. |
[39] | GUI Y Q , LU H C , JIANG X D ,et al. Compressed pseudo-analog transmission system for remote sensing images over bandwidth-constrained wireless channels[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020,30(9): 3181-3195. |
[40] | XIONG R Q , WU F , XU J Z ,et al. Analysis of decorrelation transform gain for uncoded wireless image and video communication[J]. IEEE Transactions on Image Processing, 2016,25(4): 1820-1833. |
[41] | 张平, 戴金晟, 张育铭 ,等. 面向语义通信的非线性变换编码[J]. 通信学报, 2023,44(4): 1-14. |
ZHANG P , DAI J S , ZHANG Y M ,et al. Nonlinear transform coding for semantic communications[J]. Journal on Communications, 2023,44(4): 1-14. | |
[42] | 石光明, 杨旻曦, 高大化 ,等. 面向语义信息直传的通信架构[J]. 通信学报, 2023,44(5): 15-27. |
SHI G M , YANG M X , GAO D H ,et al. Communication framework for directed transmission of informative semantic[J]. Journal on Communications, 2023,44(5): 15-27. | |
[43] | 吕品, 李凯, 许嘉 ,等. 无人驾驶汽车协同感知信息传输负载优化技术[J]. 计算机学报, 2021,44(10): 1984-1997. |
LYU P , LI K , XU J ,et al. Cooperative sensing information transmission load optimization for automated vehicles[J]. Chinese Journal of Computers, 2021,44(10): 1984-1997. | |
[44] | 王崴, 王晓军, 刘晓卫 ,等. 基于图像复杂度的图像分割算法[J]. 探测与控制学报, 2015,37(3): 5-9. |
WANG W , WANG X J , LIU X W ,et al. Image segmentation algorithm based on image complexity[J]. Journal of Detection & Control, 2015,37(3): 5-9. |
[1] | 郭芬红,熊昌镇. 全相位双正交离散Tchebichef变换图像编码与重构算法[J]. 通信学报, 2010, 31(8A): 17-25. |
[2] | 高琦,李人厚,刘连山. 基于帧间相关性的盲视频数字水印算法[J]. 通信学报, 2006, 27(6): 43-48. |
[3] | 欧世峰,赵晓晖,,顾海军. 基于DCT与维纳滤波的单通道语音增强算法[J]. 通信学报, 2006, 27(10): 86-93. |
[4] | 李毅,阮秋琦. 应用支持向量机的纹理分类[J]. 通信学报, 2005, 26(1): 114-119. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||
|