基于3D混合树和视觉特性的视频可分级编码算法

doi:10.3969/j.issn.1000-436x.2012.11.013

通信学报 ›› 2012, Vol. 33 ›› Issue (11): 100-107.doi: 10.3969/j.issn.1000-436x.2012.11.013

基于3D混合树和视觉特性的视频可分级编码算法

付明哲¹,王相海^1,²,宋传鸣¹

¹ 辽宁师范大学计算机与信息技术学院，辽宁大连 116029
² 智能计算与信息处理教育部重点实验室，湖南湘潭 411105

出版日期:2012-11-25 发布日期:2017-07-25
基金资助:
国家自然科学基金资助项目;辽宁省自然科学基金资助项目;辽宁省博士科研启动基金资助项目;计算机软件新技术国家重点实验室开放基金资助项目;计算机软件新技术国家重点实验室开放基金资助项目;南京邮电大学图像处理与图像通信江苏省重点实验室开放基金资助项目;南京邮电大学图像处理与图像通信江苏省重点实验室开放基金资助项目;苏州大学江苏省计算机信息处理技术重点实验室开放课题基金资助项目;智能计算与信息处理教育部重点实验室（湘潭大学）开放课题基金资助项目

Scalable video coding algorithm based on 3D hybrid tree and visual characteristics

Ming-zhe FU¹,Xiang-hai WANG^1,²,Chuan-ming SONG¹

¹ College of Computer and Information Technology,Liaoning Normal University,Dalian 116029,China
² State Key Laboratory for Smart Computing and Information Processing,Xiangtan 411105,China

Online:2012-11-25 Published:2017-07-25
Supported by:
The National Natural Science Foundation of China;The Natural Science Foundation of Liaoning Province;The Scientific Research Foundation for PhD of Liaoning Province;The Open Foundation of State Key Laboratory for Novel Software Technology of Nanjing University;The Open Foundation of State Key Laboratory for Novel Software Technology of Nanjing University;The Jiangsu Key Laboratory’s Open Foundation of Image Processing and Image Communication of Nanjing University of Posts ＆ Telecommunications;The Jiangsu Key Laboratory’s Open Foundation of Image Processing and Image Communication of Nanjing University of Posts ＆ Telecommunications;The Jiangsu Key Laboratory’s Open Foundation of Computer Information Processing Technology of Soochow University;The Open Project Program of Key Laboratory of Intelligent Computing ＆ Information Processing of Ministry of Education,Xiangtan University

摘要/Abstract

摘要：

分析了视频数据的3D小波系数分布特性，提出了一种基于混合3D树型结构和HVS特性的视频可分级编码算法。首先，依据小波低、高频系数的自相关性，确定相应的树型结构来扫描和处理时间维上的低、高频系数，明显减少了用于定位重要系数的同步信息；其次，依据人类视觉系统对各频率子带敏感程度的不同，对各子带系数进行加权，使得重构视频的重要系数得以排在码流前端，从而在很大程度上提高了中低码率下视频的重构质量。对多种标准测试视频的仿真实验验证了本文算法的有效性，与非对称树型结构编码方案和单一时空方向树结构方案相比，该算法解码图像的Y、U和V 3个分量的均峰值信噪比分别高出0.65dB、1.75dB、1.77dB和0.23dB、2.11dB、1.72dB。此外，算法有效抑制了振铃效应，并获得了更好的主观效果。

关键词: 视频编码, 混合树结构, 3D小波变换, 零树, 人类视觉系统

Abstract:

The distribution characteristic of three-dimensional wavelet coefficients of video data was ana ed,and a scalable video coding algorithm was subsequently addressed based on hybrid three-dimensional tree and human visual system (HVS) characteristics.First,the hybrid tree structure was adaptively determined according to the auto-correlation of low-pass and high-pass coefficients.It reduced obviously the number of ion bits locating significant wavelet coefficients when scanning and processing low-pass and high-pass coefficients in temporal dimension.Second,each wavelet coefficient was weighted in terms of HVS sensitivity to its corresponding subband.Significant coefficients thus tended to be coded with high priority and arranged at the front of bitstream,and the reconstructed video quality was improved at low and medium bitrates to a great extent.Experimental results in terms of peak signal-to-noise ratio (PSNR) verified the effectiveness of the proposed algorithm on several test videos with varying characteristics.0.65dB,1.75dB,and 1.77dB higher PSNR are gained than asymmetric 3-D orientation tree for Y,U,and V components,respectively.Moreover,0.23dB,2.11dB,and 1.72dB higher PSNR are reached than single temporal-spatial orientation tree separately for Y,U,and V components.Besides,better subjective quality is obtained through effectively attenuating ringing artifact.

Key words: video coding, hybrid tree structure, 3D wavelet transform, zerotree, human visual system

付明哲,王相海,宋传鸣. 基于3D混合树和视觉特性的视频可分级编码算法[J]. 通信学报, 2012, 33(11): 100-107.

Ming-zhe FU,Xiang-hai WANG,Chuan-ming SONG. Scalable video coding algorithm based on 3D hybrid tree and visual characteristics[J]. Journal on Communications, 2012, 33(11): 100-107.

图/表 9

图1

图2

图3

表1

图4

图5

表2

表3

表4

参考文献 22

[1]	SCHWARZ H , MARPE D , WIEGAND T.Overview of the scalable video coding extension of the H . 264/AVC standard[J]. I E Trans on Circuits and Syst for Video Technol, 2007,17(9): 1103-1120.
[2]	王相海 . 视频细粒度可分级编码研究进展[J]. 计算机科学, 2006,33(7): 75-80. WANG X H . Research progress on fine granularity scalability video coding[J]. Computer Science, 2006,33(7): 75-80.
[3]	王相海, 宋传鸣 . 图像及视频可分级编码[M]. 北京: 科学出版社, 2009. WANG X H , SONG C M . Image and Video Scalable Coding[M]. Beijing: Science PressPress, 2009.
[4]	DAS A , HAZRA A , BANERJEE S . An efficient architecture for 3-D discrete wavelet transform[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(2): 286-296.
[5]	KIM B , XIONG Z , PEARLMAN W A . Low bit rate,scalable video coding with 3-D set partitioning in hierarchical trees(3-D SPIHT)[J]. IEEE Trans on Circuits and Syst for Video Technol, 2000,10(12): 1374-1387.
[6]	丁文奇, 胡佳, 张立明 . 充分减小树间冗余的优化三维 VSPIHT 视频编码方法[J]. 计算机辅助设计与图形学学报, 2005,17(3): 563-569. DING W Q , HU J , ZHANG L M . Optimal 3D-SPIHT video coding method by reducing redundancy between tress[J]. Journal of Computer-Aided Design ＆ Computer Graphics, 2005,17(3): 563-569.
[7]	CHENG C C , PENG G J , HWANG W L . Subband weighting with pixel connectivity for 3-D wavelet coding[J]. IEEE Trans on Image Process, 2009,18(1): 52-62.
[8]	WANG H M , PAN X Z . Video compression coding based on the improved 3D-SPIHT[A]. 2010 International Conference on Computer Application and System Modeling (ICCASM)[C]. Taiyuan,China, 2010.108-111.
[9]	. ISO/IEC JTC 1/SC 29/WG 11.Wavelet Video Coding – an Overview:w7824[R]. MPEG 2006.
[10]	ISO/IEC JTC 1/SC 29/WG 11.Status Report on Wavelet Video Coding Exploration:N7822[R]. MPEG 2006.
[11]	宋传鸣 . 基于多尺度分析的视频可分级编码技术研究[D]. 南京:南京大学, 2010. SONG C M . Research on Scalable Video Coding Based on Multiscale Analysis[D]. Nanjing:Nanjing University, 2010.
[12]	SHAPIRO J . Embedded image coding using zerotree of wavelet coefficients[J]. IEEE Trans on Signal Process, 1993,41(12): 3445-3462.
[13]	SAID A , PEARLMAN W A . A new,fast,and efficient image codec based on set partitioning in hierarchical trees[J]. IEEE Tra on Circuits and Syst for Video Technol, 1996,6(3): 243-250.
[14]	张宗平, 刘贵忠, 侯兴松 . 一种改进的三维小波视频编码[J]. 西安交通大学学报, 2001,35(6): 595-599. ZHANG Z P , LIU G Z , HOU X S . Improved 3D-wavelet video coder[J]. Journal of Xi’an Jiaotong University, 2001,35(6): 595-599.
[15]	HE C , DONG , ZHENG , GAO Z . Optimal 3-D coefficient tree structure for 3-D wavelet video coding[J]. IEEE Trans on Circuits Syst and Video Technol, 2003,13(10): 61-972.
[16]	KHAN E , GHANBARI M . Very low bit rate video coding using virtual SPIHT[J]. IEE Electronic Letters, 2001,37(1): 40-41.
[17]	ZHANG L , WANG D , VINCENT A . Decoupled 3-D zerotree structure for wavelet-based video coding[J]. IEEE Trans on Broadcasting, 2008,54(3): 430-436.
[18]	KASSIM A A , TAN E H , LEE W S . 3D color set partitioning in hierarchical trees[J]. Circuits Syst Signal Process, 2009,28: 41-53.
[19]	MOINUDDIN A A , KHAN E , GHANBARI M . The impact of tree structures on the performance of zerotree-based wavelet video codecs[J]. Signal Processing:Image Communication, 2010,25(3): 179-195.
[20]	姚庆栋, 毕厚杰, 王兆华 ,等. 图像编码基础[M]. 北京: 清华大学出版社, 2006. YAO Q D , BI H J , WANG Z H ,et al. Fundamentals of Image Coding[M]. Beijing: Tsinghua University PressPress, 2006.
[21]	李玲, 王向阳 . 基于视觉敏感特性的小波域图像编码算法研究[J]. 小型微型计算机系统, 2010,31(4): 780-783. LI L , WANG X Y . New image coding algorithm contrast sensitivity[J]. Mini-MicroSystems, 2010,31(4): 780-783.
[22]	BEEGANA P . Wavelet-based image compression using human visual system models[A]. Electrical Engineering Department of Virginia Polytechnic Institute[C]. Virginia,USA, 2001.

	LL	LH	HL	HH
粗尺度层（3层）	3.500	5.300	5.300	7.200
2层	——	4.740	4.740	3.750
细尺度层（1层）	——	2.330	2.330	1.000

视频序列	码率/(kbit·s^-1)			PSNR/dB
			文献[15]方法			本文方法
		Y	U	V	Y	U	V
	128	30.920	36.460	38.820	31.500	38.020	40.130
Hall Monitor	256	34.580	37.500	39.570	35.930	39.150	41.240
	512	37.350	38.710	40.800	38.530	39.880	42.020
	128	40.040	38.380	40.500	40.510	39.280	42.030
Miss America	256	40.590	38.750	41.070	42.000	39.750	43.130
	512	42.330	40.270	42.570	43.030	40.780	43.760
	128	35.400	40.680	41.330	35.740	42.600	42.610
Mother ＆ Daughter	256	38.740	42.470	43.600	38.930	44.870	45.060
	512	41.540	44.560	45.550	41.880	46.430	47.090
	128	36.730	39.410	40.610	37.480	41.890	43.970
Akiyo	256	40.370	42.810	43.710	40.990	45.190	46.800
	512	43.510	45.860	46.880	44.170	47.690	48.500
	128	20.450	26.120	24.730	20.670	28.040	26.280
Mobile ＆ Calendar	256	23.240	28.470	27.240	23.430	30.560	28.860
	512	25.790	30.440	29.590	26.530	33.060	31.620

视频序列	码率/(kbit·s^-1)			PSNR/dB
			文献[17]方法			本文方法
		Y	U	V	Y	U	V
	500	34.840	37.630	39.420	34.960	40.980	41.630
Foreman	1 000	37.760	39.630	41.760	37.460	42.740	43.890
	1 500	39.400	40.500	42.620	38.880	43.690	45.040
	500	41.760	40.640	42.270	42.980	40.740	43.660
Miss America	1 000	43.230	40.690	43.460	43.710	41.580	44.270
	1 500	43.990	40.690	43.460	44.370	42.720	44.840

视频序列	码率/(kbit·s^-1)	文献[15]方法			本文方法
视频序列	码率/(kbit·s^-1)	编码时间/ms	解码时间/ms	编码时间/ms		解码时间/ms
Miss-America	128	247.5	32.8	137.3		30.3
Mobile	512	370.7	126.7	236.7		113.5

基于3D混合树和视觉特性的视频可分级编码算法

Scalable video coding algorithm based on 3D hybrid tree and visual characteristics

在线阅读

PDF下载

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 22

相关文章 15

Metrics

推荐阅读 0

[1]	张伟, 王宇, 陈新怡, 王延文, 景庆阳, 雷为民. 基于图像块码本模型的监控视频背景参考帧生成方法[J]. 通信学报, 2023, 44(1): 129-141.
[2]	郭红伟, 朱策, 杨栩, 罗雷. 基于失真反向传播的时域依赖率失真优化[J]. 通信学报, 2022, 43(12): 222-232.
[3]	公衍超, 王玲, 刘颖, 杨楷芳, 林庆帆, 王富平. 视频主观观测实验启发的HEVC感知帧内码率控制[J]. 通信学报, 2021, 42(8): 90-102.
[4]	李跃,杨高波,丁湘陵,朱亚培. 基于学习模型的3D-HEVC提前Merge模式终止算法[J]. 通信学报, 2019, 40(7): 104-113.
[5]	王汝言,杨衍,吴大鹏. QoE感知的FiWi视频分发机制[J]. 通信学报, 2018, 39(1): 1-13.
[6]	朱威,张训华,王财盛,张桦. 基于时空相关性的HEVC帧间模式决策快速算法[J]. 通信学报, 2016, 37(4): 64-73.
[7]	刘杰平,王琴玲,何越盛,韦岗. 分布式编码中广义伽马分布相关噪声模型研究[J]. 通信学报, 2016, 37(3): 33-39.
[8]	刘晟,彭宗举,陈嘉丽,陈芬,郁梅,蒋刚毅. 基于多类支持向量机的3D-HEVC深度视频帧内编码快速算法[J]. 通信学报, 2016, 37(11): 181-188.
[9]	陈健,惠超,阔永红. 无反馈分布式视频编码中的速率控制算法[J]. 通信学报, 2014, 35(6): 32-38.
[10]	陈健，惠超，阔永红. 无反馈分布式视频编码中的速率控制算法[J]. 通信学报, 2014, 35(6): 5-38.
[11]	宋传鸣1,2,3，郭延文2，王相海1,2,3，刘丹1. 基于模糊量化和2 bit深度像素的运动估计算法[J]. 通信学报, 2013, 34(7): 7-70.
[12]	宋传鸣,郭延文,王相海,刘丹. 基于模糊量化和2 bit深度像素的运动估计算法[J]. 通信学报, 2013, 34(7): 59-70.
[13]	刘西蒙,刘光军,马建峰,熊金波. 可伸缩视频流的安全网络编码方案[J]. 通信学报, 2013, 34(5): 184-191.
[14]	刘西蒙1，刘光军1，马建峰2，熊金波2. 可伸缩视频流的安全网络编码方案[J]. 通信学报, 2013, 34(5): 21-191.
[15]	黄韬1，张丽1，张云勇1,2，刘韵洁1. 基于OpenFlow的SVC流媒体时延自适应分级传输方法[J]. 通信学报, 2013, 34(11): 14-128.