基于显著特征的HEVC帧内率失真优化

doi:10.11959/j.issn.1000-0801.2017250

Abstract

Abstract:

Although the perception based rate distortion optimization (RDO) and coding algorithms can improve subjective quality,they significantly decrease rate distortion performance.For the above questions,a saliency-based RDO method was proposed.Firstly,according to the relation between rate distribution and saliency features of coding tree unit in HEVC,a priori saliency-rate model was designed.Furthermore,the initial parameters of the model were determined.Secondly,the rate difference minimization rate distortion model was proposed,and then a calculation method of the adaptive Lagrangian multiplier was derived from the model.Finally,update mechanism of model parameters was designed.Experimental results show that the proposed algorithm can improve the subjective quality while it maintains rate distortion performance.

Key words: high efficiency video coding, rate distortion optimization, Lagrangian multiplier, saliency characteristic

CLC Number:

TN919.81

Jinlong LI,Fen CHEN,Zongju PENG,Gangyi JIANG,Mei YU. Rate distortion optimization based on saliency characteristic for HEVC intra coding[J]. Telecommunications Science, 2017, 33(10): 124-133.

Figures/Tables 9

References 25

[1]	赵翠, 张诚, 欧阳峰 . 有线电视网络的发展现状与趋势[J]. 电信科学, 2017,33(6): 146-153.
	ZHAO C , ZHANG C , OUYANG F . Development status and trends of cable TV networks[J]. Telecommunications Science, 2017,33(6): 146-153.
[2]	SULLIVAN G J , OHM J , HAN W J ,et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1649-1668.
[3]	姚英彪, 李晓娟 . 基于图像空间相关性与纹理的HEVC块划分快速算法[J]. 电信科学, 2015,31(1): 38-46.
	YAO Y B , LI X J . Fast block partitioning algorithm for HEVC based on spatial correlation and image texture[J]. Telecommu-nications Science, 2015,31(1): 38-46.
[4]	WANG Z , BOVIK A C . Mean squared error:love it or leave it? a new look at signal fidelity measures[J]. IEEE Signal Processing Magazine, 2009,26(1): 98-117.
[5]	BAE S H , KIM J , KIM M . HEVC-based perceptually adaptive video coding using a DCT-based local distortion detection probability model[J]. IEEE Transactions on Image Processing, 2016,25(7): 3343-3357.
[6]	WEI H , ZHOU X , ZHOU W ,et al. Visual saliency based perceptual video coding in HEVC[C]// IEEE International Symposium on Circuits and Systems,May 22-25,2016,Montreal,QC,Canada. New Jersey:IEEE Press, 2016: 2547-2550.
[7]	SHOHAM Y , GERSHO A . Efficient bit allocation for an arbitrary set of quantizers[J]. IEEE Transactions on Acoustics Speech and Signal Processing, 1988,36(9): 1445-1453.
[8]	WIEGAND T , SULLIVAN G J , BJONTEGAARD G ,et al. Overview of the H.264/AVC video coding standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003,13(7): 560-576.
[9]	YANG E H , YU X.Rate distortion optimization for H . 264 inter-frame coding:a general framework and algorithms[J]. IEEE Transactions on Image Processing, 2007,16(7): 1774-1784.
[10]	LI B , . QP determination by lambda value[C]// Document JCTVC-I0426,Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 9th Meeting,April 27-May 7,2012,Geneva,Switzerland[S.l.:s.n.], 2012.
[11]	LI S , ZHU C , GAO Y . Lagrangian multiplier adaptation for rate-distortion optimization with inter-frame dependency[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2016,26(1): 117-129.
[12]	HUANG T Y , CHEN H H . Efficient quantization based on rate-distortion optimization for video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2016,26(6): 1099-1106.
[13]	HUANG Y H , OU T S , SU P Y ,et al. Perceptual rate-distortion optimization using structural similarity index as quality metric[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(11): 1614-1624.
[14]	YEO C , TAN H L , TAN Y H . On rate distortion optimization using SSIM[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2013,23(7): 1170-1181.
[15]	WANG S , REHMAN A , WANG Z ,et al. SSIM-motivated rate distortion optimization for video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(4): 516-529.
[16]	ZHU X , HONG W , XU H ,et al. Spatial quality index based rate perceptual-distortion optimization for video coding[J]. Journal of Visual Communication and Image Representation, 2016,38(C): 423-432.
[17]	YANG A , ZENG H , CHEN J ,et al. Perceptual feature guided rate distortion optimization for high efficiency video coding[J]. Multidimensional Systems and Signal Processing, 2016: 1-18.
[18]	CEN F , LU Q , XU W . SSIM based rate-distortion optimization for intra-only coding in HEVC[C]// IEEE International Conference on Consumer Electronics,January 10-13,2014,Las Vegas,NV,USA. New Jersey:IEEE Press, 2014: 17-18.
[19]	ZHAO P , LIU Y , LIU J ,et al. Perceptual rate-distortion optimization for H.264/AVC video coding from both signal and vision perspectives[J]. Multimedia Tools and Applications, 2016,75(5): 1-20.
[20]	BRUCE N D B . Saliency,attention and visual search:an information theoretic approach[J]. Journal of Vision, 2009,9(3): 1-24.
[21]	GISH H , PIERCE J . Asymptotically efficient quantizing[J]. IEEE Transactions on Information Theory, 1968,14(5): 676-683.
[22]	BOSSEN F , . Common test conditions and software reference configurations[C]// Document JCTVC-G1200,Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting,November 21-30,2011,Geneva,Switzerland[S.l.:s.n], 2011.
[23]	WANG Z , SIMONCELLI E P , BOVIK A C . Multiscale structural similarity for image quality assessment[C]// Conference Record of the Thirty-Seventh Asilomar Conference on Signals,Systems and Computers,November 9-12,2003,Pacific Grove,CA,USA. New Jersey:IEEE Press, 2003: 1398-1402.
[24]	WANG Z , LI Q . Information content weighting for perceptual image quality assessment[J]. IEEE Transactions on Image Processing, 2011,20(5): 1185-1198.
[25]	BJONTEGAARD G , . Calculation of average PSNR differences between RD-curves[C]// Austin:13th Video Coding Experts Group (VCEG) Meeting,April 2-4,2001,Austin,TX,USA.[S.l.:s.n], 2001.

Metrics

Recommended 0

No Suggested Reading articles found!

序列	帧编号	相关系数R²	a	b

ChinaSpeed	1	0.54	0.99	2.47
	2	0.56	1.00	2.39
	3	0.56	1.00	2.39
FourPeople	1	0.42	0.98	2.65
	2	0.42	0.98	2.58
	3	0.42	0.98	2.64
Johnny	1	0.62	0.96	2.63
	2	0.65	0.96	2.76
	3	0.65	0.98	2.60
BasketballDrill	1	0.18	0.93	2.65
	2	0.18	0.93	2.65
	3	0.18	0.93	2.58
均值	-	0.45	0.97	2.60

序列	PSNR		MSSSIM		IWSSIM
序列	BD-BR	BD-PSNR/dB	BD-BR	BD-MSSSIM	BD-BR	BD-IWSSIM
BasketballDrill	0.979 62%	-0.046 23	-0.284 14%	-0.000 03	-0.984 15%	0.000 03
BQTerrace	0.698 06%	-0.042 12	-0.781 17%	0.000 12	-1.111 59%	0.000 25
ChinaSpeed	0.461 73%	-0.043 85	-3.317 88%	0.000 44	-1.780 13%	0.000 32
Johnny	-1.121 25%	0.090 23	-2.098 99%	0.000 18	-0.652 26%	0.000 22
Kimono	-0.871 95%	0.033 08	0.330 44%	-0.000 04	0.726 85%	-0.000 08
PeopleOnStreet	0.112 59%	-0.007 65	-0.605 39%	0.000 10	0.035 37%	-0.000 02
均值	0.043 13%	-0.002 76	-1.126 19%	0.000 13	-0.627 65%	0.000 12

序列	PSNR		MSSSIM		IWSSIM
序列	BD-BR	BD-PSNR/dB	BD-BR	BD-MSSSIM	BD-BR	BD-IWSSIM
BasketballDrill	1.230 00%	-0.057 75	-4.995 28%	0.000 85	-5.891 22%	0.000 91
BasketballPass	-0.010 00%	0.002 88	-1.771 78%	0.000 38	-2.781 62%	0.000 54
BQMall	0.253 55%	-0.017 00	-3.857 11%	0.000 62	-4.294 17%	0.000 65
BQTerrace	0.246 83%	-0.015 15	-4.112 38%	0.000 84	-4.163 53%	0.000 79
ChinaSpeed	0.480 53%	-0.045 32	-4.688 16%	0.000 93	-6.332 35%	0.002 09
FourPeople	0.375 45%	-0.021 53	-6.138 77%	0.001 53	-8.102 50%	0.002 52
Johnny	-0.099 46%	0.004 62	-2.170 08%	0.000 19	-2.310 52%	0.000 36
Kimono	0.025 86%	-0.000 87	-2.067 25%	0.000 18	-3.861 06%	0.000 46
RaceHorseC	0.288 20%	-0.021 01	-4.994 85%	0.000 81	-5.117 75%	0.000 69
均值	0.310 11%	-0.019 01	-3.866 18%	0.000 70	-4.761 63%	0.001 00

序列	QP	参考文献[5]方法			本文方法		BD-BR	BD-PSNR/dB
序列	QP	PSNR/dB	码率/(kbit·s^-1)	PSNR/dB		码率/(kbit·s^-1)	BD-BR	BD-PSNR/dB
BQTerrace	22	35.70	16 788	38.50		59 218	10.55%	-0.20
	27	34.77	5 273	34.93		7 260
	32	33.37	1 918	33.01		1 778
	37	31.36	760	30.78		800
Cactus	22	37.35	12 483	38.43		21 384	-7.56%	0.15
	27	36.21	5 367	36.34		5 628
	32	34.47	2 551	34.38		2 314
	37	32.25	1 267	32.07		1 093
ParkSence	22	38.14	6 280	39.72		7 596	-19.79%	0.64
	27	36.43	2 979	37.00		3 009
	32	34.13	1 323	34.50		1 227
	37	31.59	576	31.95		508
BQMall	22	37.61	3 292	39.46		4 055	-10.13%	0.44
	27	36.25	1 758	36.70		1 711
	32	34.09	895	33.77		787
	37	31.37	457	30.89		385
PartySence	22	33.91	5 793	38.19		6 403	-13.19%	0.82
	27	32.97	3 111	34.06		3 142
	32	30.8	1 484	30.65		1 358
	37	27.8	643	27.28		552
RaceHorseC	22	36.59	3 732	39.56		4 853	5.68%	-0.03
	27	35.27	2 008	35.96		2 076
	32	32.93	985	32.04		953
	37	30.16	457	29.07		417
均值		—	—	—		—	-5.74%	0.30

序列	参考文献[16]方法		本文方法		Δ PSNR/dB
序列	码率/(kbit·s^-1)	PSNR/dB	码率/(kbit·s^-1)	PSNR/dB	Δ PSNR/dB
BasketballPass	360.02	32.77	345.36	32.88	0.11
BQSuare	256.19	29.03	252.59	29.36	0.33
RaceHorseD	166.03	29.66	164.78	29.89	0.23
RaceHorseC	537.08	30.57	522.34	30.68	0.11
BasketballDrill	703.93	33.24	704.24	33.19	-0.05
BasketballDrive	1 499.78	32.81	1 465.97	32.87	0.06
Cactus	1 200.12	31.72	1 269.28	31.93	0.21
BQTerrace	599.92	30.12	592.98	30.13	0.01
均值	—	—	—	—	0.07

Rate distortion optimization based on saliency characteristic for HEVC intra coding

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 25

Related Articles 3

Metrics

Recommended 0

[1]	Yufeng ZHOU,Mei YU,Baozhen DU,Yang SONG,Gangyi JIANG. Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity [J]. Telecommunications Science, 2019, 35(2): 59-69.
[2]	Bowen XU,Xiaodong WANG,Lei GUO,Jian WANG. A video encryption in HEVC entropy coding based on magic square [J]. Telecommunications Science, 2018, 34(3): 95-104.
[3]	Yingbiao Yao,Xiaojuan Li. Fast Block Partitioning Algorithm for HEVC Based on Spatial Correlation and Image Texture [J]. Telecommunications Science, 2015, 31(1): 32-40.