视频主观观测实验启发的HEVC感知帧内码率控制

doi:10.11959/j.issn.1000-436x.2021146

Abstract

Abstract:

In view of the low perceptual rate-distortion performance of the rate control method used in high efficiency video coding (HEVC), an intra-frame rate control algorithm to effectively improve the perceptual rate-distortion performance of video was proposed.First, the spatiotemporal complexity of videos was measured, and the video subjective observation experiment was designed combined with the spatiotemporal complexity.Secondly, based on the experimental results of video subjective observation, combined with the relevant human vision system perception characteristics, the spatiotemporal perceptual sensitivity factors of video content which could effectively measure the perception difference of human eyes for different regions of video were constructed.Finally, the spatiotemporal perceptual sensitivity factors were applied to the target bit allocation of the largest coding unit layer in the intra-frame image, then the perceptual intra-frame rate control was realized.Experimental results show that the proposed algorithm is superior to the rate control algorithm adopted by HEVC in terms of the bit estimation accuracy and the perceptual rate-distortion performance.

Key words: high efficiency video coding, rate control, human vision perception, target bit allocation

CLC Number:

TN911.7

Yanchao GONG, Ling WANG, Ying LIU, Kaifang YANG, Qingfan LIN, Fuping WANG. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102.

Figures/Tables 14

References 38

[1]	LI B , LI H Q , LI L ,et al. λ domain rate control algorithm for high efficiency video coding[J]. IEEE Transactions on Image Processing, 2014,23(9): 3841-3854.
[2]	SULLIVAN G J , OHM J R , HAN W J ,et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1649-1668.
[3]	GONG Y C , WAN S , YANG K F ,et al. [J]. Temporal-layer-motivated lambda domain picture level rate control for random-access configuration in H.265/HEVC, 2019,29(1): 156-170.
[4]	ZHAO F , KU C W , XIANG G ,et al. A novel quality enhanced low complexity rate control algorithm for HEVC[C]// 2020 IEEE International Conference on Visual Communications and Image Processing. Piscataway:IEEE Press, 2020: 278-280.
[5]	LI B , LI H Q , LI L ,et al. Rate control by R-lambda model for HEVC:JCTVC-K0103[C]// Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2012: 1-11.
[6]	WANG X , KARCZEWICZ M . Intra frame rate control based SATD:JCT-VC M0257[C]// Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2013: 1-5.
[7]	LI B , LI H Q , LI L ,et al. Adaptive bit allocation for R-lambda model rate control in HM:JCTVC-M0036[C]// Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2013: 1-7.
[8]	LI L , LI B , LI H Q ,et al. λ-domain optimal bit allocation algorithm for high efficiency video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018,28(1): 130-142.
[9]	李维, 赵凡, 张二虎 ,等. 基于SATD的H.265/HEVC拉格朗日因子选择算法[J]. 通信学报, 2017,38(6): 68-74.
	LI W , ZHAO F , ZHANG E H ,et al. Lagrange multiplier selection based on SATD for H.265/HEVC[J]. Journal on Communications, 2017,38(6): 68-74.
[10]	MCCANN K , ROSEWARNE C , BROSS B ,et al. High efficiency video coding (HEVC) test model 16 (HM 16) encoder description:JCTVC-R1002[C]// Proceedings of the 18th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2014: 1-59.
[11]	LI X J , ABUDOULIKEMU Y . Background-foreground information based bit allocation algorithm for surveillance video on high efficiency video coding (HEVC)[C]// 2016 IEEE International Conference on Visual Communications and Image Processing. Piscataway:IEEE Press, 2016: 1-4.
[12]	ZHANG Z W , JING T , HAN J N ,et al. A new rate control scheme for video coding based on region of interest[J]. IEEE Access, 2017,5: 13677-13688.
[13]	WANG M H , NGAN K N , LI H L . An efficient frame-content based intra frame rate control for high efficiency video coding[J]. IEEE Signal Processing Letters, 2015,22(7): 896-900.
[14]	GAO W , KWONG S , ZHOU Y ,et al. SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation[J]. IEEE Transactions on Multimedia, 2016,18(6): 988-999.
[15]	ZHAO H L , XIE W , ZHANG Y C ,et al. An SSIM-motivated LCU-level rate control algorithm for HEVC[C]// 2013 Picture Coding Symposium. Piscataway:IEEE Press, 2013: 85-88.
[16]	LIU X Y , ZHANG Y , ZHU L W ,et al. Perception-based CTU level bit allocation for intra high efficiency video coding[J]. IEEE Access, 2019,7: 154959-154970.
[17]	ZENG H Q , YANG A S , NGAN K N ,et al. Perceptual sensitivity-based rate control method for high efficiency video coding[J]. Multimedia Tools and Applications, 2016,75(17): 10383-10396.
[18]	ZHOU M L , WEI X K , KWONG S ,et al. Just noticeable distortion-based perceptual rate control in HEVC[J]. IEEE Transactions on Image Processing, 2020,29(6): 7603-7614.
[19]	CHOU C H , LI Y C . A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile[J]. IEEE Transactions on Circuits and Systems for Video Technology, 1995,5(6): 467-476.
[20]	WU H R , REIBMAN A R , LIN W S ,et al. Perceptual visual signal compression and transmission[J]. Proceedings of the IEEE, 2013,101(9): 2025-2043.
[21]	YANG K F , WAN S , WU H R ,et al. Detection and estimation of supra-threshold distortion levels of pictures based on just-noticeable difference[C]// 2016 IEEE International Conference on Visual Communications and Image Processing. Piscataway:IEEE Press, 2016: 1-4.
[22]	WU H R , LIN W S , NGAN K N . Rate-perceptual-distortion optimization (RpDO) based picture coding-issues and challenges[C]// 2014 International Conference on Digital Signal Processing. Piscataway:IEEE Press, 2014: 777-782.
[23]	WANG H Q , KATSAVOUNIDIS I , ZHOU J T ,et al. VideoSet:a large-scale compressed video quality dataset based on JND measurement[J]. Journal of Visual Communication and Image Representation, 2017,46(7): 292-302.
[24]	WU J J , LI L D , DONG W S ,et al. Enhanced just noticeable difference model for images with pattern complexity[J]. IEEE Transactions on Image Processing, 2017,26(6): 2682-2693.
[25]	WANG S Q , MA L , FANG Y M ,et al. Just noticeable difference estimation for screen content images[J]. IEEE Transactions on Image Processing, 2016,25(8): 3838-3851.
[26]	张尧尧 . 基于视频结构化的侦查应用[J]. 法制与社会, 2020,19: 75-76.
	ZHAGN Y Y . Investigation application based on video structure[J]. Legal System and Society, 2020,19: 75-76.
[27]	孙展明, 尹伟中 . 论视频侦查的几个基本问题[J]. 公安教育, 2015,12: 32-36.
	SUN Z M , YIN W Z . On several basic issues of video investigation[J]. Public Security Education, 2015,12: 32-36.
[28]	ITU-R. ITU-R BT.500-13-2012:Methodology for the subjective assessment of the quality of television pictures[S]. 2012.
[29]	GONG Y C , WAN S , YANG K F ,et al. Rate-distortion- optimization-based quantization parameter cascading technique for random-access configuration in H.265/HEVC[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2017,27(6): 1304-1312.
[30]	LEE J S , EBRAHIMI T . Perceptual video compression:a survey[J]. IEEE Journal of Selected Topics in Signal Processing, 2012,6(6): 684-697.
[31]	YANG X K , LIN W S , LU Z K ,et al. Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005,15(6): 742-752.
[32]	YAMADA K E . Some structural features of the fovea centralis in the human retina[J]. Arch Ophthalmol, 1969,82(2): 151-159.
[33]	ONG P E , YANG X K , LIN W S ,et al. Perceptual quality and objective quality measurements of compressed videos[J]. Journal of Visual Communication and Image Representation, 2006,17(4): 717-737.
[34]	LI B , ZHANG D , LI H Q ,et al. QP determination by lambda value JCTVC-I0426[C]// Proceedings of the 9th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2012: 1-10.
[35]	BOSSEN F , . Common test conditions and software reference configurations[C]// Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting. New York:ACM Press, 2012: 1-4.
[36]	李维, 杨付正, 任鹏 . 考虑视频内容的 H.265/HEVC 帧层码率分配算法[J]. 通信学报, 2015,36(9): 76-81.
	LI W , YANG F Z , REN P . H.265/HEVC frame layer rate allocation algorithm considering video content[J]. Journal on Communications, 2015,36(9): 76-81.
[37]	PATEUXS B , JUNG J . An excel add-in for computing Bj?ntegaard metric and its evolution:VCEG-AE07[C]// Proceedings of the Video Coding Experts Group Meeting. New York:ACM Press, 2007: 1-10.
[38]	DABEER O , CHAUDHURI S . Analysis of an adaptive sampler based on weber's law[J]. IEEE Transactions on Signal Processing, 2011,59(4): 1868-1878.

Metrics

Recommended 0

No Suggested Reading articles found!

序列	HM16.0算法	文献[3]算法	文献[4]算法	文献[13]算法	所提算法
BasketballDrill	0.008 5%	0.008 3%	0.001 4%	0.005 6%	0.005 6%
BQMall	0.001 5%	0.001 7%	0.000 3%	0.002 4%	0.001 2%
ParkScene	0.000 7%	0.000 4%	0.001 1%	0.000 7%	0.000 5%
Johnny	0.007 3%	0.004 3%	0.001 4%	0.005 1%	0.000 5%
KristenAndSara	0.002 6%	0.002 1%	0.001 2%	0.005 5%	0.008 3%
Vidyo1	0.004 3%	0.007 8%	0.000 6%	0.001 2%	0.000 7%
Vidyo4	0.000 5%	0.003 6%	0.001 5%	0.004 2%	0.000 4%
Intersection	0.008 7%	0.004 8%	0.001 2%	0.002 3%	0.001 1%
Mainroad	0.014 6%	0.002 1%	0.001 1%	0.001 0%	0.000 9%
Metro	0.012 4%	0.012 1%	0.009 2%	0.000 5%	0.002 6%
Runners	0.000 7%	0.000 7%	0.001 1%	0.000 7%	0.002 0%
Corridor1	0.005 4%	0.015 3%	0.005 0%	0.002 0%	0.001 0%
Corridor2	0.009 9%	0.007 8%	0.002 2%	0.003 9%	0.001 6%
平均	0.005 9%	0.005 5%	0.002 1%	0.002 7%	0.002 0%

序列	文献[3]算法	文献[4]算法	文献[13]算法	所提算法
BasketballDrill	-5.831 3%	2.228 2%	-10.398 5%	-14.437 5%
BQMall	0.989 3%	5.729 4%	-4.267 4%	-11.859 2%
ParkScene	-2.702 7%	-1.367 6%	-8.749 2%	-12.059 7%
Johnny	-6.088 6%	-3.306 6%	-9.238 8%	-17.364 4%
KristenAndSara	-2.578 4%	-3.818 0%	-5.401 1%	-23.322 2%
Vidyo1	-4.817 5%	-2.899 6%	-6.579 8%	-15.795 0%
Vidyo4	-5.450 9%	-3.165 3%	-6.311 9%	-17.130 8%
Intersection	-3.470 8%	-1.563 6%	3.580 3%	-20.574 6%
Mainroad	-3.470 8%	0.986 0%	-10.076 4%	-17.781 3%
Metro	-4.523 0%	3.296 0%	-8.782 5%	-12.545 1%
Runners	-4.472 1%	5.956 9%	-9.845 1%	-16.792 3%
Corridor1	-3.405 8%	-2.162 8%	-7.176 5%	-13.281 8%
Corridor2	-3.119 4%	-3.547 4%	-8.342 5%	-16.792 3%
平均	-3.764 8%	-0.279 6%	-7.045 3%	-16.133 6%

序列	文献[3]算法	文献[4]算法	文献[13]算法	所提算法
BasketballDrill	1.247%	0.830%	0.312%	0.480%
BQMall	-1.214%	-0.699%	-3.337%	-0.045%
ParkScene	-2.600%	0.634%	-1.106%	-0.134%
Johnny	-4.977%	0.014%	0.925%	1.110%
KristenAndSara	-4.578%	-0.466%	0.544%	0.552%
Vidyo1	-5.992%	-0.006%	0.813%	-1.033%
Vidyo4	-4.636%	-0.496%	1.375%	-0.937%
Intersection	-6.964%	0.384%	0.917%	-1.347%
Mainroad	-7.163%	0.320%	-0.405%	0.088%
Metro	-7.101%	-0.826%	0.271%	0.363%
Runners	-6.252%	1.072%	-0.266%	-0.938%
Corridor1	-4.723%	-0.796%	-0.255%	0.215%
Corridor2	-7.150%	0.092%	0.922%	2.641%
平均	-4.777%	0.004%	0.055%	0.078%

HEVC perceptual intra-frame rate control inspired by video subjective observation experiment

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 14

References 38

Related Articles 14

Metrics

Recommended 0

[1]	Yue LI,Gaobo YANG,Xiangling DING,Yapei ZHU. Early Merge mode decision algorithm for 3D-HEVC based on learning model [J]. Journal on Communications, 2019, 40(7): 104-113.
[2]	Li-rong XIONG,Jing-zhi LEI,Xin JIN. Research on Q-learning based rate control approach for HTTP adaptive streaming [J]. Journal on Communications, 2017, 38(9): 18-24.
[3]	Wei ZHU,Xun-hua ZHANG,Cai-sheng WANG,Hua2 ZHANG. Spatio-temporal correlation based fast inter mode decision for HEVC [J]. Journal on Communications, 2016, 37(4): 64-73.
[4]	Ming-jian LIU,Guo-zhen TAN,Shuai-bing LI,Nan DING,Cai-xia SONG. Adaptive message sending rate control method based on channel congestion cost calculation in VANET [J]. Journal on Communications, 2016, 37(10): 108-116.
[5]	Wei LI,Fu-zheng YANG,Peng REN. H.265/HEVC frame-level bitrate allocation algorithm considering video content [J]. Journal on Communications, 2015, 36(9): 76-81.
[6]	. Rate control algorithm for no-feedback distributed video coding [J]. Journal on Communications, 2014, 35(6): 5-38.
[7]	HENJian C,Chao HUI,Yong-hong KUO. Rate control algorithm for no-feedback distributed video coding [J]. Journal on Communications, 2014, 35(6): 32-38.
[8]	. Network-assisted optimal rate control methods in cognitive networks [J]. Journal on Communications, 2013, 34(5): 15-135.
[9]	Chun-gang YANG,Min SHENG,Yan-jie DONG,Jian-dong LI,Hong-yan LI,Qin LIU. Network-assisted optimal rate control methods in cognitive networks [J]. Journal on Communications, 2013, 34(5): 126-135.
[10]	Dong-jie LI,Zhong-jie ZHU,Yu-er WANG. HVS-based rate-control scheme for object-based embedded image coding [J]. Journal on Communications, 2012, 33(4): 115-120.
[11]	Xin-zi ZHENG,Bing-qing LUO,Zhi-xin SUN. Research on adaptive rate control algorithm for H.264 based on R-Q model [J]. Journal on Communications, 2012, 33(12): 35-42.
[12]	Bin SONG,Ming-ming YANG,Hao QIN,Hong HE. No-feedback rate control algorithm for Wyner-Ziv video coding [J]. Journal on Communications, 2011, 32(12): 1-7.
[13]	Bo-cheng ZHONG,Jiang-hong HAN. Optimization based multimedia multicast rate control [J]. Journal on Communications, 2007, 28(3): 57-62.
[14]	Yun-peng CHEN,Pei-ren ZHANG,Xiu-feng GAO. Rate control scheme for wireless video transmission [J]. Journal on Communications, 2006, 27(3): 94-98.