基于统计建模的VVC快速码率估计算法

doi:10.11959/j.issn.1000-0801.2022279

电信科学 ›› 2022, Vol. 38 ›› Issue (12): 35-45.doi: 10.11959/j.issn.1000-0801.2022279

基于统计建模的VVC快速码率估计算法

祁伟, 殷海兵, 王鸿奎, 黄晓峰, 牛伟宏

杭州电子科技大学通信工程学院，浙江杭州 310018

修回日期:2022-10-20 出版日期:2022-12-20 发布日期:2022-12-01
作者简介:祁伟（1995- ），男，杭州电子科技大学硕士生，主要研究方向为视频编解码
殷海兵（1974- ），男，博士，杭州电子科技大学教授，主要研究方向为数字视频编解码
王鸿奎（1990- ），男，博士，杭州电子科技大学讲师，主要研究方向为感知视频编码
黄晓峰（1988- ），男，博士，杭州电子科技大学教授，主要研究方向为感知视频编码
牛伟宏（1998- ），男，杭州电子科技大学硕士生，主要研究方向为视频编解码
基金资助:
国家自然科学基金资助项目(61972123);国家自然科学基金资助项目(62031009);浙江省尖兵研发攻关计划项目(2022C01068)

Statistical modeling based fast rate estimation algorithm for VVC

Wei QI, Haibing YIN, Hongkui WANG, Xiaofeng HUANG, Weihong NIU

College of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China

Revised:2022-10-20 Online:2022-12-20 Published:2022-12-01
Supported by:
The National Natural Science Foundation of China(61972123);The National Natural Science Foundation of China(62031009);Zhejiang Provincial Pioneer Research and Development Project(2022C01068)

摘要/Abstract

摘要：

为降低新一代通用视频编码（versatile video coding，VVC）标准率失真优化过程的编码复杂度，提出一种基于统计建模的快速码率估计算法。首先，算法充分考虑依赖性量化（dependent quantization，DQ）的量化行为和熵编码中的上下文依赖，提出可以准确刻画编码过程中上下文状态迁移的码率特征，初步预估变换单元（transform unit，TU）中部分语法元素的码率；其次，基于系数分布特性，定义系数混乱度特征和稀疏度特征来区分系数分布差异带来的码率影响，并构建 TU 级码率模型；最后，算法根据码率构成特性将大尺寸TU和小尺寸TU分开建模实现更精准的码率预估。通过统计方式对大量样本进行回归训练，得到最终的线性码率模型，并应用于VVC的模式决策中。实验结果表明，所提出算法在随机访问（random access，RA）配置下，可以实现16.289%的复杂度降低，而码率变化率（Bjontegaard delta bit rate，BD-BR）仅增加1.567%。

关键词: 码率预估, 通用视频编码, 率失真优化, 回归训练

Abstract:

To reduce the coding complexity of the rate-distortion optimization process of the latest video coding standard versatile video coding (VVC), a fast rate estimation model based on statistical modeling was proposed.Firstly, the quantization behavior in dependent quantization (DQ) and the context dependency in entropy coding were fully considered.Features that could describe context state transition in the coding process were proposed to estimate rate of some synatax elements in a TU preliminarily.Secondly, coefficient chaos and sparsity features were proposed to distinguish the influence of coefficient distribution difference on the rate cost based on the coefficient distribution characteristics which built a TU level rate model.Finally, large-size transform unit (TU) and small-size TU was modeling respectively according to the rate composition character to achieve more accurate rate estimation.A large number of parameters were trained by regression model through statistical methods, and the final linear rate model was obtained which was applied to the mode decision.Experimental results show that the proposed algorithm can achieve 16.289% complexity reduction with 1.567% BD-BR increase for RA configuration.

Key words: rate estimation, VVC, RDO, regression training

中图分类号:

TN919.81

祁伟, 殷海兵, 王鸿奎, 黄晓峰, 牛伟宏. 基于统计建模的VVC快速码率估计算法[J]. 电信科学, 2022, 38(12): 35-45.

Wei QI, Haibing YIN, Hongkui WANG, Xiaofeng HUANG, Weihong NIU. Statistical modeling based fast rate estimation algorithm for VVC[J]. Telecommunications Science, 2022, 38(12): 35-45.

图/表 9

图1

图2

图3

图4

图5

图6

图7

图8

表1

参考文献 22

[1]	BROSS B , WANG Y K , YE Y ,et al. Overview of the versatile video coding (VVC) standard and its applications[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021,31(10): 3736-3764.
[2]	SCHWARZ H , COBAN M , KARCZEWICZ M ,et al. Quantization and entropy coding in the versatile video coding (VVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021,31(10): 3891-3906.
[3]	SCHWARZ H , NGUYEN T , MARPE D ,et al. Hybrid video coding with trellis-coded quantization[C]// Proceedings of 2019 Data Compression Conference (DCC). Piscataway:IEEE Press, 2019: 182-191.
[4]	SULLIVAN G J , OHM J R , HAN W J ,et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1649-1668.
[5]	SULLIVAN G J , WIEGAND T . Rate-distortion optimization for video compression[J]. IEEE Signal Processing Magazine, 1998,15(6): 74-90.
[6]	WIEGAND T , SULLIVAN G J , BJONTEGAARD G ,et al. Overview of the H.264/AVC video coding standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003,13(7): 560-576.
[7]	SARWER M G , PO L M . Fast bit rate estimation for mode decision of H.264/AVC[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007,17(10): 1402-1407.
[8]	ZHAO X , SUN J , MA S W ,et al. Novel statistical modeling,analysis and implementation of rate-distortion estimation for H.264/AVC coders[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(5): 647-660.
[9]	TU Y K , YANG J F , SUN M T . Efficient rate-distortion estimation for H.264/AVC coders[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2006,16(5): 600-611.
[10]	CHEN W G , WANG X . Fast entropy-based CABAC rate estimation for mode decision in HEVC[J]. SpringerPlus, 2016,5(1): 1-10.
[11]	CHEN H C , CHANG T S . Fast rate distortion optimization with adaptive context group modeling for HEVC[C]// Proceedings of 2017 IEEE International Symposium on Circuits and Systems. Piscataway:IEEE Press, 2017: 1-4.
[12]	SHARABAYKO M P , PONOMAREV O G . Fast rate estimation for RDO mode decision in HEVC[J]. Entropy, 2014,16(12): 6667-6685.
[13]	HU L D , SUN H M , ZHOU D J ,et al. Hardware-oriented rate-distortion optimization algorithm for HEVC intra-frame encoder[C]// Proceedings of 2015 IEEE International Conference on Multimedia ＆ Expo Workshops. Piscataway:IEEE Press, 2015: 1-6.
[14]	HUANG X F , JIA H Z , CAI B B ,et al. Fast algorithms and VLSI architecture design for HEVC intra-mode decision[J]. Journal of Real-Time Image Processing, 2016,12(2): 285-302.
[15]	SHENG Z , ZHOU D , SUN H ,et al. Low-complexity rate-distortion optimization algorithms for HEVC intra prediction[C]// Proceedings of International Conference on Multimedia Modeling. Cham:Springer, 2014: 541-552.
[16]	LIU Z Y , GUO S C , WANG D S . Binary classification based linear rate estimation model for HEVC RDO[C]// Proceedings of 2014 IEEE International Conference on Image Processing. Piscataway:IEEE Press, 2014: 3676-3680.
[17]	SUN H M , ZHOU D J , HU L D ,et al. Fast algorithm and VLSI architecture of rate distortion optimization in H.265/HEVC[J]. IEEE Transactions on Multimedia, 2017,19(11): 2375-2390.
[18]	孟翔, 殷海兵, 黄晓峰 . 基于统计建模的 HEVC 快速率失真估计算法[J]. 电信科学, 2021,37(1): 58-68.
	MENG X , YIN H B , HUANG X F . Statistical modeling based fast rate distortion estimation algorithm for HEVC[J]. Tele-communications Science, 2021,37(1): 58-68.
[19]	SCHWARZ H , NGUYEN T , MARPE D ,et al. Hybrid video coding with trellis-coded quantization[C]// Proceedings of 2019 Data Compression Conference (DCC). Piscataway:IEEE Press, 2019: 182-191.
[20]	SCHWARZ H , NGUYEN T , MARPE D ,et al. Improved quantization and transform coefficient coding for the emerging versatile video coding (VVC) standard[C]// Proceedings of 2019 IEEE International Conference on Image Processing. Piscataway:IEEE Press, 2019: 1183-1187.
[21]	BOSSEN F , BOYCE J , LI X ,et al. JVET common test conditions and software reference configurations for SDR video[EB]. 2019.
[22]	BJONTEGAARD G . Calculation of average PSNR differences between RD-curves[EB]. 2001.

类别	视频序列	Sun等^[17]所提算法		孟翔等^[18]所提算法		本文算法
类别	视频序列	BD_BR	?T_RDO	BD_BR	?T_RDO	BD_BR	?T_RDO
A1	Tango2	1.83%	20.34%	1.79%	20.32%	1.52%	21.36%
	FoodMarket4	2.01%	21.11%	2.03%	19.93%	1.94%	20.91%
	Campfire	1.92%	17.65%	1.77%	18.64%	1.75%	19.86%
A2	CatRobot	2.03%	20.02%	1.72%	21.16%	1.64%	21.62%
	DaylightRoad2	2.16%	20.61%	1.64%	19.55%	1.53%	20.64%
	ParkRunning3	1.65%	18.41%	1.38%	18.79%	1.25%	19.62%
B	MarketPlace	2.24%	17.74%	2.15%	17.26%	1.90%	18.31%
	RitualDance	1.92%	19.32%	1.12%	18.20%	1.13%	19.47%
	Cactus	2.79%	16.57%	2.14%	15.44%	2.13%	17.20%
	BasketballDrive	1.87%	17.21%	1.50%	16.72%	1.49%	16.52%
	BQTerrace	2.04%	17.42%	1.96%	17.37%	1.91%	16.78%
C	BasketballDrill	1.81%	16.13%	1.74%	15.29%	1.51%	17.49%
	BQMall	1.94%	15.34%	1.61%	16.53%	1.59%	16.34%
	PartyScene	2.86%	14.65%	2.17%	13.62%	2.24%	15.91%
	RaceHorses	1.98%	15.36%	1.72%	13.87%	1.60%	14.20%
D	BasketballPass	2.06%	15.92%	1.40%	15.52%	1.10%	14.63%
	BQSquare	2.57%	14.87%	2.15%	14.29%	2.02%	14.74%
	BlowingBubbles	1.57%	13.89%	1.22%	14.84%	0.97%	15.24
	RaceHorses	2.46%	13.87%	1.61%	13.66%	1.44%	14.10%
F	BasketballDrillText	2.59%	12.32%	1.68%	10.26%	1.57%	11.03%
	ArenaOfValor	2.16%	11.26%	1.81%	9.87%	1.63%	10.25%
	SlideEditing	1.87%	10.59%	1.19%	9.61%	0.95%	9.74%
	SlideShow	1.74%	8.14%	1.36%	8.19%	1.21%	8.67%
平均值		2.09%	16.032%	1.690%	15.61%	1.567%	16.289%

基于统计建模的VVC快速码率估计算法

Statistical modeling based fast rate estimation algorithm for VVC

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 22

相关文章 4

Metrics

推荐阅读 0

[1]	孟翔, 殷海兵, 黄晓峰. 基于统计建模的HEVC快速率失真估计算法[J]. 电信科学, 2021, 37(1): 58-68.
[2]	周瑜锋,郁梅,杜宝祯,宋洋,蒋刚毅. 基于球形加权结构相似度的全向视频编码率失真优化方法[J]. 电信科学, 2019, 35(2): 59-69.
[3]	李金龙,陈芬,彭宗举,蒋刚毅,郁梅. 基于显著特征的HEVC帧内率失真优化[J]. 电信科学, 2017, 33(10): 124-133.
[4]	柴鑫刚,郑冬冬. 无线视频传输的容错编码研究[J]. 电信科学, 2011, 27(9): 89-92.