一种基于深度可分离卷积的VVC帧内编码快速块划分算法

doi:10.11959/j.issn.1000-0801.2023132

Abstract

Abstract:

The joint video exploration team (JVET) proposed versatile video coding (VVC) as a new video coding standard, and its quadtree plus multi-type tree (QTMTT) partition structure brings effective coding performance improvements.However, it brings about a sharp increase in encoding complexity, which greatly increases the encoding time.In order to solve the above problems, a fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution was proposed.The pixel of coding unit (CU) was used as input, and the texture information feature of CU was extracted through depth-separable convolution.Therefore, accurate partition mode prediction was realized in the QTMT structure in VVC, and the complexity of the encoder was reduced by skipping low-probability partition modes.Experimental results show that the proposed algorithm saves 18% to 48% of encoding time on the VTM 15.2, and only brings an average performance loss of 0.15%.And the additional complexity brought by the lightweight depthwise separable convolution calculation is also negligible.

Key words: video coding, deep learning, intra coding, coding unit division

CLC Number:

TP391

Zhen YE, Guoxiang WANG, Junfeng SONG, Haokun LIU, Tiansong LI. A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution[J]. Telecommunications Science, 2023, 39(7): 99-108.

Figures/Tables 7

References 22

[1]	SULLIVAN G J , OHM J R , HAN W J ,et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1649-1668.
[2]	BROSS B , WANG Y K , YE Y ,et al. Overview of the versatile video coding (VVC) standard and its applications[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021,31(10): 3736-3764.
[3]	万帅, 杨付正 . 新一代高效视频编码H.265/HEVC:原理、标准与实现[M]. 北京: 电子工业出版社, 2014.
	WAN S , YANG F Z . New generation efficient video coding H.265/HEVC:principles,standards,and implementation[M]. Beijing: Publishing House of Electronics Industry, 2014.
[4]	XIANG M . CE3:CCLM/MDLM using simplified coefficients derivation method[EB]. 2018.
[5]	CHEN J , YE Y , KIM S ,et al. Algorithm description for versatile video coding and test model 5 (VTM 5)[EB]. 2019.
[6]	JIANLE C . Algorithm description for versatile video coding and test model 4 (VTM 4)[EB]. 2019.
[7]	SANTIAGO D L H . CE3:Intra sub-partitions coding mode[EB]. 2019.
[8]	JONATHAN P , BJ?RN S . CE3:affine linear weighted intra prediction[EB]. 2019.
[9]	卢嘉彬, 彭宗举, 束争杰 ,等. 面向 VVC 帧内编码的快速CU 划分和角度模式决策[J]. 光电子·激光, 2021,32(11): 1171-1179.
	LU J B , PENG Z J , SHU Z J ,et al. Fast CU partition and angle mode decision for VVC intra coding[J]. Journal of Optoelectronics · Laser, 2021,32(11): 1171-1179.
[10]	陶浩然, 路锦正, 李意弦 . 一种VVC帧内编码单元快速划分算法[J]. 小型微型计算机系统, 2021,42(7): 1470-1474.
	TAO H R , LU J Z , LI Y X . Fast division algorithm of VVC intra-coding unit[J]. Journal of Chinese Computer Systems, 2021,42(7): 1470-1474.
[11]	TANG N , CAO J , LIANG F ,et al. Fast CTU partition decision algorithm for VVC intra and inter coding[C]// Proceedings of 2019 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS). Piscataway:IEEE Press, 2020: 361-364.
[12]	DONG X C , SHEN L Q , YU M ,et al. Fast intra mode decision algorithm for versatile video coding[J]. IEEE Transactions on Multimedia, 2021,24: 400-414.
[13]	LI Y , YANG G B , SONG Y ,et al. Early intra CU size decision for versatile video coding based on a tunable decision model[J]. IEEE Transactions on Broadcasting, 2021,67(3): 710-720.
[14]	熊丹祺, 高伟, 滕国伟 . 基于决策树的 H.266/VVC 帧内预测CU快速划分算法[J]. 工业控制计算机, 2021,34(7): 88-90,92.
	XIONG D Q , GAO W , TENG G W . Decision tree accelerated CU partition algorithm for intra prediction in H.266/VVC[J]. Industrial Control Computer, 2021,34(7): 88-90,92.
[15]	ZHAO J C , WU A B , ZHANG Q W . SVM-based fast CU partition decision algorithm for VVC intra coding[J]. Electronics, 2022,11(14): 2147.
[16]	WU G Q , HUANG Y , ZHU C ,et al. SVM based fast CU partitioning algorithm for VVC intra coding[C]// Proceedings of 2021 IEEE International Symposium on Circuits and Systems (ISCAS). Piscataway:IEEE Press, 2021: 1-5.
[17]	LIU X G , LI Y Y , LIU D Y ,et al. An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019,29(1): 144-155.
[18]	ZHANG S P , FENG S X , CHEN J W ,et al. A GCN-based fast CU partition method of intra-mode VVC[J]. Journal of Visual Communication and Image Representation, 2022,88:103621.
[19]	TECH G , PFAFF J , SCHWARZ H ,et al. Fast partitioning for VVC intra-picture encoding with a CNN minimizing the rate-distortion-time cost[C]// Proceedings of 2021 Data Compression Conference (DCC). Piscataway:IEEE Press, 2021: 3-12.
[20]	WU S L , SHI J , CHEN Z B . HG-FCN:hierarchical grid fully convolutional network for fast VVC intra coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022,32(8): 5638-5649.
[21]	FANG J T , LIU B H , CHANG P C . Fast coding unit partitioning algorithms for versatile video coding intra coding[J]. Journal of Visual Communication and Image Representation, 2022,87:103542.
[22]	DANG-NGUYEN D T , PASQUINI C , CONOTTER V ,et al. RAISE:a raw images dataset for digital image forensics[C]// Proceedings of the 6th ACM Multimedia Systems Conference. New York:ACM Press, 2015: 219-224.

Metrics

Recommended 0

No Suggested Reading articles found!

类别	视频序列	文献[18]方法		文献[21]方法		本文方法
类别	视频序列	BD-BR	TS	BD-BR	TS	BD-BR	TS
B	BasketballDrive	0.18%	13.41%	1.79%	33.78%	0.05%	27.05%
1 920 pixel×1 080 pixel	BQTerrace	0.38%	12.52%	0.58%	30.27%	0.02%	18.31%
	Cactus	0.27%	13.46%	0.81%	30.11%	0.03%	27.80%
C	BasketballDrill	0.12%	25.32%	0.92%	29.93%	0.11%	48.24%
832 pixel×480 pixel	BQMall	-0.03%	16.22%	1.09%	32.63%	0.11%	47.26%
	PartyScene	0.00%	17.97%	0.22%	25.50%	0.04%	35.18%
	RaceHorses	0.19%	17.30%	0.45%	31.64%	0.08%	46.38%
D	BasketballPass	0.32%	13.29%	1.13%	29.19%	0.14%	46.36%
416 pixel×240 pixel	BlowingBubbles	0.12%	14.42%	0.23%	23.93%	0.04%	40.55%
	BQSquare	0.32%	20.93%	0.08%	19.95%	0.02%	26.23%

类别	视频序列	本文方法
类别	视频序列	BD-BR	TS
B	BasketballDrive	0.05%	27.05%
1 920 pixel× 1 080 pixel	BQTerrace	0.02%	18.31%
	Cactus	0.03%	27.80%
	Kimono1	0.03%	27.48%
	ParkScene	0.03%	20.29%
C	BasketballDrill	0.11%	48.24%
832 pixel× 480 pixel	BQMall	0.11%	47.26%
	PartyScene	0.04%	35.18%
	RaceHorses	0.08%	46.38%
D	BasketballDrive	0.14%	46.36%
416 pixel× 240 pixel	BQTerrace	0.04%	40.55%
	Cactus	0.02%	26.23%
	Kimono1	0.06%	40.86%
E	BasketballDrive	0.15%	50.24%
1 280 pixel× 720 pixel	BQTerrace	0.24%	46.30%
	Cactus	0.14%	45.54%

A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 22

Related Articles 15

Metrics

Recommended 0

[1]	Min LU, Juan HU, Xianchao ZHANG, Weijian DING, Guangxue YUE. Personalized recommendation model based on users multi-features fusion [J]. Telecommunications Science, 2023, 39(5): 101-115.
[2]	Bin ZHUGE, Zhenghu YIN, Wenxue SI, Lei YAN, Ligang DONG, Xian JIANG. Student knowledge tracking based multi-indicator exercise recommendation algorithm [J]. Telecommunications Science, 2022, 38(9): 129-143.
[3]	Jie ZHOU, Bernardo Esono Esono Mikue, Xueying WANG, Huiting ZHOU, Hong LUO. PAPR optimization based on SLM and PTS algorithms in NC-OFDM systems [J]. Telecommunications Science, 2022, 38(7): 63-74.
[4]	Qing SHEN, Wenbin GUO, Jungang LOU, Qiangguo YU. Personalized recommendation model with multi-level latent features [J]. Telecommunications Science, 2022, 38(2): 71-83.
[5]	Panpan LI, Zhengxia XIE, Guangxue YUE, Xin LIU. Research progress and trends of deep learning based wireless communication receiving method [J]. Telecommunications Science, 2022, 38(2): 1-17.
[6]	Zhihong CHEN, Mingxiao WANG. Application of computer vision in intelligent security [J]. Telecommunications Science, 2021, 37(8): 142-147.
[7]	Shujun SUN, Shengliang PENG, Yudong YAO, Xi YANG. A survey of deep learning based modulation recognition [J]. Telecommunications Science, 2021, 37(5): 82-90.
[8]	Boheng TANG, Xingang CHAI. Cloud-edge collaboration based computer vision inference mechanism [J]. Telecommunications Science, 2021, 37(5): 72-81.
[9]	Shuang PENG, Xiaodong WANG, Zongju PENG, Fen CHEN. Fast QTMT partition decision based on deep learning [J]. Telecommunications Science, 2021, 37(4): 73-81.
[10]	Daoyun HU, Jin QI, Qianchun LU, Feng LI, Hongqiang FANG. Research and application of traffic engineering algorithm based on deep learning [J]. Telecommunications Science, 2021, 37(2): 107-114.
[11]	Xiang MENG, Haibing YIN, Xiaofeng HUANG. Statistical modeling based fast rate distortion estimation algorithm for HEVC [J]. Telecommunications Science, 2021, 37(1): 58-68.
[12]	Jie ZHANG, Lihua YANG, Zenghao WANG, Bo HU, Qian NIE. A novel deep learning based time-varying channel prediction method [J]. Telecommunications Science, 2021, 37(1): 39-47.
[13]	Yuanning LI,Baifeng NING,Zhaojie DONG. Patrol image analysis framework and deep learning method for power grid [J]. Telecommunications Science, 2020, 36(8): 167-174.
[14]	Tingting ZHANG,Jianwu ZHANG,Chunsheng GUO,Huahua CHEN,Di ZHOU,Yansong WANG,Aihua XU. A survey of image object detection algorithm based on deep learning [J]. Telecommunications Science, 2020, 36(7): 92-106.
[15]	Rui GUO,Fanchun RAN. Polar codes decoding algorithm based on convolutional neural network [J]. Telecommunications Science, 2020, 36(6): 119-124.