基于模糊量化和2 bit深度像素的运动估计算法

doi:10.3969/j.issn.1000-436x.2013.07.007

通信学报 ›› 2013, Vol. 34 ›› Issue (7): 59-70.doi: 10.3969/j.issn.1000-436x.2013.07.007

基于模糊量化和2 bit深度像素的运动估计算法

宋传鸣^1,^2,³,郭延文²,王相海^1,^2,³,刘丹¹

¹ 辽宁师范大学计算机与信息技术学院，辽宁大连 116029;
² 南京大学计算机软件新技术国家重点实验室，江苏南京 210093;
³ 南京邮电大学江苏省图像处理与图像通信重点实验室，江苏南京210046

出版日期:2013-07-25 发布日期:2017-06-24
基金资助:
国家自然科学基金资助项目;国家自然科学基金资助项目;国家自然科学基金资助项目;辽宁省自然科学基金资助项目;辽宁省博士科研启动基金资助项目;辽宁百千万人才工程基金资助项目;计算机软件新技术国家重点实验室（南京大学）开放基金资助项目;计算机软件新技术国家重点实验室（南京大学）开放基金资助项目;江苏省图像处理与图像通信重点实验室（南京邮电大学）开放基金资助项目;江苏省图像处理与图像通信重点实验室（南京邮电大学）开放基金资助项目;辽宁省高等学校科学技术计划基金资助项目;大连市科学技术基金资助项目

Motion estimation algorithm using 2 bit-depth pixel and fuzzy quantization

Chuan-ming SONG^1,^2,³,Yan-wen GUO²,Xiang-hai WANG^1,^2,³,Dan LIU¹

¹ College of Computer and Information Technology, Liaoning Normal University, Dalian 116029, China;
² State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210093, China;
³ Key Laboratory for Image Processing ＆ Communication of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing 210046, China

Online:2013-07-25 Published:2017-06-24
Supported by:
The National Natural Science Foundation of China;The National Natural Science Foundation of China;The National Natural Science Foundation of China;The Natural Science Foundation of Liaoning Province;The Scientific Research Foundation for PhD of Liaoning Province;The BaiQianWan Talents Program of Liaoning Province;The Open Foundation of State Key Laboratory for Novel Soft-ware Technology of Nanjing University;The Open Foundation of State Key Laboratory for Novel Soft-ware Technology of Nanjing University;The Jiangsu Key Laboratory's Open Foundation of Image Processing and Image Communication of Nanjing University of Posts ＆ Telecommunications;The Jiangsu Key Laboratory's Open Foundation of Image Processing and Image Communication of Nanjing University of Posts ＆ Telecommunications;The Foundation of Science and Technology Plan for Higher Education of Liaoning Province;The Foundation for Science and Technology of Dalian

摘要/Abstract

摘要：

提出了一种2bit深度像素的运动估计算法。首先，将像素深度的降采样过程形式化为区间分划和区间映射2个步骤，其中前者为多对一映射，决定着运动估计性能，后者为一一映射；其次，提出一种非均匀量化方法求解区间分划的3个初始阈值，并利用隶属度函数对初始阈值细化，从而克服信号噪声等因素导致的初始阈值周围像素值的误匹配；再次，讨论了适用于2bit深度像素运动估计的误差度量准则，进而提出了基于模糊量化和2bit深度像素的运动估计算法；最后，借助信号自相关函数，建立比特深度转换误差—运动向量精度模型来估计该算法所能达到的预测精度。实验结果证明，对于多种类型的视频序列，尤其是场景细节和物体运动比较复杂者，该算法始终能保持较高的估计精度，运动补偿的平均峰值信噪比较之传统2 bit深度像素的运动估计提高0.27 dB。

关键词: 视频编码, 运动估计, 块匹配, 模糊量化, 低比特分辨率

Abstract:

A motion estimation algorithm was proposed using 2 bit-depth pixels. The reduction of pixel depth was first formalized by two successive steps, namely interval partitioning and interva mapping. The former is a many-to-one mapping which determines motion estimation performance, while the latter is a one-to-one mapping. A non-uniform quantization method was then presented to compute three initial thresholds of the interval partitioning. These initial thre-sholds were subsequently refined by using a membership function to solve the mismatch of pixel values near them caused by signal noise and so on. Afterwards, a matching criterion was discussed suitable for the motion estimation using 2 bit-depth pixels. A novel motion estimation algorithm was consequently addressed based on 2 bit-depth pixels and fuzzy quantiza-tion. To further predict the precision of the proposed algorithm, a bit resolution reduction error-motion vector precision model was built by exploiting the auto-correlation function. Extensive experimental results show that the proposed algo-rithm can always achieve high motion estimation precis rious characteristics, especially for those with detailed scene and complex motion. Compared with traditional 2 bit motion estimation, the proposed algorithm gains 0.27 dB improvement in terms of average peak signal-to-noise ratio of motion compensation.

Key words: video coding, motion estimation, block matching, fuzzy quantization, low bit-resolution

宋传鸣,郭延文,王相海,刘丹. 基于模糊量化和2 bit深度像素的运动估计算法[J]. 通信学报, 2013, 34(7): 59-70.

Chuan-ming SONG,Yan-wen GUO,Xiang-hai WANG,Dan LIU. Motion estimation algorithm using 2 bit-depth pixel and fuzzy quantization[J]. Journal on Communications, 2013, 34(7): 59-70.

图/表 7

图1

图2

图3

图4

表1

图5

表2

参考文献 37

[1]	ISO/IEC JTC1/SC29/WG11. SVC Requirements Specified by MPEG:JVT-N026[S]. 2005.
[2]	SULLIVANG J , OHMJ R , ORTEGA A , et al . Future of video coding and transmission[J]. IEEE Signal Processing Magazine, 200,23(6):76-82.
[3]	高文, 赵德斌, 马思伟 . 数字视频编码技术原理[M]. 北京: 科学出版社, 2010.
[4]	ERTüRK A , ERTüRK S . Two-bit transform for binary block motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005,15(7):938-946.
[5]	CHEN Z , XU J , HE Y , et al . Fast integer-pel and fractional-pel motion estimation for H.264/AVC[J]. Journal of Visual Communication and Image Representation, 2006,17(2):264-290.
[6]	PO L M , MA W C . A novel four-step search algorithm for fast block motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 1996,6(3):313-317.
[7]	LIU L K , FEIG E . A block-based gradient descent search algorithm for block motion estimation in video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 1996,6(4):419-423.
[8]	ZHU S , MA K K . A new diamond search algorithm for fast block-matching motion estimation[J]. IEEE Security and Privacy, 2000,9(2):287-290.
[9]	CHEUNG C H , PO L M . Novel cross-diamond-hexagonal search algorithms for fast block motion estimation[J]. IEEE Transactions on Multimedia, 2005,7(1):16-22.
[10]	LOU C C , LEE S W , JAY KUO C C . Adaptive motion search range prediction for video encoding[J]. IEEE Transcations on Circuits and Systems for Video Technology, 2010,20(12):1903-1908.
[11]	LIN W , PANUSOPONE K , BAYLON D M , et al . A fast sub-pixel motion estimation algorithm for H.264/AVC video coding[J]. IEEE Transcations on Circuits and Systems for Video Technology, 2011,21(2):237-243.
[12]	CHEUNG C K , PO L M . Normalized partial distortion search algo-rithm for block motion estimation[J]. IEEE Transcations on Circuits and Systems for Video Technology, 2000,10(3):417-422.
[13]	宋传鸣, 王相海 . 小波域视频运动估计研究进展[J]. 计算机学报, 2005,28(10):1716-1727.
[14]	ZHANG R , COMER M L . Rate distortion performance of pyramid and subband motion compensation based on quantization heory[J]. IEEE Transcations on Circuits and Systems for Video Technology, 2010,20(12):1876-1881.
[15]	WANG Y , WANG Y , KURODA H . A globally adaptive pix-el-decimation algorithm for block-motion estimation[J]. IEEE Trans-actions on Circuits and Systems for Video Technology, 2000,10(6):1006-1011.
[16]	KIM J , CHOI T . A fast full-search motion-estimation algorithm using representative pixels and adaptive matching scan[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2000,10(7):1040-1048.
[17]	CHEN M J , CHEN L G , CHIUEH T D , et al . A new block-matching criterion for motion estimation and its implementation[J]. IEEE Transactions onCircuits and Systems for Video Technology, 1995,5(3):231-236.
[18]	NATARAJAN B , BHASKARAN V , KONSTANTINIDES K . Low-complexity block-based motion estimation via one-bit transforms[J]. IEEE Transactions on Circuits and Systems for Video Technology, 1997,7(4):702-706.
[19]	ERTüRK S . Multiplication-free one-bit transform for low-complexity block-based motion estimation[J]. IEEE Signal Processing Letters, 2007,14(2):109-112.
[20]	LEE H , JEONG J . Early termination scheme for binary motion estima-tion[J]. IEEE Transactions on Consumer Electronics, 2007,53(4):1682-1686.
[21]	WU C B , YAO C Y , LIU B D , et al . DCT-based adaptive thresholding algorithm for binary motion estimation[J]. IEEE Transactions on Cir-cuits and Systems for Video Technology, 2005,15(5):694-703.
[22]	CELEBI A , AKBULUT O , URHAN O , et al . An all binary sub-pixel motion estimation approach and its hardware architecture[J]. IEEE Transactions on Consumer Electronics, 2008,54(4):1928-1937.
[23]	LUO J H , WANG C N , CHIANG T . A novel all-binary motion estimation (ABME) with optimized hardware architectures[J]. IEEE ransactions on Circuits and Systems for Video Technology, 2002,12(8):700-712.
[24]	URHAN O , ERTüRK S . Constrained one-bit transform for low com-plexity block motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007,17(4):478-482.
[25]	LEE X , ZHANG Y Q . A fast hierarchical motion-compensation scheme for video coding using block feature matching[J]. IEEE Transac-tions on Circuits and Systems for Video Technology, 1996,6(6):627-635.
[26]	WONG P H W , AU O C . Modified one-bit transform for motion esti-mation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 1999,9(7):1020-1024.
[27]	SONG X , CHIANG T , LEE X , et al . New fast binary pyramid motion estimation for MPEG2 and HDTV encoding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2000,10(7):1015-1028.
[28]	LEE S , CHAE S I . Motion estimation algorithm using low resolution quantisation[J]. Electronics Letters, 1996,32(7):647-648.
[29]	LEE S , KIM J M , CHAE S I . New motion estimation algorithm using adaptively quantized low bit-resolution image and its VLSI architec-ture for MPEG2 video encoding[J]. IEEE Transactions onCircuits and Systems for Video Technology, 1998,8(6):734-744.
[30]	Block motion estimation using adaptive mod-ified two-bit transform[J]. IET Image Processing, 2007,1(2):215-222.
[31]	BAEK Y , OH H S , LEE H K . An efficient block-matching criterion for motion estimation and its VLSI implementation[J]. IEEE Transactions on Consumer Electronics, 1996,42(4):885-892.
[32]	HE Z L , TSUI C Y , CHAN K K , et al . Low-power VLSI design for motion estimation using adaptive pixel truncation[J]. IEEE Transactions et alon Circuits and Systems for Video Technology, 2000,10(5):669-678.
[33]	张武健, 邱晓海, 周润德等 . 一种新的使用两种比特分辨率图象的块匹配运动估计算法及其低功耗 VLSI 结构[J]．电子学报, 2001,29(6):860-864.
[34]	PATRAS I , HENDRIKS E A , LAGENDIJK R L . Probabilistic confi-dence measures for block matching motion estimation[J]. IEEE Trans-actions on Circuits and Systems for Video Technology, 2007,17(8):988-995.
[35]	MAX J . Quantizing for minimum distortion[J]. IRE Transactions on Information Theory, 1960,6(1):7-12.
[36]	LLOYD S P . Least squares quantization in PCM[J]. IEEE Transactions on Information Theory, 1982,28(2):129-137.
[37]	RIBAS-CORBERA J , NEUHOFF D L . Optimizing motion-vector accuracy in block-based video coding[J]. IEEE Transactions on Cir-cuits and Systems for Video Technology, 2001,11(4):497-511.

序列名称	8b-FS	1b-FS	2b-FS	T-FS	AQ-FS	FQ-FS
Football	27.46	24.79	25.85	25.75	26.14	26.58
Flower	26.03	25.67	25.84	25.83	25.86	25.93
Mobile	23.96	23.52	23.61	23.78	23.62	23.80
Paris	30.70	30.17	30.17	30.45	30.27	30.49
Tennis	28.91	27.28	27.95	28.19	28.10	28.25
Silent	36.27	34.80	35.12	34.98	35.40	35.59
Stefan	25.90	25.27	25.44	25.70	25.49	25.70
Soccer	29.61	28.22	28.32	28.01	28.57	28.84
Tempete	27.75	27.09	27.29	27.47	27.36	27.58
Akiyo	42.67	41.93	42.23	41.84	42.33	42.11
Bus	24.87	23.80	24.14	24.49	24.31	24.50
Sign Irene	33.56	32.35	32.59	32.57	32.84	33.03
Husky	19.70	19.43	19.46	19.61	19.47	19.61
Salesman	39.41	39.19	39.25	38.78	39.18	39.27
City	30.86	30.07	30.29	28.66	30.40	30.41
Harbour	28.10	26.77	27.45	27.00	27.48	27.70

阶段	操作	8b-FS	1b-FS	2b-FS	T-FS	AQ-FS	FQ-FS
	加法	0	24	2.843 8	0	1.5	1.250 7
	乘法	0	1	1.062 5	0	5.859 4×10^{- 3}	0.500 7
比特深度	比较	0	1	3	0	7.5	3.001 3
转换阶段	取绝对值	0	0	0	0	0.5	4.932 2×10^{- 6}
	开平方	0	0	0	0	0	4.932 2×10^{- 6}
	位运算	0	0	0	2	0	0
	8 bit定点整数加法	2 048	0	0	0	0	0
	2 bit整数加法	0	0	1 024	1 024	1 024	1 024
运动估计	1 bit整数加法	0	1 024	0	0	0	0
阶段	取绝对值	1 024	0	0	0	0	0
	位运算	0	1 024	3 072	0	3 072	0
	查表运算	0	0	0	1 024	0	1 024

基于模糊量化和2 bit深度像素的运动估计算法

Motion estimation algorithm using 2 bit-depth pixel and fuzzy quantization

在线阅读

PDF下载

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 7

参考文献 37

相关文章 15

Metrics

推荐阅读 0

[1]	张伟, 王宇, 陈新怡, 王延文, 景庆阳, 雷为民. 基于图像块码本模型的监控视频背景参考帧生成方法[J]. 通信学报, 2023, 44(1): 129-141.
[2]	郭红伟, 朱策, 杨栩, 罗雷. 基于失真反向传播的时域依赖率失真优化[J]. 通信学报, 2022, 43(12): 222-232.
[3]	公衍超, 王玲, 刘颖, 杨楷芳, 林庆帆, 王富平. 视频主观观测实验启发的HEVC感知帧内码率控制[J]. 通信学报, 2021, 42(8): 90-102.
[4]	李跃,杨高波,丁湘陵,朱亚培. 基于学习模型的3D-HEVC提前Merge模式终止算法[J]. 通信学报, 2019, 40(7): 104-113.
[5]	王汝言,杨衍,吴大鹏. QoE感知的FiWi视频分发机制[J]. 通信学报, 2018, 39(1): 1-13.
[6]	朱威,张训华,王财盛,张桦. 基于时空相关性的HEVC帧间模式决策快速算法[J]. 通信学报, 2016, 37(4): 64-73.
[7]	刘杰平,王琴玲,何越盛,韦岗. 分布式编码中广义伽马分布相关噪声模型研究[J]. 通信学报, 2016, 37(3): 33-39.
[8]	刘晟,彭宗举,陈嘉丽,陈芬,郁梅,蒋刚毅. 基于多类支持向量机的3D-HEVC深度视频帧内编码快速算法[J]. 通信学报, 2016, 37(11): 181-188.
[9]	肖进胜,李文昊,姜红,彭红,朱神添. 基于双域滤波的三维块匹配视频去噪算法[J]. 通信学报, 2015, 36(9): 91-97.
[10]	陈健,惠超,阔永红. 无反馈分布式视频编码中的速率控制算法[J]. 通信学报, 2014, 35(6): 32-38.
[11]	陈健，惠超，阔永红. 无反馈分布式视频编码中的速率控制算法[J]. 通信学报, 2014, 35(6): 5-38.
[12]	宋传鸣1,2,3，郭延文2，王相海1,2,3，刘丹1. 基于模糊量化和2 bit深度像素的运动估计算法[J]. 通信学报, 2013, 34(7): 7-70.
[13]	刘西蒙1，刘光军1，马建峰2，熊金波2. 可伸缩视频流的安全网络编码方案[J]. 通信学报, 2013, 34(5): 21-191.
[14]	刘西蒙,刘光军,马建峰,熊金波. 可伸缩视频流的安全网络编码方案[J]. 通信学报, 2013, 34(5): 184-191.
[15]	黄韬,张丽,张云勇,刘韵洁. 基于OpenFlow的SVC流媒体时延自适应分级传输方法[J]. 通信学报, 2013, 34(11): 121-128.