一种自由视点视频系统中立体图像质量的评价方法

doi:10.11959/j.issn.1000-0801.2018038

电信科学 ›› 2018, Vol. 34 ›› Issue (3): 76-85.doi: 10.11959/j.issn.1000-0801.2018038

一种自由视点视频系统中立体图像质量的评价方法

王士培,彭宗举,陈芬,蒋刚毅,郁梅

宁波大学信息科学与工程学院，浙江宁波 315211

修回日期:2017-10-26 出版日期:2018-03-01 发布日期:2018-04-02
作者简介:王士培（1994-），女，宁波大学信息科学与工程学院硕士生，主要研究方向为虚拟视点绘制及其质量评价。|彭宗举（1973-），男，博士，宁波大学信息科学与工程学院教授，主要研究方向为三维视频信号处理与编码。|陈芬（1973-），女，博士，宁波大学信息科学与工程学院副教授，主要研究方向为三维视频信号处理与编码。|蒋刚毅（1964-），男，博士，宁波大学信息科学与工程学院教授，主要研究方向为三维视频信号处理与编码。|郁梅（1968-），女，博士，宁波大学信息科学与工程学院教授，主要研究方向为三维视频信号处理与编码。
基金资助:
国家自然科学基金资助项目(61771269);国家自然科学基金资助项目(61620106012);国家自然科学基金资助项目(U1301257);浙江省自然科学基金资助项目(LY16F010002);浙江省自然科学基金资助项目(LY15F010005);浙江省自然科学基金资助项目(LY17F010005)

A quality assessment metric for stereoscopic image in free viewpoint video system

Shipei WANG,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU

Faculty of Information Science and Engineering,Ningbo University,Ningbo 315211,China

Revised:2017-10-26 Online:2018-03-01 Published:2018-04-02
Supported by:
The National Natural Science Foundation of China(61771269);The National Natural Science Foundation of China(61620106012);The National Natural Science Foundation of China(U1301257);The Natural Science Foundation of Zhejiang Province of China(LY16F010002);The Natural Science Foundation of Zhejiang Province of China(LY15F010005);The Natural Science Foundation of Zhejiang Province of China(LY17F010005)

摘要/Abstract

摘要：

提出了一种自由视点视频系统中立体图像的质量评价方法。分别对参考图像与失真图像进行小波分解后用对比敏感度函数加权，计算两者之间的平均结构相似度得到基于内容的质量分数；在双目匹配区域中找到中心凹区域，在该区域上计算图像之间的平均相位相似度，得到基于深度感知的质量分数；利用阈值提取匹配区域中为人眼所感知的失真区域，与利用视差映射过来的另一视点图像的相对应区域计算平均结构相似度得到基于双目特性的质量分数。融合各部分质量分数得到最终图像质量。实验结果表明，本算法评价结果与主观感知一致性较好，更符合人眼视觉特性。

关键词: 自由视点视频, 立体图像, 虚拟视点, 人眼视觉特性, 深度感知

Abstract:

A quality assessment metric of stereoscopic image in free viewpoint video system was proposed.After the reference and distorted images being decomposed by wavelet then weighted by contrast sensitivity function respectively,the content score was obtained by calculating the average structural similarity.After the center region being found in the binocular matching region,the average phase similarity was calculated on the region to obtain depth perception.The distortion region perceived by the human eye in the matching region by using the threshold,the average structural similarity was calculated between this region and the corresponding region of the other view image by disparity mapping,then the binocular characteristic score was obtained.The final image quality can be obtained by fusing score of each part.The experimental results show that the proposed algorithm has better consistency with subjective perception and it is more in line with human visual characteristics.

Key words: free viewpoint video, stereo image, virtual viewpoint, human visual characteristic, depth perception

中图分类号:

TP391.41

王士培,彭宗举,陈芬,蒋刚毅,郁梅. 一种自由视点视频系统中立体图像质量的评价方法[J]. 电信科学, 2018, 34(3): 76-85.

Shipei WANG,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU. A quality assessment metric for stereoscopic image in free viewpoint video system[J]. Telecommunications Science, 2018, 34(3): 76-85.

图/表 8

图1

图2

图3

图4

图5

图6

表1

图7

参考文献 22

[1]	陈晓贝，魏克军 . 全球5G研究动态和标准进展[J]. 电信科学， 2015,31(5):16-19.
	CHEN X B ， WEI K J . Global research and standardization progress of 5G[J]. Telecommunications Science, 2015,31(5):16-19.
[2]	卢卫，陆希玉 . 4G时代移动互联网的发展趋势[J]. 电信科学， 2014,30(5):51-54.
	LU W ， LU X Y . Mobile internet trends in 4G era[J]. Telecommunications Science, 2014,30(5):51-54.
[3]	林金桐，许晓东 . 第五代移动互联网[J]. 电信科学， 2015,31(5):7-14.
	LIN J T ， XU X D . The 5th generation of mobile internet[J]. Telecommunications Science, 2015,31(5):7-14.
[4]	COLLET A , CHUANG M , SWEENEY P , et al. High quality streamable free viewpoint video[J]. ACM Transactions on Graphics, 2015,34(4):1-13.
[5]	FEHN C , . Depth image based rendering (DIBR),compression and transmission for a new approach on 3D TV[J]. Proceedings of the 2004 SPIE Stereoscopic Displays and Virtual Reality Systems XI, 2004(5291):93-104.
[6]	CHO J H , SONG W , CHOI H , et al. Hole filling method for depth image based rendering based on boundary decision[J]. IEEE Signal Processing Letters, 2017,24(3):329-333.
[7]	WANG Z , BOVIK A C , SHEIKH H R , et al. mage quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004(13):600.
[8]	BOSC E . Towards a new quality metric for 3D synthesized view assessment[J]. IEEE Journal of Selected Topics in Signal Processing, 2011,5(7):1332-1343.
[9]	BENOIT P , CALLETL , CAMPISI P , et al. Using disparity for quality assessment of stereoscopic images[C]// 2008 IEEE International Conference Image Processing, October 12-15, 2008, San Diego,California America.Piscataway: IEEE Press, 2008:389-392.
[10]	CHEN M J , SU C C , KWON D K , et al. Full reference quality assessment of stereopairs accounting for rivalry[J]. Signal Processing Image Communication, 2013,28(9):1143-1155.
[11]	SHAO F , LIN W , GU S , et al. Perceptual full reference quality assessment of stereoscopic images by considering binocular visual characteristics[J]. IEEE Transactions on Image Processing, 2013,22(5):1940-1953.
[12]	ZHOU W , YU L . Binocular responses for no reference 3D image quality assessment[J]. IEEE Transactions on Multimedia, 2016,18(6):1077-1084.
[13]	CHEN F , JIAO R , PENG Z , et al. Virtual view quality assessment based on shift compensation and visual masking effect[J]. Journal of Visual Communication ＆ Image Representation, 2017(43):41-49.
[14]	BATTISTI F , BOSC E , CARLI M , et al. Objective image quality assessment of 3D synthesized views[J]. Signal Processing Image Communication, 2015,30(C):78-88.
[15]	YONG J J , KIM H G , YONG M R , et al. Critical binocular asymmetry measure for the perceptual quality assessment of synthesized stereo 3D Images in view synthesis[J]. IEEE Transactions on Circuits ＆ Systems for Video Technology, 2016,26(7):1201-1214.
[16]	GAO X , LU W , TAO D , et al. Image quality assessment and human visual system[J]. Proceedings of The International Society for Optical Engineering, 2010,7744(5):17-19.
[17]	RIBEIRO F , FLORêNCIO D . Region of interest determination using human computation[C]// IEEE International Workshop on Multimedia Signal Processing, October 17-19, 2011, Hangzhou,China.Piscataway: IEEE Press, 2011:1-5.
[18]	ZHANG L , MOU X . FSIM:a feature similarity index for image quality assessment[J]. IEEE Transactions on Image Processing, 2011,20(8):2378-2386.
[19]	ZHAO Y , CHEN Z , ZHU C , et al. Binocular just noticeable difference model for stereoscopic images[J]. IEEE Signal Processing Letters, 2011,18(1):19-22.
[20]	WANG J , REHMAN A , ZENG K , et al. Quality prediction of asymmetrically distorted stereoscopic 3D images[J]. IEEE Transactions on Image Processing a Publication of the IEEE Signal Processing Society, 2015,24(11):3400-3414.
[21]	IVY LAB Stereoscopic 3D image database for quality assessment of synthesized stereo imagesEB/OL]. (2014-10-01).[2017-06-03]. .
[22]	Middlebury stereo datasetsEB/OL]. (2015-06-29).[2017-06-03]. .

评价指标		PLCC	SROCC	RMSE
客观评价算法	SSIM	0.351	0.381	13.585
	MS_SSIM	0.637	0.647	11.180
	VIF	0.388	0.299	13.373
	Benoit	0.452	0.438	12.944
	3DSwIM	0.527	0.499	12.330
	Bosc	0.642	0.596	11.135
	Chen	0.687	0.695	10.631
	Jung	0.826	0.829	8.181
	本文算法	0.855	0.834	11.28

一种自由视点视频系统中立体图像质量的评价方法

A quality assessment metric for stereoscopic image in free viewpoint video system

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 8

参考文献 22

相关文章 3

Metrics

推荐阅读 0

[1]	邢亚芬, 殷海兵, 王鸿奎, 骆琼华. 基于视频时域感知特性的恰可察觉失真模型[J]. 电信科学, 2022, 38(2): 92-102.
[2]	崔帅南,彭宗举,邹文辉,陈芬,陈华. 多特征融合的合成视点立体图像质量评价[J]. 电信科学, 2019, 35(5): 104-112.
[3]	戴庆焰,朱仲杰. 基于图割和视域相关性的立体图像分割[J]. 电信科学, 2015, 31(11): 77-84.