一种自由视点视频系统中立体图像质量的评价方法

doi:10.11959/j.issn.1000-0801.2018038

Abstract

Abstract:

A quality assessment metric of stereoscopic image in free viewpoint video system was proposed.After the reference and distorted images being decomposed by wavelet then weighted by contrast sensitivity function respectively,the content score was obtained by calculating the average structural similarity.After the center region being found in the binocular matching region,the average phase similarity was calculated on the region to obtain depth perception.The distortion region perceived by the human eye in the matching region by using the threshold,the average structural similarity was calculated between this region and the corresponding region of the other view image by disparity mapping,then the binocular characteristic score was obtained.The final image quality can be obtained by fusing score of each part.The experimental results show that the proposed algorithm has better consistency with subjective perception and it is more in line with human visual characteristics.

Key words: free viewpoint video, stereo image, virtual viewpoint, human visual characteristic, depth perception

CLC Number:

TP391.41

Shipei WANG,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU. A quality assessment metric for stereoscopic image in free viewpoint video system[J]. Telecommunications Science, 2018, 34(3): 76-85.

Figures/Tables 8

References 22

[1]	陈晓贝，魏克军 . 全球5G研究动态和标准进展[J]. 电信科学， 2015,31(5):16-19.
	CHEN X B ， WEI K J . Global research and standardization progress of 5G[J]. Telecommunications Science, 2015,31(5):16-19.
[2]	卢卫，陆希玉 . 4G时代移动互联网的发展趋势[J]. 电信科学， 2014,30(5):51-54.
	LU W ， LU X Y . Mobile internet trends in 4G era[J]. Telecommunications Science, 2014,30(5):51-54.
[3]	林金桐，许晓东 . 第五代移动互联网[J]. 电信科学， 2015,31(5):7-14.
	LIN J T ， XU X D . The 5th generation of mobile internet[J]. Telecommunications Science, 2015,31(5):7-14.
[4]	COLLET A , CHUANG M , SWEENEY P , et al. High quality streamable free viewpoint video[J]. ACM Transactions on Graphics, 2015,34(4):1-13.
[5]	FEHN C , . Depth image based rendering (DIBR),compression and transmission for a new approach on 3D TV[J]. Proceedings of the 2004 SPIE Stereoscopic Displays and Virtual Reality Systems XI, 2004(5291):93-104.
[6]	CHO J H , SONG W , CHOI H , et al. Hole filling method for depth image based rendering based on boundary decision[J]. IEEE Signal Processing Letters, 2017,24(3):329-333.
[7]	WANG Z , BOVIK A C , SHEIKH H R , et al. mage quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004(13):600.
[8]	BOSC E . Towards a new quality metric for 3D synthesized view assessment[J]. IEEE Journal of Selected Topics in Signal Processing, 2011,5(7):1332-1343.
[9]	BENOIT P , CALLETL , CAMPISI P , et al. Using disparity for quality assessment of stereoscopic images[C]// 2008 IEEE International Conference Image Processing, October 12-15, 2008, San Diego,California America.Piscataway: IEEE Press, 2008:389-392.
[10]	CHEN M J , SU C C , KWON D K , et al. Full reference quality assessment of stereopairs accounting for rivalry[J]. Signal Processing Image Communication, 2013,28(9):1143-1155.
[11]	SHAO F , LIN W , GU S , et al. Perceptual full reference quality assessment of stereoscopic images by considering binocular visual characteristics[J]. IEEE Transactions on Image Processing, 2013,22(5):1940-1953.
[12]	ZHOU W , YU L . Binocular responses for no reference 3D image quality assessment[J]. IEEE Transactions on Multimedia, 2016,18(6):1077-1084.
[13]	CHEN F , JIAO R , PENG Z , et al. Virtual view quality assessment based on shift compensation and visual masking effect[J]. Journal of Visual Communication ＆ Image Representation, 2017(43):41-49.
[14]	BATTISTI F , BOSC E , CARLI M , et al. Objective image quality assessment of 3D synthesized views[J]. Signal Processing Image Communication, 2015,30(C):78-88.
[15]	YONG J J , KIM H G , YONG M R , et al. Critical binocular asymmetry measure for the perceptual quality assessment of synthesized stereo 3D Images in view synthesis[J]. IEEE Transactions on Circuits ＆ Systems for Video Technology, 2016,26(7):1201-1214.
[16]	GAO X , LU W , TAO D , et al. Image quality assessment and human visual system[J]. Proceedings of The International Society for Optical Engineering, 2010,7744(5):17-19.
[17]	RIBEIRO F , FLORêNCIO D . Region of interest determination using human computation[C]// IEEE International Workshop on Multimedia Signal Processing, October 17-19, 2011, Hangzhou,China.Piscataway: IEEE Press, 2011:1-5.
[18]	ZHANG L , MOU X . FSIM:a feature similarity index for image quality assessment[J]. IEEE Transactions on Image Processing, 2011,20(8):2378-2386.
[19]	ZHAO Y , CHEN Z , ZHU C , et al. Binocular just noticeable difference model for stereoscopic images[J]. IEEE Signal Processing Letters, 2011,18(1):19-22.
[20]	WANG J , REHMAN A , ZENG K , et al. Quality prediction of asymmetrically distorted stereoscopic 3D images[J]. IEEE Transactions on Image Processing a Publication of the IEEE Signal Processing Society, 2015,24(11):3400-3414.
[21]	IVY LAB Stereoscopic 3D image database for quality assessment of synthesized stereo imagesEB/OL]. (2014-10-01).[2017-06-03]. .
[22]	Middlebury stereo datasetsEB/OL]. (2015-06-29).[2017-06-03]. .

Metrics

Recommended 0

No Suggested Reading articles found!

评价指标		PLCC	SROCC	RMSE
客观评价算法	SSIM	0.351	0.381	13.585
	MS_SSIM	0.637	0.647	11.180
	VIF	0.388	0.299	13.373
	Benoit	0.452	0.438	12.944
	3DSwIM	0.527	0.499	12.330
	Bosc	0.642	0.596	11.135
	Chen	0.687	0.695	10.631
	Jung	0.826	0.829	8.181
	本文算法	0.855	0.834	11.28

A quality assessment metric for stereoscopic image in free viewpoint video system

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 22

Related Articles 2

Metrics

Recommended 0

[1]	Shuainan CUI,Zongju PENG,Wenhui ZOU,Fen CHEN,Hua CHEN. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion [J]. Telecommunications Science, 2019, 35(5): 104-112.
[2]	Qingyan Dai,Zhongjie Zhu. Stereo Image Segmentation Based on Graph Cut and Visual Correlation [J]. Telecommunications Science, 2015, 31(11): 77-84.