全景媒体的系统架构研究综述

doi:10.11959/j.issn.1000-0801.2018007

Abstract

Abstract:

With the development of virtual reality technology,the formulation and perfection of omnidirectional media system standard plays a more important role.In order to standardize the virtual reality system,it is of great value to study the system architecture of omnidirectional media.Firstly,the current development of virtual reality technology and the problems in practical application were reviewed.Secondly,the structure and development trend of the application framework of omnidirectional media were introduced.Then the application architectures of MPEG OMAF,Facebook and Google were introduced separately.Through the comparative analysis of several system architecture schemes,the development of omnidirectional multimedia was summarized and prospected.

Key words: virtual reality, omnidirectional media, OMAF, application architecture, standard organization

CLC Number:

TP393

Ying LUO,Li SONG,Rong XIE,Chuanfei LUO. Review of system architecture of omnidirectional media[J]. Telecommunications Science, 2018, 34(2): 88-98.

Figures/Tables 12

References 23

[1]	董振江, 张东卓, 黄成 ,等. 虚拟现实视频处理与传输技术[J]. 电信科学, 2017,33(8): 45-52.
	DONG Z J , ZHANG D Z , HUANG C ,et al. Technology of virtual reality video processing and streaming[J]. Telecommunications Science, 2017,33(8): 45-52.
[2]	ISO/IEC JTC1/SC29/WG11/M37044.Use cases and requirements of omnidirectional media format,MPEG 113[S]. 2015.
[3]	ISO/IEC JTC1/SC29/WG11/N16189.WD on ISO/IEC 23000-20 omnidirectional media application format,MPEG 116[S]. 2016.
[4]	ISO/IEC JTC1/SC29/WG11/M37152.Future video coding requirements on virtual reality,MPEG 113[S]. 2015.
[5]	ISO/IEC JTC1/SC29/WG11/M37914.Support of vr video in iso base media file format,MPEG114[S]. 2016.
[6]	ISO/IEC JTC1/SC29/WG11/M38662.Dash descriptor for omnidirectional media,MPEG 115[S]. 2016.
[7]	WANG R G . VRU (virtual reality union) meeting report,AVS-N2422[R]. 2017.
[8]	ISO/IEC JTC1/SC29/WG11/N16824.Text of iso/iec dis 23090-2 omnidirectional media format,MPEG 118[S]. 2017.
[9]	ISO/IEC JTC1/SC29/WG11/M39469.OMAF:lens shading parameters metadata for omnidirectional video,MPEG 116[S]. 2016.
[10]	ISO/IEC JTC1/SC29/WG11/M39380.OMAF:camera and lens parameter for stereo 360-degree video using fisheye cameras,MPEG 116[S]. 2016.
[11]	ISO/IEC JTC1/SC29/WG11/M40178.Update of OMAF PROJ-VE description,MPEG 117[S]. 2017.
[12]	ISO/IEC JTC1/SC29/WG11/N16828.Projections under considerations for ISO/IEC 23000-20 omnidirectional media application format,MPEG 118[S]. 2017.
[13]	BUDAGAVI M , FURTON J , JIN G ,et al. 360 degrees video coding using region adaptive smoothing[C]// IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada. Piscataway:IEEE Press, 2015: 750-754.
[14]	JIN G , SAXENA A , BUDAGAVI M . Motion estimation and compensation for fisheye warped video[C]// IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada. Piscataway:IEEE Press, 2015: 2751-2755.
[15]	SKUPIN R , SANCHEZ Y , HELLGE C ,et al. Tile based HEVC video for head mounted displays[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 399-400.
[16]	HOSSEINI M , SWAMINATHAN V . Adaptive 360 VR video streaming:divide and conquer[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 107-110.
[17]	祝谷乔, 宋皓 . MPEG-DASH与HLS流传输技术的比较分析[J]. 电信科学, 2015,31(4): 23-27.
	ZHU G Q , SONG H . Comparison and analysis of MPEGDASH and HLS adaptive streaming delivery technology[J]. Telecommunications Science, 2015,31(4): 23-27.
[18]	SREEDHAR K K , AMINLOU A , HANNUKSELA M M ,et al. Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 583-586.
[19]	ZARE A , AMINLOU A , HANNUKSELA M M ,et al. HEVC-compliant tile-based streaming of panoramic video for virtual reality applications[C]// Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands. New York:ACM Press, 2016: 601-605.
[20]	XIE L , XU Z M , BAN Y X ,et al. 360ProbDASH:improving QoE of 360 video streaming using tile-based http adaptive streaming[C]// Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands. New York:ACM Press, 2016: 521-525.
[21]	周建同, 杨海涛, 刘东 ,等. 视频编码的技术基础及发展方向[J]. 电信科学, 2017,33(8): 16-25.
	ZHOU J T , YANG H T , LIU D ,et al. Trends and technologies of video coding[J]. Telecommunications Science, 2017,33(8): 16-25.
[22]	FAUTIER T . VR video ecosystem for live distribution[J]. IBC 2016 Conference, 2016,28(13): 32-36.
[23]	QIAN F , JI L S , HAN B ,et al. Optimizing 360 video delivery over cellular networks[C]// Proceedings of the 5th Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA. New York:ACM Press, 2016: 1-6.

Metrics

Recommended 0

No Suggested Reading articles found!

	OMAF	AVS	Facebook	Google
获取设备	全景相机		Surround 360	Google Jump
映射	多种映射模型，如金字塔、立方体等	10种高效映射模型，如圆柱体、双环带等	正六面体、金字塔模型映射方式	ODS映射模型
编码	若干种基于视角编码方案	兼容目前主流的平面视频编码标准	分布式编码	ETC2Comp编码技术与Draco压缩库
传输	基于视角的DASH和MMT方案	可支持HLS、DASH和MMT传输	动态流传输技术	兼容传统方案
呈现设备	Gear VR、HTV Vive、Oculus Rift、Google Cardboard等

Review of system architecture of omnidirectional media

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 23

Related Articles 5

Metrics

Recommended 0

[1]	Jie LIU,Qingyang WANG,Yilin LIN. Mobile VR application in 5G network [J]. Telecommunications Science, 2018, 34(10): 143-149.
[2]	Jiantong ZHOU,Haitao YANG,Dong LIU,Xiang MA,Tian WANG. Trends and technologies of video coding [J]. Telecommunications Science, 2017, 33(8): 16-25.
[3]	Zhenjiang DONG,Dongzhuo ZHANG,Cheng HUANG,Haijun LIU. Technology of virtual reality video processing and streaming [J]. Telecommunications Science, 2017, 33(8): 45-52.
[4]	Chuanfei LUO,Dehui KONG,Xiangkai LIU,Ke XU,Hao YANG. A business realization of VR panoramic video in smart home [J]. Telecommunications Science, 2017, 33(10): 185-193.
[5]	Yingshi Kang,Haining Wang,Jiangfeng Yu. Study on Virtual Design System Based on Cloud Computing [J]. Telecommunications Science, 2011, 27(4): 61-67.