全景媒体的系统架构研究综述

doi:10.11959/j.issn.1000-0801.2018007

电信科学 ›› 2018, Vol. 34 ›› Issue (2): 88-98.doi: 10.11959/j.issn.1000-0801.2018007

全景媒体的系统架构研究综述

罗莹¹,宋利¹,解蓉¹,罗传飞²

¹ 上海交通大学图像通信与网络工程研究所，上海 200240
² 中国电信股份有限公司上海研究院，上海 200122

修回日期:2017-09-27 出版日期:2018-02-01 发布日期:2018-02-13
作者简介:罗莹（1993-），女，上海交通大学图像通信与网络工程研究所硕士生，主要研究方向为视频通信与处理、虚拟现实技术。|宋利（1975-），男，上海交通大学图像通信与网络工程研究所研究员，主要研究方向为图像处理、视频编码。|解蓉（1975-），女，上海交通大学图像通信与网络工程研究所副教授，主要研究方向为视频编码与通信、视频处理。|罗传飞（1978-），男，中国电信股份有限公司上海研究院高级工程师，主要研究方向为IPTV系统、视频体验技术等。
基金资助:
国家自然科学基金资助项目(61671296);国家自然科学基金资助项目(61521062)

Review of system architecture of omnidirectional media

Ying LUO¹,Li SONG¹,Rong XIE¹,Chuanfei LUO²

¹ Image Communication and Network Engineering Institute,Shanghai Jiao Tong University,Shanghai 200240,China
² Shanghai Research Institute of China Telecom Co.,Ltd.,Shanghai 200122,China

Revised:2017-09-27 Online:2018-02-01 Published:2018-02-13
Supported by:
The National Natural Science Foundation of China(61671296);The National Natural Science Foundation of China(61521062)

摘要/Abstract

摘要：

随着虚拟现实技术的不断发展，全景媒体系统的标准制定与完善逐渐显示出越来越重要的作用。为了规范虚拟现实系统，研究全景媒体的系统架构具有重要的价值。首先回顾了目前虚拟现实技术的发展以及在实际应用中存在的问题。其次，介绍了全景多媒体的应用框架的结构和发展趋势，针对国际标准组织MPEG OMAF架构以及Facebook和Google的全景媒体应用架构进行了简要的介绍。通过对几种系统架构的对比分析，对全景媒体应用的发展做出了总结和展望。

关键词: 虚拟现实, 全景媒体, OMAF, 应用架构, 标准组织

Abstract:

With the development of virtual reality technology,the formulation and perfection of omnidirectional media system standard plays a more important role.In order to standardize the virtual reality system,it is of great value to study the system architecture of omnidirectional media.Firstly,the current development of virtual reality technology and the problems in practical application were reviewed.Secondly,the structure and development trend of the application framework of omnidirectional media were introduced.Then the application architectures of MPEG OMAF,Facebook and Google were introduced separately.Through the comparative analysis of several system architecture schemes,the development of omnidirectional multimedia was summarized and prospected.

Key words: virtual reality, omnidirectional media, OMAF, application architecture, standard organization

中图分类号:

TP393

罗莹,宋利,解蓉,罗传飞. 全景媒体的系统架构研究综述[J]. 电信科学, 2018, 34(2): 88-98.

Ying LUO,Li SONG,Rong XIE,Chuanfei LUO. Review of system architecture of omnidirectional media[J]. Telecommunications Science, 2018, 34(2): 88-98.

图/表 12

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

表1

参考文献 23

[1]	董振江, 张东卓, 黄成 ,等. 虚拟现实视频处理与传输技术[J]. 电信科学, 2017,33(8): 45-52.
	DONG Z J , ZHANG D Z , HUANG C ,et al. Technology of virtual reality video processing and streaming[J]. Telecommunications Science, 2017,33(8): 45-52.
[2]	ISO/IEC JTC1/SC29/WG11/M37044.Use cases and requirements of omnidirectional media format,MPEG 113[S]. 2015.
[3]	ISO/IEC JTC1/SC29/WG11/N16189.WD on ISO/IEC 23000-20 omnidirectional media application format,MPEG 116[S]. 2016.
[4]	ISO/IEC JTC1/SC29/WG11/M37152.Future video coding requirements on virtual reality,MPEG 113[S]. 2015.
[5]	ISO/IEC JTC1/SC29/WG11/M37914.Support of vr video in iso base media file format,MPEG114[S]. 2016.
[6]	ISO/IEC JTC1/SC29/WG11/M38662.Dash descriptor for omnidirectional media,MPEG 115[S]. 2016.
[7]	WANG R G . VRU (virtual reality union) meeting report,AVS-N2422[R]. 2017.
[8]	ISO/IEC JTC1/SC29/WG11/N16824.Text of iso/iec dis 23090-2 omnidirectional media format,MPEG 118[S]. 2017.
[9]	ISO/IEC JTC1/SC29/WG11/M39469.OMAF:lens shading parameters metadata for omnidirectional video,MPEG 116[S]. 2016.
[10]	ISO/IEC JTC1/SC29/WG11/M39380.OMAF:camera and lens parameter for stereo 360-degree video using fisheye cameras,MPEG 116[S]. 2016.
[11]	ISO/IEC JTC1/SC29/WG11/M40178.Update of OMAF PROJ-VE description,MPEG 117[S]. 2017.
[12]	ISO/IEC JTC1/SC29/WG11/N16828.Projections under considerations for ISO/IEC 23000-20 omnidirectional media application format,MPEG 118[S]. 2017.
[13]	BUDAGAVI M , FURTON J , JIN G ,et al. 360 degrees video coding using region adaptive smoothing[C]// IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada. Piscataway:IEEE Press, 2015: 750-754.
[14]	JIN G , SAXENA A , BUDAGAVI M . Motion estimation and compensation for fisheye warped video[C]// IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada. Piscataway:IEEE Press, 2015: 2751-2755.
[15]	SKUPIN R , SANCHEZ Y , HELLGE C ,et al. Tile based HEVC video for head mounted displays[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 399-400.
[16]	HOSSEINI M , SWAMINATHAN V . Adaptive 360 VR video streaming:divide and conquer[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 107-110.
[17]	祝谷乔, 宋皓 . MPEG-DASH与HLS流传输技术的比较分析[J]. 电信科学, 2015,31(4): 23-27.
	ZHU G Q , SONG H . Comparison and analysis of MPEGDASH and HLS adaptive streaming delivery technology[J]. Telecommunications Science, 2015,31(4): 23-27.
[18]	SREEDHAR K K , AMINLOU A , HANNUKSELA M M ,et al. Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications[C]// IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA. Piscataway:IEEE Press, 2016: 583-586.
[19]	ZARE A , AMINLOU A , HANNUKSELA M M ,et al. HEVC-compliant tile-based streaming of panoramic video for virtual reality applications[C]// Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands. New York:ACM Press, 2016: 601-605.
[20]	XIE L , XU Z M , BAN Y X ,et al. 360ProbDASH:improving QoE of 360 video streaming using tile-based http adaptive streaming[C]// Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands. New York:ACM Press, 2016: 521-525.
[21]	周建同, 杨海涛, 刘东 ,等. 视频编码的技术基础及发展方向[J]. 电信科学, 2017,33(8): 16-25.
	ZHOU J T , YANG H T , LIU D ,et al. Trends and technologies of video coding[J]. Telecommunications Science, 2017,33(8): 16-25.
[22]	FAUTIER T . VR video ecosystem for live distribution[J]. IBC 2016 Conference, 2016,28(13): 32-36.
[23]	QIAN F , JI L S , HAN B ,et al. Optimizing 360 video delivery over cellular networks[C]// Proceedings of the 5th Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA. New York:ACM Press, 2016: 1-6.

	OMAF	AVS	Facebook	Google
获取设备	全景相机		Surround 360	Google Jump
映射	多种映射模型，如金字塔、立方体等	10种高效映射模型，如圆柱体、双环带等	正六面体、金字塔模型映射方式	ODS映射模型
编码	若干种基于视角编码方案	兼容目前主流的平面视频编码标准	分布式编码	ETC2Comp编码技术与Draco压缩库
传输	基于视角的DASH和MMT方案	可支持HLS、DASH和MMT传输	动态流传输技术	兼容传统方案
呈现设备	Gear VR、HTV Vive、Oculus Rift、Google Cardboard等

全景媒体的系统架构研究综述

Review of system architecture of omnidirectional media

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 12

参考文献 23

相关文章 8

Metrics

推荐阅读 0

[1]	李玉宏,张朋,金帝,周颖超. 应用对未来网络的需求与挑战[J]. 电信科学, 2019, 35(8): 49-64.
[2]	王凌豪, 王淼, 张亚文, 张玉军. 未来网络应用场景与网络能力需求[J]. 电信科学, 2019, 35(10): 1-12.
[3]	周一青,孙布勒,齐彦丽,彭燕,刘玲,张志龙,刘奕彤,刘丹谱,李兆歆,田霖. 面向通信与计算融合的5G移动增强/虚拟现实[J]. 电信科学, 2018, 34(8): 19-33.
[4]	刘洁,王庆扬,林奕琳. 5G网络中的移动VR应用[J]. 电信科学, 2018, 34(10): 143-149.
[5]	周建同,杨海涛,刘东,马祥,王田. 视频编码的技术基础及发展方向[J]. 电信科学, 2017, 33(8): 16-25.
[6]	董振江,张东卓,黄成,刘海军. 虚拟现实视频处理与传输技术[J]. 电信科学, 2017, 33(8): 45-52.
[7]	罗传飞,孔德辉,刘翔凯,徐科,杨浩. 智慧家庭的VR全景视频业务实现[J]. 电信科学, 2017, 33(10): 185-193.
[8]	康瑛石,王海宁,虞江锋. 基于云计算的虚拟化系统研究[J]. 电信科学, 2011, 27(4): 61-67.