视频编码的技术基础及发展方向

doi:10.11959/j.issn.1000-0801.2017248

Abstract

Abstract:

The current video coding uses block based hybrid architecture,which uses predictive,transform,quantization and entropy coding techniques to efficiently compress video signals.Further optimizations on current architectures provide more flexible processing and coding for local characteristics of video image signals.Video coding based on machine learning was expected to change the existing hybrid coding framework partially or comprehensively,and bring new research ideas to video coding.In addition to existing 2D video signal,the future of video also needs to spherical video coding and volumetric video coding for AR/VR applications,the new video source data format of the video encoding technology has brought new opportunities and challenges.

Key words: video coding, machine learning, virtual reality, spherical video, volumetric video

CLC Number:

TP393

Jiantong ZHOU,Haitao YANG,Dong LIU,Xiang MA,Tian WANG. Trends and technologies of video coding[J]. Telecommunications Science, 2017, 33(8): 16-25.

Figures/Tables 10

References 42

[1]	施唯佳, 蒋力, 贾立鼎 . OTT TV和IPTV的技术比较分析[J]. 电信科学, 2014,30(5): 15-19,26.
	SHI W J , JIANG L , JIA L D . Technique comparative analysis of OTT TV and IPTV[J]. Telecommunications Science, 2014,30(5): 15-19,26.
[2]	魏峥, 施唯佳, 祝谷乔 . 互联网视频中多屏互动技术的应用[J]. 电信科学, 2014,30(5): 27-32,39.
	WEI Z , SHI W J , ZHU G Q . Multi-screen interaction technologies on internet streaming video[J]. Telecommunications Science, 2014,30(5): 27-32,39.
[3]	张敏, 宋杰, 刘晓峰 . 电信运营商面对 OTT 的战略选择[J]. 电信科学, 2014,30(2): 142-146,151.
	ZHANG M , SONG J , LIU X F . Strategic selection of telecom operators to counter OTT[J]. Telecommunications Science, 2014,30(2): 142-146,151.
[4]	MPEG. Presentations of the brainstorming session of the future of video coding standardization:MPEG-w15050[S]. 2014.
[5]	MPEG. Steps towards a future video compression standard:MPEG-w15272[S]. 2015.
[6]	MPEG. Requirements for a future video coding standard:MPEG-w15090[S]. 2015.
[7]	MPEG. Request for contributions on future video compression technology:MPEG-w15273[S]. 2015.
[8]	JVET. Joint call for evidence on video compression with capability beyond HEVC:JVET-F1002[S]. 2017.
[9]	MPEG. Joint group on future video coding technology exploration (JVET):MPEG-w15897[S]. 2015.
[10]	ITU. Coding tools investigation for next generation video coding:ITU-T SG16-C806[S]. 2015.
[11]	JVET. JVET common test conditions and software reference configurations:JVET-B1010[S]. 2016.
[12]	JVET. Algorithm description of joint exploration test model 6:JVET-F1001[S]. 2017.
[13]	YUAN Y , KIM I K , ZHENG X ,et al. Quadtree based nonsquare block structure for inter frame coding in high efficiency video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1707-1719.
[14]	AN J , CHEN Y W , ZHANG K ,et al. Block partitioning structure for next generation video coding:COM 16–C966[S]. 2015.
[15]	JVET. Multi-type-tree:JVET-D0117[S]. 2016.
[16]	YANG H , FU J , LIN S ,et al. Description of video coding technology proposal by Huawei Technologies ＆ Hisilicon Technologies[C]// ISO/IEC JTC1/SC29/WG11,JCTVC-A111,April 15-23,2010,Dresden,Germany.[S.1.:s.n]. 2010.
[17]	KAMP S , WIEN M . Description of video coding technology proposal by RWTH Aachen University[C]// JVT on Video Coding of ITU-T VCEG and ISO/IEC MPEG 1st Meeting,JCTVC,JCTVC-A112,April 15-23,2010,Dresden,Germany.[S.1.:s.n]. 2010.
[18]	KAMP S , WIEN M . Decoder-side motion vector derivation for block-based video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012,22(12): 1732-1745.
[19]	CHIU Y , XU L , ZHANG W ,et al. Description of video coding technology proposal:self derivation of motion estimation and adaptive (Wiener) loop filtering[C]// JCT-VC 1st Meeting,JCTVC-A106,April 15-23,2010,Dresden,Germany.[S.1.:s.n]. 2010.
[20]	CHEN J , CHIEN W J , KARCZEWICZ M ,et al. Further improvements to HMKTA-1.0[J]. Doc VECG-AZO7, 2015.
[21]	LIN S , CHEN H , ZHANG H ,et al. Affine transform prediction for next generation video coding[J]. ITU-T SG16 Doc COM16-C1016, 2015.
[22]	CHEN H , LIANG F , LIN S . Affine SKIP and MERGE modes for video coding[C]// 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP),Oct 19-21,2015,Xiamen,China. New Jersey:IEEE Press, 2015: 1-5.
[23]	LI L , LI H , LIU D ,et al. An efficient four-parameter affine motion model for video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2017.
[24]	WITTMANN S , WEDI T . Transmission of post-filter hints for video coding schemes[C]// 2007 IEEE International Conference on Image Processing,Sept 16-Oct 19,San Antonio,TX,USA. New Jersey:IEEE Press, 2007: 81-84.
[25]	ITU. Adaptive (Wiener) filter for video compression:ITU-T SG16 Contribution C,VCEG-C437[S]. 2008.
[26]	ITU. Adaptive loop filter for improving coding efficiency:ITU-T SG16 Contribution C,VCEG-C402[S]. 2008.
[27]	TSAI C Y , CHEN C Y , YAMAKAGE T ,et al. Adaptive loop filtering for video coding[J]. IEEE Journal of Selected Topics in Signal Processing, 2013,7(6): 934-945.
[28]	JIANG J . Image compression with neural networks–a survey[J]. Signal Processing:Image Communication, 1999,14(9): 737-760.
[29]	TODERICI G , O'MALLEY S M , HWANG S J ,et al. Variable rate image compression with recurrent neural networks[J]. arXiv preprint arXiv:1511.06085, 2015.
[30]	TODERICI G , VINCENT D , JOHNSTON N ,et al. Full resolution image compression with recurrent neural networks[J]. arXiv preprint arXiv:1608.05148, 2016.
[31]	DUMAS T , ROUMY A , GUILLEMOT C . Image compression with stochastic winner-take-all auto-encoder[C]// 2017 IEEE International Conference on Acoustics (ICASSP 2017),March 5-9,2017,New Orleans,USA. New Jersey:IEEE Press, 2017: 1512-1516.
[32]	PRAKASH A , MORAN N , GARBER S ,et al. Semantic perceptual image compression using deep convolution networks[J]. arXiv preprint arXiv:1612.08712, 2016.
[33]	BALLé J , LAPARRA V , SIMONCELLI E P . End-to-end optimization of nonlinear transform codes for perceptual quality[J]. arXiv preprint arXiv:1607.05006, 2016.
[34]	BALLé J , LAPARRA V , SIMONCELLI E P . End-to-end optimized image compression[J]. arXiv preprint arXiv:1611.01704, 2016.
[35]	DONG C , DENG Y , CHANGE Loy C ,et al. Compression artifacts reduction by a deep convolutional network[C]// 2017 IEEE International Conference on Computer Vision (ICCV 2015),Dec 7-13,2015,Santiago,Chile. New Jersey:IEEE Press, 2017: 576-584.
[36]	PARK W S , KIM M . CNN-based in-loop filtering for coding efficiency improvement[C]// 2016 IEEE Image,Video,and Multi dimensional Signal Processing Workshop (IVMSP),July 11-12,2016,Bordeaux,France. New Jersey:IEEE Press, 2016: 1-5.
[37]	DAI Y , LIU D , WU F . A convolutional neural network approach for post-processing in HEVC intra coding[C]// 2017 International Conference on Multimedia Modeling (MMM 2017),January 4-6,2017,Reykjavik,Iceland. Heidelberg:Springer, 2017: 28-39.
[38]	LIU Z , YU X , CHEN S ,et al. CNN oriented fast HEVC intra CU mode decision[C]// 2016 IEEE International Symposium on Circuits and Systems (ISCAS 2016),May 22-25,2016,Montreal,Canada. New Jersey:IEEE Press, 2016: 2270-2273.
[39]	LAFRUIT G , QUACKENBUSH S , FOESSEL S ,et al. Technical report of the joint ad hoc group for digital representations of light/sound fields for immersive media applications[R]. 2016.
[40]	TULVAN C , MEKURIA R , LI Z ,et al. Use cases for point cloud compression[R]. 2016.
[41]	MEKURIA R , LI Z , TULVAN C . Call for proposals for point cloud compression[R]. 2017.
[42]	PALOMO C M . Interactive image-based rendering for virtual view synthesis from depth image[D]. Rio de Janeiro:Pontífícia Universidade Católica do Rio de Janeiro, 2009.

Metrics

Recommended 0

No Suggested Reading articles found!

Trends and technologies of video coding

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 42

Related Articles 15

Metrics

Recommended 0

[1]	Zehua GUO, Haowen ZHU, Tongwen XU. Network modal innovation for distributed machine learning [J]. Telecommunications Science, 2023, 39(6): 44-51.
[2]	Yaqiong LIU, Zhe LYU, Yafei ZHAO, Guochu SHOU. A survey on AI techniques applied in the satellite communication/satellite Internet field [J]. Telecommunications Science, 2023, 39(2): 10-24.
[3]	Jianwu ZHANG, Yanjun AN, Huangyan DENG. A survey on DNS attack detection and security protection [J]. Telecommunications Science, 2022, 38(9): 1-17.
[4]	Zhichao ZHOU, Yi FENG, Xiaohan XIA, Yuyao FENG, Chao CAI, Jiahui QIU, Lihui YANG, Yunxiao WU. Outdoor location scheme with fingerprinting based on machine learning of mobile cellular network [J]. Telecommunications Science, 2021, 37(8): 85-95.
[5]	Xiang MENG, Haibing YIN, Xiaofeng HUANG. Statistical modeling based fast rate distortion estimation algorithm for HEVC [J]. Telecommunications Science, 2021, 37(1): 58-68.
[6]	Xiang LI,Yuan LI,Zifei ZHANG,Zhe YANG. A density clustering-based network performance failure big data analysis algorithm [J]. Telecommunications Science, 2020, 36(9): 51-58.
[7]	Ziyu XIAO. A review of key technologies for the future of the 2030 network——Beyond 5G [J]. Telecommunications Science, 2020, 36(9): 114-121.
[8]	Yaxing QIU,Xidong WANG,Sen BIAN,Lei YUE. Load balancing based on clustering analysis and deep learning for multi-frequency and multi-mode network [J]. Telecommunications Science, 2020, 36(7): 156-162.
[9]	Ye OUYANG,Aidong YANG,Fanyu MENG. A game theory-assisted machine learning methodology for subscriber churn behaviors detection [J]. Telecommunications Science, 2020, 36(6): 79-89.
[10]	Feng LIN,Liujing XU,Xiaohua CHEN,Weiqiang QI,Ke CHEN,Tiantian ZHU. Method of Webshell detection based on multi-view feature fusion [J]. Telecommunications Science, 2020, 36(6): 125-132.
[11]	Jiantao SHENG,Maofei CHEN,Dongxin LIU,Laifu WANG,Guoshui SHI,Huamin JIN. Detection of malicious domain name based on a classifier combination [J]. Telecommunications Science, 2020, 36(5): 47-55.
[12]	Tao PANG,Haihua QIU,Biying PAN. Research on artificial intelligence key technologies of mobile terminal [J]. Telecommunications Science, 2020, 36(5): 145-151.
[13]	Qizhu ZHONG. Research and application of VoLTE video call quality based on machine learning [J]. Telecommunications Science, 2020, 36(3): 156-165.
[14]	Zishan LIU,Qiang CHENG,Bo LV. A survey on key technologies of privacy protection for machine learning [J]. Telecommunications Science, 2020, 36(11): 18-27.
[15]	Xiaolian CHEN,Yi QIN,Jie ZHANG,Yajie LI,Haokun SONG,Huibin ZHANG. Optical fiber eavesdropping detection method based on machine learning [J]. Telecommunications Science, 2020, 36(11): 61-67.