电信科学 ›› 2019, Vol. 35 ›› Issue (2): 84-94.doi: 10.11959/j.issn.1000-0801.2019029

• 运营技术广角 • 上一篇    下一篇

电信运营商数据湖技术实施策略

胡军军,谢晓军,石彦彬,喻琦   

  1. 中国电信股份有限公司广州研究院,广东 广州 510630
  • 修回日期:2019-01-22 出版日期:2019-02-01 发布日期:2019-02-23
  • 作者简介:胡军军(1969- ),男,中国电信股份有限公司广州研究院IT研发中心高级工程师、总经理,主要研究方向为电信支撑系统、云计算/大数据、移动互联网商业模式、智能可穿戴设备等。|谢晓军(1972- ),男,中国电信股份有限公司广州研究院IT研发中心高级工程师、技术总监,主要研究方向为BSS/OSS系统规划、设计、建设与运营的研究与支撑。|石彦彬(1980- ),男,中国电信股份有限公司广州研究院IT研发中心高级工程师、高级业务主管,主要研究方向为 OSS 系统规划、设计、建设与运营的研究与支撑。|喻琦(1985- ),男,中国电信股份有限公司广州研究院 IT 研发中心工程师,主要研究方向为OSS系统规划、设计、建设与运营的研究与支撑。

Implementation strategy of telecom operators’ data lake technology

Junjun HU,Xiaojun XIE,Yanbin SHI,Qi YU   

  1. Guangzhou Research Institute of China Telecom Co.,Ltd.,Guangzhou 510630,China
  • Revised:2019-01-22 Online:2019-02-01 Published:2019-02-23

摘要:

首先,从分析电信运营商传统数据架构入手,识别当前面临的数据质量不高、实时性不够、灵活性不足及存储和应用相互制约等问题。然后,讨论引入数据湖技术的可行性,明确数据湖的存储规模化和低成本、数据“原汁原味”和方便易用、应用按需建模等特点,能够为电信运营商数据架构优化提供非常有益的参考。最后,提出数据统一存储、统一标准、近源采集、与应用分离的电信运营商数据湖建设方案,并针对数据湖数据分区、部署、入湖及应用数据动态加载、数据统一管理等关键要点给予明确的阐述。

关键词: 数据湖, 原生数据存储, 存储计算分离, 数据目录

Abstract:

Firstly,the traditional data architecture of telecom operators was analyzed and the problems such as low quality,lack of real-time,lack of flexibility and mutual constraints of storage and application were identified.Then,the feasibility of introducing data lake technology was discussed,the storage scale and low cost of data lake,the originality of data and ease of use,and the application of on-demand modeling were clarified,which could provide great benefits for telecom operators’ data architecture optimization.Finally,the data lake construction plan of unified storage,unified standards,near-source acquisition,and application separation was proposed,and key points such as data lake data partitioning,deployment,lake entry and application data dynamic loading,and unified data management were clearly stated.

Key words: data lake, native data storage, loose coupling between storage and computation, data catalog

中图分类号: 

No Suggested Reading articles found!