通信学报 ›› 2013, Vol. 34 ›› Issue (Z2): 170-174.doi: 10.3969/j.issn.1000-436x.2013.Z2.032

• 数字化校园与典型应用 • 上一篇    下一篇

面向大数据的数据服务中心设计与应用研究

刘云峰,李丽,王素美,王倩宜,扬旭,欧阳荣彬,龙新征   

  1. 北京大学 计算中心,北京100871
  • 出版日期:2013-12-25 发布日期:2017-06-16
  • 基金资助:
    国家发展改革委2011年国家信息安全专项基金资助项目

Design and application research on data service platform for big data

Yun-feng LIU,Li LI,Su-mei WANG,Qian-yi WANG,Xu YANG,Rong-bin OUYANG,Xin-zheng LONG   

  1. Computer Center,Peking University,Beijing 100871,China
  • Online:2013-12-25 Published:2017-06-16
  • Supported by:
    2011 National Information Security Special Project Funded by National Development and Reform Commission

摘要:

大数据管理对传统的基于关系数据库管理系统为核心的数据管理服务平台提出了挑战,研究开发支持结构化和非结构化数据统一管理的数据管理与服务中心成为一项非常迫切井且重要的任务,汇总分析出大数据服务中心四项关键技术,采用可配置泛化表模型等技术,设计了基于 Hadoop 平台的数据服务中心系统原型BIG-DMS和基于BIG-DMS的数据综合服务平台应用方案,支持结构化和非结构化数据的统一存储、管理和访问服务。

关键词: 大数据, MapReduce, 数据模型, 数据服务中心

Abstract:

Big data management gives challenges to data manage and service platform based on traditional relational database management system,and research on big data management and service platform supporting both structured and unstructured data has become a very urgent and important task.4 key technologies for big data management service platform was summarized,and the configurable generalization table model was adopt.The data service center system prototype BIG-DMS based on Hadoop platform and the application scheme of data integration services platform based on BIG-DMS were also designed to support both structured and unstructured data storage,management and access services.

Key words: big data, MapReduce, data model,, data service center