大数据 ›› 2018, Vol. 4 ›› Issue (5): 104-112.doi: 10.11959/j.issn.2096-0271.2018054

所属专题: 大数据

• 专栏:大数据领域国家工程实验室 • 上一篇    

大数据系统软件创新平台与生态建设

王建民1,2,王晨1,2,刘英博1,2,刘璘1,2   

  1. 1 清华大学软件学院,北京 100084
    2 大数据系统软件国家工程实验室,北京 100084
  • 出版日期:2018-09-15 发布日期:2018-12-10

Big data system software eco-system and platform construction

Jianmin WANG1,2,Chen WANG1,2,Yingbo LIU1,2,Lin LIU1,2   

  1. 1 School of Software,Tsinghua University,Beijing 100084,China
    2 National Engineering Laboratory for Big Data System Software,Beijing 100084,China
  • Online:2018-09-15 Published:2018-12-10

摘要:

针对大数据系统软件开源生态发展现状、大数据系统软件技术与领域应用发展的迫切需求与工程化瓶颈,系统地介绍了大数据系统软件共性技术的研发思路以及大数据系统软件国家工程验室研制的“数为平台”的技术架构,包括大规模多源异构数据的一体化管理、异构数据的交互式分析框架、数据可视化与智能数据工程、大数据混源软件可信验证、领域大数据应用开发与运行环境等。给出了基于平台建设开放的大数据软件创新平台与生态的模式,并在工业制造业、气象环保服务领域开展应用示范。

关键词: 大数据系统软件, 开源软件生态, 领域大数据应用, 国家工程实验室

Abstract:

In view of the bottlenecks in common technology and engineering practice faced by big data system software and applications development,the key technological innovations of the National Engineering Laboratory for Big Data System Software(NEL-BDSS) were introduced systematically,including the technical architecture and domain applications of the big data system software "Tsinghua Dataway Platform",which addresses issues such as:massive multi-source heterogeneous data integration management,interactive heterogeneous data analysis framework,data visualisation and intelligent data engineering,validation and verification of hybrid source big data software,and domain-specific big data applications development and run-time environment.The big data system software eco-system,state-of-the-art big data technology and systems,domain applications,as well as future challenges were summarized systematically.The NEL-BDSS focuses on supporting demonstrative applications of industrial big data,environmental big data as well as meteorological big data.

Key words: big data system software, open source software eco-system, domain-specific big data applications, National Engineering Laboratory

No Suggested Reading articles found!