大数据 ›› 2017, Vol. 3 ›› Issue (4): 1-8.doi: 10.11959/j.issn.2096-0271.2017036

• 聚焦 •    下一篇

流式大数据实时处理技术、平台及应用

陈纯   

  1. 浙江大学计算机科学与技术学院，浙江 杭州 310058
  • 出版日期:2017-07-01 发布日期:2017-08-07
  • 作者简介:陈纯（1955-），男，博士，浙江大学计算机科学与技术学院教授，中国工程院院士，计算机应用专家，主要研究方向为大数据智能计算、计算机图形图像处理等。

Real-time processing technology,platform and application of streaming big data

Chun CHEN   

  1. College of Computer Science and Technology,Zhejiang University,Hangzhou 310058,China
  • Online:2017-07-01 Published:2017-08-07

在线阅读

97

PDF下载

2373

摘要：

大数据处理系统根据其时效性可分为批式大数据和流式大数据两类。上述两类系统均无法满足“事中”感知查询分析处理模式的需求。为此，从分析大数据应用场景入手，提出了“流立方”流式大数据实时处理技术和平台，在完整大数据集上实现了低迟滞、高实时的即席查询分析。目前基于“流立方”平台开发的业务系统已应用到金融风控反欺诈、机器防御等领域，具有广阔的应用前景。

关键词: 流式大数据, 流处理, 增量计算, 时序处理

Abstract:

According to its timeliness,big data processing systems can be categorized into two groups,namely batching big data processing and streaming big data processing.Both systems mentioned above are unable to meet the real-time requirement for censoring and query analysis tasks.To this end,the “stream cube” real-time data analysis technology and platform were presented,which can perform timely query with low lag.Currently,this technology has been applied to many fields,including financial risk management,anti-fraud as well as web bots defense,and offers promising prospects for further applications.

Key words: streaming big data, streaming processing, incremental computation, time series processing

中图分类号: 

No Suggested Reading articles found!