基于S4框架的并行复杂事件处理系统

doi:10.3969/j.issn.1000-436x.2012.z1.021

Journal on Communications ›› 2012, Vol. 33 ›› Issue (Z1): 165-169.doi: 10.3969/j.issn.1000-436x.2012.z1.021

• Papers • Previous Articles Next Articles

Parallel complex event processing system based on S4 framework

Hao CHEN^1,²,Yu LI^1,²,Song-lin HU¹,Ying LIANG¹

¹ Institute of Computing Technology,Chinese Academy of Sciences,Beijing 100190,China
² Graduate University,Chinese Academy of Sciences,Beijing 100049,China

Online:2012-09-25 Published:2017-08-03
Supported by:
Science Plan of State Grid Information and Telecommunacation Co,Ltd;The Planned Science and Technology Project of Guangdong Province

Abstract

Abstract:

There was a throughput bottleneck for complex event processing in only one computer,and the existing general-purpose parallel framework was not suitable for complex event processing system.Based on the analysis of existing parallel technology,fourteen kinds of complex event processing operator and a parallel framework by operator for complex event processing system were proposed,the event stream load triage based on operator was given.S4 system for parallel complex event processing system was utilized,provided greater reliability and throughput than stand-alone operation.Through the cluster experiments show that,within a certain range,the throughput of the system can be increased with the number of cluster nodes linear growth.

Key words: complex event processing, mass data, parallel computing

Hao CHEN,Yu LI,Song-lin HU,Ying LIANG. Parallel complex event processing system based on S4 framework[J]. Journal on Communications, 2012, 33(Z1): 165-169.

[1]	LUCKHAM D C , VERA J . An event-based architecture definition language[J]. IEEE Transactions on Software Engineering, 1995,21(9): 717-734.
[2]	LUCKHAM D C . The Power of Events:An Introduction to Complex Event Processing in Distributed Enterprise Systems[M]. Boston: Addison-Wesley ProfessionalPress, 2002.
[3]	DEAN J , GHEMAWAT S . Mapreduce:simplified data processing on large clusters[J]. Commun ACM, 2008,51(1): 107-113.
[4]	CONDIE T , CONWAY N , ALVARO P ,et al. Map reduce online[A]. Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation[C]. Berkeley,San Jose,CA,USA, 2010.21.
[5]	Storm wiki[EB/OL]. , 2012.
[6]	NEUMEYER L , ROBBINS B , NAIR A ,et al. S4:distributed stream computing platform[A]. The 10th IEEE International Conference on Data Mining Workshops[C]. Sydney,Australia, 2010. 170-177.
[7]	Zookeeper[EB/OL]. , 2012.

[1]	Cheng ZHONG, Hui SUN. Parallel algorithm for sensitive sequence recognition from long-read genome data with high error rate [J]. Journal on Communications, 2023, 44(2): 160-171.
[2]	Jianping CAI, Ximeng LIU, Jinbo XIONG, Zuobin YING, Yingjie WU. Approximation method of multiple consistency constraint under differential privacy [J]. Journal on Communications, 2021, 42(6): 107-117.
[3]	Qing LI,Jiang ZHONG,Lili LI,Qi LI. Self-correcting complex semantic analysis method based on pre-training mechanism [J]. Journal on Communications, 2019, 40(12): 41-50.
[4]	Chen BIAN,Jiong1 YU,Wei-rong XIU,Bin LIAO,Chang-tian YING,Yu-rong QIAN. Progressive filling partitioning and mapping algorithm for Spark based on allocation fitness degree [J]. Journal on Communications, 2017, 38(9): 133-147.
[5]	Shao-feng GENG,Yong-heng WANG,Ren-fa LI,Jia ZHANG. Research of proactive complex event processing method [J]. Journal on Communications, 2016, 37(9): 111-120.
[6]	Lei ZHANG,Bo YANG. Research and implemention of parallel particle swarm optimization algorithm [J]. Journal on Communications, 2005, 26(1A): 289-292.

Parallel complex event processing system based on S4 framework

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 5

References 7

Related Articles 6

Metrics

Recommended 0