流计算大数据技术在运营商实时信令处理中的应用

doi:10.11959/j.issn.1000-0801.2015212

Abstract

Abstract:

Big data platform based on the Hadoop structures using offline batch processing mode，unable to meet the service requirements for data timeliness.In order to solve the real-time signal processing requirements in operator OIDD（open information of dynamic data）big data platform，the big-data system components of stream computing were discussed，real-time data collecting，distribution and processing components which formed the end-to-end real-time signal processing big data technology solutions were recommended，and the solutions of the OIDD big data platform which integrated batch computing and stream computing were proposed.It will improve the timeliness of the network signaling data and provide more space for business innovation and bring more benefits.

Key words: big data, stream computing, Storm, real-time signal data processing

Bin Dong,Di Yang,Zheng Wang,Wenhong Zhou. Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing[J]. Telecommunications Science, 2015, 31(10): 165-171.

Figures/Tables 9

References 10

1	Condiet T ， Alvaro P ， Hellerstein J M ， et al. MapReduce Online. UCB/EECS-2009-136， 2009
2	Apache Software Foundation. Welcome to Apache Hadoop. ， 2015
3	孙大为，张广艳，郑纬民 . 大数据流式计算：关键技术及系统实例. 软件学报， 2014，25（4）： 839～862 Sun D W ， Zhang G Y ， Zheng W M . Big data stream computing：technologies and instances. Journal of Software， 2014，25（4）： 839～862
4	Neumeyer L ， Robbins B ， Nair A ， et al. S4：distributed stream computing platform. Proceedings of the IEEE International Conference on Data Mining Workshops， Sydney，Australia， 2010
5	崔星灿，禹晓辉，刘洋等. 分布式流处理技术综述. 计算机研究与发展， 2015，52（2）： 318～332 Cui X C ， Yu X H ， Liu Y ， et al. Distributed stream processing：a survey. Journal of Computer Research and Development， 2015，52（2）： 318～332
6	Apache Software Foundation. Spark Streaming makes it easy to build scalable fault-tolerant streaming applications. ， 2015
7	Apache Software Foundation. Apache Kafka：a high-throughput distributed messaging system. ， 2015
8	Apache Software Foundation. Storm official website. ， 2015
9	Apache Software Foundation. Welcome to Apache ZooKeeper. ， 2015
10	Vavilapali V K ， Murthy A C ， Douglas C ， et al. Apache Hadoop YARN：yet another resource negotiator. Proceedings of the 4th ACM Symposium on Cloud Computing，Santa Clara， California，USA， 2013

Metrics

Recommended 0

No Suggested Reading articles found!

[1]	Lu HAN, Weiyu CHEN, Fei ZHANG, Jianfeng HE, Huaizhen SU. Big data classification method of non relational distributed submission information under differentiated requirements [J]. Telecommunications Science, 2023, 39(6): 114-121.
[2]	Xue HAN. Damage toughness assessment method of power backbone communication network based on power big data [J]. Telecommunications Science, 2023, 39(5): 136-143.
[3]	Yudi SUN. A prediction model of massive 5G network users’ revisit behavior based on telecom big data [J]. Telecommunications Science, 2023, 39(2): 157-162.
[4]	Aihua LI, Xiaobo WU, Chao CHEN, Bin WEI, Yuanyuan SHI. Big data intelligent analysis technology for 5G network [J]. Telecommunications Science, 2022, 38(8): 129-139.
[5]	Gengsheng HUANG, Yuhong HUANG, Manxue GUO, Jianping ZHENG, Xin GE. Architecture of a new infrastructure for data service in DT era [J]. Telecommunications Science, 2022, 38(7): 138-145.
[6]	Panpan LI, Zhengxia XIE, Guangxue YUE, Xin LIU. Research progress and trends of deep learning based wireless communication receiving method [J]. Telecommunications Science, 2022, 38(2): 1-17.
[7]	Haibo ZHAO, Zhijun XIANG, Linsong XIAO. A big data framework for short-term power load forecasting using heterogenous data [J]. Telecommunications Science, 2022, 38(12): 103-111.
[8]	Zhiyong LIU, Zhongjiang HE, Yilong RUAN, Junfeng SHAN, Chao ZHANG. Big data security features and operation practices [J]. Telecommunications Science, 2021, 37(5): 160-169.
[9]	Xiaojun LIU,Juan WU,Xiaoqing XU. Big data architecture analysis and data security fusion technology [J]. Telecommunications Science, 2020, 36(7): 146-155.
[10]	Yujiao LIU,Kunhuang SONG,Xiang WANG. Analysis of economic prosperity index based on big data of electricity [J]. Telecommunications Science, 2020, 36(6): 166-171.
[11]	Weihua CHENG,Xiaorong HE. Quality analysis method of Web browsing based on big data [J]. Telecommunications Science, 2020, 36(11): 174-181.
[12]	Xiaomin TAN,Ai FANG,Bing LIANG,Haojie YANG. Locating causes of abnormality of EPG experience based on decision tree [J]. Telecommunications Science, 2019, 35(8): 158-164.
[13]	Zelin LU,Qiangzhi LI. Evolutionary logic and operational mechanism of E-commerce platform [J]. Telecommunications Science, 2019, 35(7): 152-158.
[14]	Ming LIAO,Ming CHEN,Ji ZHOU,Xiaohua XIANG,Fang LI,Yefen JIAO. DNS log analysis system based on big data fusion algorithm [J]. Telecommunications Science, 2019, 35(5): 129-139.
[15]	Yuanfeng GONG,Yi HUANG. Optimization method of wireless indoor coverage based on big data analysis [J]. Telecommunications Science, 2019, 35(5): 149-154.

Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 10

Related Articles 15

Metrics

Recommended 0