基于大数据技术的网管系统数据管理层

doi:10.11959/j.issn.1000-0801.2015265

Abstract

Abstract:

Data management layer is the core of data processing and management in network management system.The current situation and problems of network management system was introduced.To break the isolation between the professional network management system and promote data sharing,data domain should further be subdivided and the data model should be reconstructed,and technical framework of Hadoop+MPP was a better choice.The direction for the planning and design of the network management system was pointed out.Finally,the relation of data management layer platform and enterprise wide data sharing service platform was discussed.

Key words: network management system, data management layer, big data, data model, technical framework

Wei Li. Network Management System's Data Management Layer Based on Big Data Technology[J]. Telecommunications Science, 2015, 31(11): 185-188.

序号	项目	基础数据域	汇总数据域
1	数据来源	经处理后的采集层数据，如信令数据	经ETL（抽取（extract）、转换（transform）、加载（load））处理后的采集层数据和基础层数据，如资源数据
2	数据类型	结构化数据和非结构化数据	一般是结构化数据
3	模型要求	存取方便且速度快，结构清晰，容易理解和扩展	满足布尔逻辑运算和数学运算规则形成的查询要求；能搜索、组合和比较分析各类数据；增加和删除数据方便；具有更高的数据独立性、更好的安全保密性
4	主要目标	形成稳定和统一的基础性明细数据集	为数据挖掘或多维分析应用提供整合后的、高质量的汇总数据集
5	上层调用	支持大规模简单写入和读取，无需支持随机修改和写操作；通过计算可以生成各种简单维度的汇总数据和部分直接供上层调用的应用数据	支持经过预处理后，一定规模的写入和读取，需支持随机修改和写操作；通过计算可以生成各种复杂维度的统计汇总，计算数据和部分直接供上层调用的应用数据
6	数据体量	巨大，一般大于PB	大，一般在数据基础层的几分之一
7	保存时间	30～60天	按需存储

[1]	Lu HAN, Weiyu CHEN, Fei ZHANG, Jianfeng HE, Huaizhen SU. Big data classification method of non relational distributed submission information under differentiated requirements [J]. Telecommunications Science, 2023, 39(6): 114-121.
[2]	Xue HAN. Damage toughness assessment method of power backbone communication network based on power big data [J]. Telecommunications Science, 2023, 39(5): 136-143.
[3]	Yudi SUN. A prediction model of massive 5G network users’ revisit behavior based on telecom big data [J]. Telecommunications Science, 2023, 39(2): 157-162.
[4]	Aihua LI, Xiaobo WU, Chao CHEN, Bin WEI, Yuanyuan SHI. Big data intelligent analysis technology for 5G network [J]. Telecommunications Science, 2022, 38(8): 129-139.
[5]	Gengsheng HUANG, Yuhong HUANG, Manxue GUO, Jianping ZHENG, Xin GE. Architecture of a new infrastructure for data service in DT era [J]. Telecommunications Science, 2022, 38(7): 138-145.
[6]	Panpan LI, Zhengxia XIE, Guangxue YUE, Xin LIU. Research progress and trends of deep learning based wireless communication receiving method [J]. Telecommunications Science, 2022, 38(2): 1-17.
[7]	Haibo ZHAO, Zhijun XIANG, Linsong XIAO. A big data framework for short-term power load forecasting using heterogenous data [J]. Telecommunications Science, 2022, 38(12): 103-111.
[8]	Zhiyong LIU, Zhongjiang HE, Yilong RUAN, Junfeng SHAN, Chao ZHANG. Big data security features and operation practices [J]. Telecommunications Science, 2021, 37(5): 160-169.
[9]	Xiaojun LIU,Juan WU,Xiaoqing XU. Big data architecture analysis and data security fusion technology [J]. Telecommunications Science, 2020, 36(7): 146-155.
[10]	Yujiao LIU,Kunhuang SONG,Xiang WANG. Analysis of economic prosperity index based on big data of electricity [J]. Telecommunications Science, 2020, 36(6): 166-171.
[11]	Qiming WAN,Sining WANG,Xin HE. SG-CIM model application method in data middle platform [J]. Telecommunications Science, 2020, 36(3): 136-143.
[12]	Weihua CHENG,Xiaorong HE. Quality analysis method of Web browsing based on big data [J]. Telecommunications Science, 2020, 36(11): 174-181.
[13]	Xiaomin TAN,Ai FANG,Bing LIANG,Haojie YANG. Locating causes of abnormality of EPG experience based on decision tree [J]. Telecommunications Science, 2019, 35(8): 158-164.
[14]	Zelin LU,Qiangzhi LI. Evolutionary logic and operational mechanism of E-commerce platform [J]. Telecommunications Science, 2019, 35(7): 152-158.
[15]	Ming LIAO,Ming CHEN,Ji ZHOU,Xiaohua XIANG,Fang LI,Yefen JIAO. DNS log analysis system based on big data fusion algorithm [J]. Telecommunications Science, 2019, 35(5): 129-139.

Network Management System's Data Management Layer Based on Big Data Technology

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 2

References 2

Related Articles 15

Metrics

Recommended 0

1	刘军 . Hadoop大数据处理．北京：人民邮电出版社， 2013 Liu J . Hadoop Big Data Processing. Beijing: Posts and Telecom Press, 2013
2	孙博辉．电信网管系统数据存储及处理方法的研究． , 2014 Sun B H . Research on data storage and processing method of telecommunication network management system. , 2014