基于Hadoop的OSS域数据建模与采集方法研究

doi:10.11959/j.issn.1000-0801.2015021

Abstract

Abstract:

According to the data acquisition and the modeling problem of telecom operators facing in the construction of EDC, the data status and data characteristics in the OSS was analyzed, a modeling method of hierarchical classification of combing theory and data model management idea were proposed, the unification of OSS data collection, sharing the modeling and data concentration were realized. Through the application of end to end analysis on mobile internet terminal as case subject,it provides reference for the construction on telecom industry EDC.

Key words: EDC, ETL, OSS, data acquisition, Hadoop

Lei Lei,Jingwen Li,Dapeng Gong,Rui Wang,Lei Su,Ningjiang Chen. Study on Data Modeling and Collection in OSS Based on Hadoop[J]. Telecommunications Science, 2015, 31(1): 128-138.

Figures/Tables 13

References 11

b1	Barroso L A , Dean J , Holzle U , et al. Websearch for a planet: The Google cluster architecture. IEEE Micro, 2003, 23（2） 22～28
2	Xu Y , Kostamaa P , Qi Y . A Hadoop based distributed loading approach to parallel data warehouses. Proceedings of SIGMOD 2011, Athens, Greece, 2011
3	詹志强，孟洛明，邱雪松 . 多专业网综合网管系统体系结构的研究. 北京邮电大学学报， 2003(1) Zhan Z Q , Meng L M , Qiu X S . Architecture of network management system for multi-technology network. Journal of Beijing University of Posts and Telecommunications, 2003(1)
4	Liu X F , Thomsen C , Pedersen T B . Cloud ETL: Scalable Dimensional ETL for Hadoop and Hive. DB Technical Report, 2012
5	Mohammed M , Mohd S A . A Framework for Interoperable Distributed ETL Components Based on SOA. Proceedings of ICSTE 2010, San Juan, PR, USA, 2010
6	陈桂汉 . 综合电信管理解决方案. 北京: 电子工业出版社， 2002 Chen G H . Integrated Telecommunications Management Solutions. Beijing: Publishing House of Electronics Industry, 2002
7	Ghemawat S , Gobioff H , Le-ung S T . The Google file system. Proceedings of 19th Symposium on Operating Systems Principles, Lake George, New York, USA, 2003
8	Corbett J C , Dean J , Epstein M . Google's globally distributed database. Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012, Hollywood, CA, USA, 2012
9	Samuel P , Mal R , Kanth P . Automatic test case generation from UML communication diagrams. Information and Software Technology, 2007(49): 158～171
10	Ling F , Chang E , Dillon T . A semantic network-based design methodology for XML documents. ACM Transactions on Information System（TOIS）, 2002,20(4): 1～6
11	Dean J , Ghemawat S . MapReduce: Simplified data processing on large clusters. Proceedings of6th Symposium on Operating Systems Design and Implementation, OSDI'04, San Francisco, USA, 2004

Metrics

Recommended 0

No Suggested Reading articles found!

专题名称	表说明	表名	数据粒度	存储周期
四网协同	GN口日统计	TM_SIGN_GN_D	天	30天
	GN口月统计	TM_SIGN_GN_M	月	24月
	天粒度高流量用户	TM_BSS_HIGH_FLOW_CUST_D	天	30天
	月度高流量用户	TM_BSS_HIGH_FLOW_CUST_M	月	24月
	…	…	…	…
价值小区分析	移动自有业务月统计	TM_BSS_SERVICE_M	月	24月
	价值小区收益月粒度表	TM_NIOS_VALUE_CELL_INCOME_M	月	24月
	BSC收益月粒度表	TM_NIOS_VALUE_BSC_INCOME_M	月	24月
	GPRS收益月粒度表	TM_DNMS_VALUE_GPRS_INCOME_M	月	24月
	…	…	…	…

业务类型	信息交互的可用性	信息交互的及时性	信息交互的稳定性
浏览类	首页响应成功率页面显示成功率	首页响应时长页面显示时长页面下载速率
视频类	流媒体播放成功率	流媒体播放等待时长流媒体业务下载速率	流媒体播放中断率
即时通信类	业务登录成功率	业务登录时延大数据（视频/图片）传输上下行速率	异常掉线率
应用下载类	应用下载成功率	应用下载速率

附着	承载建立	DNS解析	TCP链接	HTTP过程
EPS附着请求次数	专用承载激活请求次数	DNS解析成功率	TCP建立成功率	get响应成功率
EPS附着成功次数	专用承载激活成功次数	DNS解析时长	TCP建立时长	get响应时长
…	…	…	…	…

[1]	Yuming GE, Qiqi MAO. Research on cross-domain cooperation deployment of V2X infrastructure [J]. Telecommunications Science, 2023, 39(3): 24-31.
[2]	Jingbo ZHAO, Shilei DONG, Tingyu HUANG, Mengxia CHEN, Peng HUANG. Research on accurate and efficient coverage of 5G private network [J]. Telecommunications Science, 2022, 38(Z1): 108-119.
[3]	Jie ZHANG, Jianhong XU, Yongjian ZHAO, Yunxiang GAO, Xun CHEN. ICT infrastructure based on intent-based network and service orchestration [J]. Telecommunications Science, 2022, 38(Z1): 184-193.
[4]	Shengwei CHEN, Fan LI, Guangping YANG, Jian ZHOU, Yu SU. Research and application of air-to-ground continuous coverage technology for air-space emergency communication system [J]. Telecommunications Science, 2022, 38(8): 54-64.
[5]	Hao DONG, Liang SONG, Cunqing HUA, Lingya LIU, Junhua TANG. Survey of the research and development on the maritime communication technology [J]. Telecommunications Science, 2022, 38(5): 1-17.
[6]	Haiyang SUN, Yi SHI, Yan LI, Qiang FAN, Xin MA. 5G-Advanced E2E deterministic transmission analysis and system design [J]. Telecommunications Science, 2022, 38(3): 49-56.
[7]	Hanyang LI, Weiwen WENG, Nan LI, Long ZHANG, Jinxia CHENG. Research of 5G NR RedCap technology [J]. Telecommunications Science, 2022, 38(3): 93-101.
[8]	Sai HAN, Dongyue ZHANG, Zelin WANG, Guangquan WANG, Ao LI, Qiukeng FANG, Hongbing MA. Research and applications on intelligent operations of cross-professional carrying network [J]. Telecommunications Science, 2022, 38(11): 113-122.
[9]	Wei WANG, Peng WANG, Xiaoyu ZHAO, Honglei XU. Cloud-network convergence solution based on SRv6 [J]. Telecommunications Science, 2021, 37(8): 111-121.
[10]	Huiguang CHEN, Huan LI. Orchestration system architecture design and implementation of smart line service [J]. Telecommunications Science, 2021, 37(10): 152-161.
[11]	Jianglong WANG,Bo LEI,Yunpeng XIE,Qi HE,Yunhe LI. Key technology of data center network for cloud network convergence [J]. Telecommunications Science, 2020, 36(4): 125-135.
[12]	Di HAN,Hua XIAO,Yuan ZHONG,Xuegang LAO,Chao HAN. Technical research of a new type of optical fibre with ultra-low-loss and large effective area [J]. Telecommunications Science, 2020, 36(12): 41-48.
[13]	Peizhuang CONG, Yuchao ZHANG, Ye TIAN, Wendong WANG, Dan LI. Design of federated routing mechanism in cross-domain scenario [J]. Telecommunications Science, 2020, 36(10): 29-36.
[14]	Huibin XU. High-efficient RPL routing for analyzing mobility of nodes [J]. Telecommunications Science, 2019, 35(8): 120-127.
[15]	Xuehua LI,Chen SHEN,Yuanyuan YAO. Performance analysis of 60 GHz pulse multiuser communication system based on cross-layer strategy [J]. Telecommunications Science, 2018, 34(9): 70-77.

Study on Data Modeling and Collection in OSS Based on Hadoop

RichHTML

PDF下载

Knowledge

Cited

Abstract

Cite this article

share this article

Figures/Tables 13

References 11

Related Articles 15

Metrics

Recommended 0