大数据网络服务器群智能伸缩机制与架构研究

doi:10.11959/j.issn.1000-0801.2015073

Abstract

Abstract:

The principle and construction of the structure of smart telescopic on big data network server groups were elaborated.The key technologies involved in the smart scaling of big data network server groups were discussed.After investigating key technologies,including the monitoring of the workload of the server group,the smart control of the number of servers,and the scheduling of access loads,the principle and realization method for the smart scaling of big data network server groups were proposed and technical supports were provided for the smart scaling and effective energy conservation of big data network server groups.According to the proposed construction method and key technologies,a smart scaling model for big data network server groups was provided as well.

Key words: big data network, server group, smart scaling, load scheduling

Hongyao Ju. Research on Smart Scaling Mechanism and Structure for Big Data Network Server Groups[J]. Telecommunications Science, 2015, 31(3): 89-97.

Figures/Tables 10

References 21

1	王元卓，靳小龙，程学旗 . 网络大数据：现状与展望. 计算机学报， 2013,36（6）:1125～1138 Wang Y Z , Jin X L , Cheng X Q . Network big data:present and future. Chinese Journal of Computers, 2013,36（6）:1125～1138
2	王珊，王会举，罩雄派等. 架构大数据：挑战、现状与展望. 计算机学报， 2011,34（10）:1741～1752 Wang S , Wang H J , Tan X P , et al. Architecting big data:challenges,studies and forecasts. Chinese Journal of Computers, 2011,34（10）:1741～1752
3	孟小峰，慈祥 . 大数据管理：概念、技术与挑战. 计算机研究与发展， 2013,50（1）:164～169 Meng X F , Ci X . Big data management:concepts,techniques and challenges. Journal of Computer Research and Development, 2013,50（1）:164～169
4	吴金红，张飞，鞠秀芳 . 大数据：企业竞争情报的机遇、挑战及对策研究. 情报杂志， 2013,32（1）:5～9 Wu J H , Zhang F , Ju X F . Big data:opportunities,challenges and strategies of enterprise. Journal of Intelligence, 2013,32（1）:5～9
5	王树良，丁刚毅，钟鸣 . 大数据下的空间数据挖掘思考. 中国电子科学研究院学报， 2013,8（1）:8～17 Wang S L , Ding G Y , Zhong M . On spatial data mining under big data. Journal of CAEIT, 2013,8（1）:8～17
6	马建光，姜巍 . 大数据的概念、特征及其应用. 国防科技， 2013,34（2）:10～17 Ma J G , Jiang W . The concept,characteristics and application of big data. National Defense Science＆Technology, 2013,34（2）:10～17
7	Manyika J , Chui M , Brown B et al. Big data:the next frontier for innovation,competition,and productivity. , May 2011
8	Big data,big impact:new possibilities for international development. , 2012
9	亓开元，赵卓峰，房俊等. 针对高速数据流的大规模数据实时处理方法. 计算机学报， 2012,35（3）:476～490 Qi K Y , Zhao Z F , Fang J , et al. Real-time processing for high speed data stream over large scale data. Chinese Journal of Computers, 2012,35（3）:476～490
10	陶健，张占平，郑戊午等. 机载实时容错分布式计算机系统数据网络的设计与实现. 航空计算技术， 2008,38（6）:102～106 Tao J , Zhang Z P , Zheng W W , et al. Design and implementation of airborne real-time fault-tolerance distributed computer system's data network. Aeronautical Computing Technique, 2008,38（6）:102～106
11	黄哲学，曹付元，李俊杰等. 面向大数据的海云数据系统关键技术研究. 网络新媒体技术， 2012,1（6）:20～26 Huang Z X , Cao F Y , Li J J , et al. Developing sea cloud data system key technologies for large data analysis and mining. Journal of Congwen.net, 2012,1（6）:20～26
12	时念云，王文佳，马力 . 基于普适云的大数据挖掘. 计算机系统应用， 2013,22（11）:7～12 Shi N Y , Wang W J , Ma L . Data mining of big data based on ubicloud. Computer Systems＆ Applications, 2013,22（11）:7～12
13	徐国虎，孙凌，许芳 . 基于大数据的线上线下电商用户数据挖掘研究. 中南民族大学学报（自然科学版）， 2013,32（2）:100～105 Xu G H , Sun L , Xu F . Study on big data-based mining of O2O ec users'data. Journal of South-Central University for Nationalities （Nat.Sci.Edition）, 2013,32（2）:100～105
14	曾斌，姚路，陈志诚 . 基于负载平衡智能体的分布式 Web 代理群集研究. 计算机工程与设计， 2011,32（8）:2631～2635 Zeng B , Yao L , Chen Z C . Study of distributed web proxy cluster using load balancing agents. Computer Engineering and Design, 2011,32（8）:2631～2635
15	李帅，李盖凡，许胤龙 . 大规模多层次分布式网络系统及其仿真. 计算机仿真， 2012,29（9）:139～143 Li S , Li G F , Xu Y L . Large-scale multi-layer distributed network system and its simulation. Computer Simulation, 2012,29（9）:139～143
16	陈斌，白晓颖，马博等. 分布式系统可伸缩性研究综述. 计算机科学， 2011,38（8）:17～24 Chen B , Bai X Y , Ma B , et al. Survey on software scalability of distributed system. Computer Science, 2011,38（8）:17～24
17	尹浩，林闯，文浩等. 大规模流媒体应用中关键技术的研究. 计算机学报， 2008,31（5）:755～774 Yin H , Lin C , Wen H , et al. Research on key technologies of large-scale streaming media. Chinese Journal of Computers, 2008,31（5）:755～774
18	姚婧，何聚厚 . 基于模糊聚类分析的云计算负载平衡策略. 计算机应用， 2012,32（1）:213～217 Yao J , He J H . Load balance strategy of cloud computing based on fuzzy clustering analysis. Journal of Computer Applications, 2012,32（1）:213～217
19	黄晓斌，钟辉新基于大数据的企业竞争情报系统模型构建. 情报杂志， 2013,32（3）:37～43 Huang X B , Zhong H X . Build enterprise competitive intelligence system model based on big data. Journal of Intelligence, 2013,32（3）:37～43
20	Chaiken R , Jenkins B , Larson P , et al. SCOPE:easy and efficient parallel processing of massive data sets. Proceedings of the VLDB Endowment, Auckland,New Zealand, 2008:1265～1276
21	Abadi D J , Ahmad Y , Balazinska M , et al. The design of the borealis stream processing engine. Proceedings of Second Biennial Conference on Innovative Data Systems Research, Asilomar,USA, 2005:277～289

Metrics

Recommended 0

No Suggested Reading articles found!

F（t）与阈值关系	负载监测器输出值	执行的操作情况
F_imax＞F_i（t）＞F_imin	0	服务器i工作负载正常，不调整调度策略
F_i（t）≥F_imax	1	服务器i超负荷工作，通知负载调度控制器减少后续访问负载进入该成员服务器
F_i（t）≤F_imin	2	服务器i负载过轻，通知负载调度控制器增加后续访问负载进入该成员服务器

G（t）与阈值关系	负载监测器输出值	执行的操作情况
G_max＞G（t）＞G_min	0	服务器群负载正常，进入单台服务器工作负载判定过程
G（t）≥G_max	1	服务器群超负荷工作，通知伸缩管控器增加成员服务器数量
G（t）≤G_min	2	服务器群负载过轻，通知伸缩管控器关闭最后一个处于工作状态的成员服务器

[1]	Xiaoan BAO,Xue WEI,Lei CHEN,Guoheng HU,Na ZHANG. Load balancing method of service cluster based on mean-variance [J]. Telecommunications Science, 2017, 33(1): 1-8.
[2]	Ju Hongyao. Research on Smart Scaling Mechanism and Structure for Big Data Network Server Groups [J]. Telecommunications Science, 2015, 31(3): 2015073-.

Research on Smart Scaling Mechanism and Structure for Big Data Network Server Groups

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 21

Related Articles 2

Metrics

Recommended 0