基于分布式块存储系统的服务质量研究与优化

doi:10.11959/j.issn.1000-0801.2018157

Abstract

Abstract:

In cloud storage technology,resource reuse and sharing is a double-edged sword.While it reducing the overhead for customers,it leads to a situation that the different applications will compete for hardware resources,especially when resource requirement exceeded storage system capability.As a consequence the cloud storage system is unable to provide satisfactory quality of service.An adaptive scheduling technology was proposed,solving the resource balance problem between front tasks and back tasks.A multilevel popularity cache replacement technology was also proposed,solving the resource balance problems between the front tasks themselves.These technology was implemented and tested on the ZTE distributed block storage system.The proposed technology satisfies the expectations of the quality of service from the users.

Key words: distributed storage system, cache tier, task scheduling, quality of service

CLC Number:

TP316.4

Yaofeng TU,Hongzhang YANG,Yinjun HAN,Zhenghua CHEN. Research and optimization on quality of service in distributed block storage system[J]. Telecommunications Science, 2018, 34(4): 118-128.

Figures/Tables 11

References 18

[1]	孙健, 贾晓菁 . Google 云计算平台的技术架构及对其成本的影响研究[J]. 电信科学, 2010,26(1): 38-44.
	SUN J , JIA X J . A study of the influence of technical architecture on the total cost of google cloud computing platform[J]. Telecommunications Science, 2010,26(1): 38-44.
[2]	李丹, 刘方明, 郭得科 ,等. 软件定义的云数据中心网络基础理论与关键技术[J]. 电信科学, 2014,30(6): 48-59.
	LI D , LIU F M , GUO D K ,et al. Fundamental theory and key technology of software defined cloud data center network[J]. Telecommunications Science, 2014,30(6): 48-59.
[3]	樊自甫, 伍春玲, 王金红 . 基于SDN架构的数据中心网络路由算法需求分析[J]. 电信科学, 2015,31(2): 42-51.
	FAN Z F , WU C L , WANG J H . Requirements analysis of data center network routing algorithm based on SDN architecture[J]. Telecommunications Science, 2015,31(2): 42-51.
[4]	孙振正, 龚靖, 段勇 ,等. 面向下一代数据中心的软件定义存储技术研究[J]. 电信科学, 2014,30(1): 39-43.
	SUN Z Z , GONG J , DUAN Y ,et al. Research on software defined storage technology for the next-generation data center[J]. Telecommunications Science, 2014,30(1): 39-43.
[5]	杨洪章, 罗圣美, 施景超 ,等. 面向移动通信大数据的云存储系统优化[J]. 计算机应用, 2017,37(a01): 27-33.
	YANG H Z , LUO S M , SHI J C ,et al. Cloud storage system optimizations for telecom big data[J]. Journal of Computer Applications, 2017,37(a01): 27-33.
[6]	张泉 . 面向云数据中心的存储服务质量技术研究[D]. 武汉:华中科技大学, 2014.
	ZHANG Q . Research on storage quality of service for cloud data centers[D]. Wuhan:Huazhong University of Science and Technology, 2014
[7]	贾博文, 张文军, 李小勇 . 面向虚拟机的分布式块存储系统设计及实现[J]. 微型电脑应用, 2015(3): 32-37.
	JIA B W , ZHANG W J , LI X Y . Design and implementation of a distributed block storage system for virtual machines in the IaaS cloud[J]. Microcomputer Applications, 2015(3): 32-37.
[8]	WEIL S A , BRANDT S A , MILLER E L ,et al. Ceph:a scalable,high-performance distributed file system[C]// The 7th symposium on Operating systems design and implementation,November 6-8,2006, Seattle,Washington.[S.l.]:USENIX Association, 2006: 307-320.
[9]	NA W W , MENG X X , SI C ,et al. A novel network RAID architecture with out-of-band virtualization and redundant management[C]// The 14th IEEE International Conference on Parallel and Distributed Systems,December 8-10,2008, Melbourne,Victoria,Australia.[S.l.:s.n] 2008: 105-112.
[10]	DIKAIAKOS M D , KATSAROS D , MEHRA P ,et al. Cloud Computing:distributed internet computing for IT and scientific research[J]. IEEE Internet Computing, 2009,13(5): 10-13.
[11]	冯盼盼, 卢明樊 . 一种分布式块存储系统及其存储质量控制方法及装置:CN201510544239.X[P]. 2009-08-28.
	FENG P P , LU M F . A distributed block storage system and its storage quality control method and device:CN201510544239.X[P]. 2009-08-28.
[12]	HUANG L . Stonehenge:a high-performance virtualized IP storage cluster with QoS guarantees[M]. New York: ACM Press, 2003.
[13]	刘飞, 蒋德钧, 张欢 ,等. 异构存储感知的Ceph存储系统数据放置方法[J]. 计算机科学, 2017,44(6): 17-22.
	LIU F , JIANG D J , ZHANG H ,et al. Heterogeneous storage aware data placement of ceph storage system computer science[J]. Computer Science, 2017,44(6): 17-22.
[14]	LEE D , CHOI J , KIM J H ,et al. LRFU:a spectrum of policies that subsumes the least recently used and least frequently used policies[J]. IEEE Transactions on Computers, 2001,50(12): 1352-1361.
[15]	JIANG S , ZHANG X . LIRS:an efficient low inter-reference recency set replacement policy to improve buffer cache performance[J]. ACM SIGMETRICS Performance Evaluation Review, 2002,30(1): 31-42.
[16]	MEGIDDO N , MODHA D S . ARC:a self-tuning,low overhead replacement cache[C]// The 2003 USENIX Conference on File and Storage Technologies,March 31 - April 2,2003, San Francisco,California,USA.[S.l.]:USENIX Association, 2003:9.
[17]	顾荣 . 大数据分布式存储技术与系统研究[D]. 南京:南京大学, 2016.
	GU R . Research on techniques and systems for big data processing[D]. Nanjing:Nanjing University, 2016.
[18]	屠要峰 . 高性能、高可靠中兴超融合架构关键技术解析[J]. 通信世界, 2017(9): 55-56.
	TU Y F . Key technical analysis of high performance and high reliability ZTE hyper-convergence architecture[J]. Communica tions World, 2017(9): 55-56.

Metrics

Recommended 0

No Suggested Reading articles found!

繁忙等级	负载范围下界	负载范围上界	后台业务可否执行
空闲	0	第1负载阈值	全部后台业务
1级繁忙	第1负载阈值	第2负载阈值	第1至第N-1优先
			级后台业务
2级繁忙	第2负载阈值	第3负载阈值	第1至第N-2优先
			级后台业务
…	…	…	…
N-1级	第N-1负载阈值	第N负载阈值	第1优先级后台业务
繁忙
N级繁忙	第N负载阈值	1	否

热度级别	热度范围下界	热度范围上界	对应存储器件
第1热度	第1热度阈值	+∞	第1存储器件
第2热度	第2热度阈值	第1热度阈值	第2存储器件
…	…	…	…
第N热度	0	第N-1热度阈值	第N存储器件

Research and optimization on quality of service in distributed block storage system

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 11

References 18

Related Articles 15

Metrics

Recommended 0

[1]	Jincan XIN, Sen XU, Hua ZHANG, Shangkun XIONG, Hua XU. Study on 5G wireless network enhancement technology for time sensitive networks [J]. Telecommunications Science, 2022, 38(5): 18-25.
[2]	Cheng DING, Jinrong CHEN, Xiaodong CAO, Yi WANG. Quality of service based hierarchical resource allocation algorithm [J]. Telecommunications Science, 2022, 38(1): 102-111.
[3]	Zhongli WU, Yuanyuan CAO, Wenrui HUANG, Bin DAI, Yijun MO. On-demand intelligent routing technology for deterministic network [J]. Telecommunications Science, 2021, 37(11): 11-16.
[4]	Sining LUO,Hualong WANG,Hongyu LI,Wei PENG. Improved ant colony algorithm based cloud computing user task scheduling algorithm [J]. Telecommunications Science, 2020, 36(2): 95-100.
[5]	Zhiwen LIAO,Ling ZHANG. A dynamic timeslot-based multicast bandwidth advance reservation algorithm for enterprise video conferencing systems [J]. Telecommunications Science, 2019, 35(7): 78-86.
[6]	Guangxue YUE,Yasheng DAI,Xiaohui YANG,Youkang ZHU,Zhenxu YOU,Jiansheng LIU. Multi-constrained trusted cooperative task migration strategy for edge computing [J]. Telecommunications Science, 2019, 35(11): 36-50.
[7]	Chong GUO,Wenqing YAN,Bin XU. Green energy management in internet of things based on quality of service composition [J]. Telecommunications Science, 2017, 33(10): 34-42.
[8]	Zhengjiang SONG,Xiaochen LI,Jiang CHEN. QoS boundary analysis of congestion control protocol based on stochastic network calculus in CRSN [J]. Telecommunications Science, 2016, 32(4): 44-51.
[9]	Tao Guo,Youming Li,Peng Lei,Biao Ji,Chengcheng Li. A Resource Allocation Scbeme Based on User's QoS in MIMO Relay System [J]. Telecommunications Science, 2015, 31(4): 114-119.
[10]	Jihong Zhao,Yuan Wang,Rui Tang,Zhenwei Zhang,Hua Qu. Energy Saving Optimization for Mobile Relays in Multicast Transmission Underlying Cellular Network [J]. Telecommunications Science, 2015, 31(4): 71-76.
[11]	Yangbo Guo,Zhizhong Zhang,Haonan Hu,Fang Cheng. Research on Energy Saving Algorithm of 5G Relay Cellular Network [J]. Telecommunications Science, 2015, 31(3): 48-53.
[12]	Guo Yangbo,Zhang Zhizhong,Hu Haonan and Cheng Fang. Research on Energy Saving Algorithm of 5G Relay Cellular Network [J]. Telecommunications Science, 2015, 31(3): 2015052-.
[13]	Fei Meng,Julong Lan,Yuxiang Hu. Researcb on New Internet Quality of Service Guarantee Tecbnology [J]. Telecommunications Science, 2014, 30(9): 116-127.
[14]	Yujun Ma,Min Chen,Junfeng Wang. Quality of Service Approach for Wireless Body Area Network Based on Grade [J]. Telecommunications Science, 2014, 30(5): 81-87.
[15]	Wang Haidong. Recent Advances in Quality-Driven Video Delivery over IEEE 802.11 WLAN [J]. Telecommunications Science, 2013, 29(7): 106-111.