网络编码云存储系统差分数据更新方案

doi:10.11959/j.issn.1000-436x.2017045

通信学报 ›› 2017, Vol. 38 ›› Issue (3): 154-164.doi: 10.11959/j.issn.1000-436x.2017045

网络编码云存储系统差分数据更新方案

王龙江,陈越,严新成,黄恺翔

解放军信息工程大学，河南郑州 450001

修回日期:2016-10-25 出版日期:2017-03-01 发布日期:2017-04-13
作者简介:王龙江（1991-），男，陕西商洛人，解放军信息工程大学硕士生，主要研究方向为网络信息安全、云存储安全等。|陈越（1965-），男，河南开封人，博士，解放军信息工程大学教授、博士生导师，主要研究方向为网络与信息安全。|严新成（1991-），男，河南信阳人，解放军信息工程大学硕士生，主要研究方向为网络信息安全、基于机密的云数据访问控制。|黄恺翔（1987-），男，河南新乡人，解放军信息工程大学博士生，主要研究方向为网络与信息安全等。
基金资助:
国家重点基础研究发展计划（“973”计划）基金资助项目(2012CB315901);河南省科技攻关计划基金资助项目(17210221001)

Differential data update scheme on network-coding-based cloud storage system

Long-jiang WANG,Yue CHEN,Xin-cheng YAN,Kai-xiang HUANG

PLA Information Engineering University,Zhengzhou 450001,China

Revised:2016-10-25 Online:2017-03-01 Published:2017-04-13
Supported by:
The National Basic Research Program of China (973 Program)(2012CB315901);Key Technologies R & D Program of Henan Province(17210221001)

摘要/Abstract

摘要：

针对基于网络编码云存储系统数据更新时通信开销过大的问题，提出一种差分数据更新方案，通过对文件中更新部分进行编码和压缩传输，降低了更新过程中的通信开销。设计实现了基于网络编码的云存储原型系统，在真实网络环境中进行部署和测试，实验结果表明，与现有更新方案相比，所提方案通信开销更小，具有更好的可扩展性。

关键词: 网络编码, 云存储, 差分数据更新

Abstract:

In order to solve the problem that the communication overhead of date update was too large on network-coding-based cloud storage system,a new differential data update scheme was proposed.By encoding and compressing the updated part of file,the communication overhead was reduced significantly.A network-coding-based storage prototype system was designed and implemented,and update scheme was deployed in the real network settings.Experimental results show that the proposed scheme has less communication overhead and better scalability than the existing schemes.

Key words: network coding, cloud storage, differential data update

中图分类号:

TP391

王龙江,陈越,严新成,黄恺翔. 网络编码云存储系统差分数据更新方案[J]. 通信学报, 2017, 38(3): 154-164.

Long-jiang WANG,Yue CHEN,Xin-cheng YAN,Kai-xiang HUANG. Differential data update scheme on network-coding-based cloud storage system[J]. Journal on Communications, 2017, 38(3): 154-164.

图/表 14

图1

表1

符号与说明"

符号	说明
F	由文件 file所有原始数据块组成，具有k个元素
P	由文件 file所有编码数据块组成，具有n个元素
s	每个数据块的大小，以字节为单位
k	原始数据块的数目
n	编码数据块的数目
$R = \frac{n}{k}$	冗余度，表示存储系统数据的冗余程度
f_i(i=1,2,…,k)	文件 file的第i个原始数据块
p_j(j=1,2,…,n)	文件 file的第 j个编码数据块
GF(q)	元素个数为q的伽罗华域
$E M = {(a_{i, j})}_{n \times k}$	编码矩阵，是一个n×k 的可逆矩阵，其中每个元素都来自GF(q)
$E M V$	编码块 p_i对应的编码向量
$N_{i} (i = 1, 2, \dots, n)$	第i个存储节点

表1

图2

图5

图3

图4

图6

图7

图8

图9

图10

图11

图12

图13

参考文献 30

[1]	HASHEM I A T , YAQOOB I , ANUAR N B ,et al. The rise of “big data” on cloud computing:review and open research issues[J]. Information Systems, 2014,47(47): 98-115.
[2]	JIEHUI J U , JIYI W U , JIANQING F U ,et al. A survey on cloud storage[J]. Journal of Computers, 2011,6(8): 1764-1771.
[3]	Amazon . What is Amazon S3?[J]. Amazon Simple Storage Service Developer Guide, 2006.
[4]	LI H . Introducing windows azure[J]. David Chappell & Associates White Paper, 2010.
[5]	ZAKERINASAB M R , WANG M . DeltaNC:efficient file updates for network-coding-based cloud storage systems[C]// IEEE International Symposium on Modelling,Analysis & Simulation of Computer and Telecommunication Systems. 2013: 360-364.
[6]	HU Y , LEE P P C , SHUM K W . Analysis and construction of functional regenerating codes with uncoded repair for distributed storage systems[C]// IEEE INFOCOM. 2012: 2355-2363.
[7]	罗象宏, 舒继武 . 存储系统中的纠删码研究综述[J]. 计算机研究与发展, 2012,49(1): 1-11.
	LUO X H , SHU J W . Summary of research for erasure code in storage system[J]. Journal of Computer Research and Development, 2012,49(1): 1-11.
[8]	LI J , LI B . Erasure coding for cloud storage systems:a survey[J]. Tsinghua Science & Technology, 2013,18(3): 259-272.
[9]	RASHMI K V , SHAH N B , GU D ,et al. A solution to the network challenges of data recovery in erasure-coded distributed storage systems:a study on the facebook warehouse cluster[J]. Usenix Hotstorage, 2013:8.
[10]	REED I S , SOLOMON G . Polynomial codes over certain finite fields[J]. Journal of the Society for Industrial & Applied Mathematics, 1960,8(2): 300-304.
[11]	PLANK , JAMES S . A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems[J]. Software—practice & Experience, 1996,27(9): 995-1012.
[12]	DIMAKIS A G , GODFREY P B , WU Y ,et al. Network coding for distributed storage systems[J]. IEEE Transactions on Information Theory, 2007,56(9): 2000-2008.
[13]	BLOMER J , KALFANE M , KARP R ,et al. An XOR-based erasure-resilient coding scheme[C]// Proc Acm Sigcomm. 1999.
[14]	BLAUM M , BRADY J , BRUCK J ,et al. EVENODD:an efficient scheme for tolerating double disk failures in RAID architectures[J]. IEEE Transactions on Computers, 1995,44(2): 192-202.
[15]	CORBETT P , ENGLISH B , GOEL A ,et al. Row-diagonal parity for double disk failure correction[C]// 3rd USENIX Symposium on File and Storage Technologies (FAST'04), 2014: 1-14.
[16]	GHEMAWAT S , GOBIOFF H , LEUNG S T . The Google file system[J]. ACM Sigops Operating Systems Review, 2003,37(5): 29-43.
[17]	DHRUBA B . HDFS architecture guide[Z]. Hadoop, 2008.
[18]	AHLSWEDE R , CAI N , LI S Y R ,et al. Network information flow[J]. Fundamenta Informaticae, 2006,72(1-3): 167-180.
[19]	GKANTSIDIS C , RODRIGUEZ P R . Network coding for large scale content distribution[C]// Infocom,Joint Conference of the IEEE Computer & Communications Societies. 2005: 2235-2245.
[20]	DIMAKIS A G , GODFREY P B , WAINWRIGHT M J ,et al. Network coding for distributed storage systems[C]// IEEE INFOCOM 2007-26th IEEE International Conference on Computer Communications. 2007: 2000-2008.
[21]	DIMAKIS A G , GODFREY P B , WU Y ,et al. Network coding for distributed storage systems[J]. IEEE Transactions on Information Theory, 2010,56(9): 4539-4551.
[22]	HU Y , YU C M , LI Y K ,et al. NCFS:on the practicality and extensibility of a network-coding-based distributed file system[C]// International Symposium on Network Coding. 2011: 1-6.
[23]	RASHMI K V , SHAH N B , KUMAR P V . Optimal exact-regenerating codes for distributed storage at the MSR and MBR points via a product-matrix construction[J]. IEEE Transactions on Information Theory, 2011,57(57): 5227-5239.
[24]	RASHMI K V , SHAH N B , KUMAR P V ,et al. Explicit construction of optimal exact regenerating codes for distributed storage[C]// 47th Annual Allerton Conference on Communication,Control,and Computing, 2009: 1243-1249.
[25]	CHEN H C H , HU Y , LEE P P C ,et al. NCCloud:a network-codingbased storage system in a cloud-of-clouds[J]. IEEE Transactions on Computers, 2014,63(1): 31-44.
[26]	CHESTERFIELD J , RODRIGUEZ P . DeltaCast:efficient file reconciliation in wireless broadcast systems[C]// International Conference on Mobile Systems,Applications,and Services. 2005: 93-106.
[27]	IRMAK U , MIHAYLOV S , SUEL T . Improved single-round protocols for remote file synchronization[J]. Proceedings-IEEE INFOCOM, 2005,3: 1665-1676.
[28]	MOHAMMAD R Z , WANG M . An update model for network coding in cloud storage systems[C]// Communication,Control,and Computing. 2012: 1158-1165.
[29]	ZHANG M , NEMAT A B , BLISS D E . Galois field multiplication system and method:US,US7526518[P]. 2009.
[30]	RATH N , SZEREDI M ,et al. FUSE[DB]. 2009-10-15.

网络编码云存储系统差分数据更新方案

Differential data update scheme on network-coding-based cloud storage system

在线阅读

PDF下载

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 14

参考文献 30

相关文章 15

Metrics

推荐阅读 0

[1]	赖恪, 雷菁, 刘伟, 文磊. 基于网络编码的稀疏码分多址接入HARQ方案[J]. 通信学报, 2022, 43(9): 57-69.
[2]	哈冠雄, 贾巧雯, 陈杭, 贾春福. 无第三方服务器的基于数据流行度的加密去重方案[J]. 通信学报, 2022, 43(8): 17-29.
[3]	杨君一, 李博, 张钦宇. 基于物理层网络编码的无人机中继网络资源优化[J]. 通信学报, 2021, 42(9): 12-20.
[4]	刘光军, 郭网媚, 熊金波, 刘西蒙, 董长宇. 适用于再生编码分布式存储的轻量型隐私保护审计方案[J]. 通信学报, 2021, 42(7): 220-230.
[5]	殷俊, 沙雪琪, 王磊, 张登银, 杨余旺. 基于网络编码的协作恢复机制线性可解性研究[J]. 通信学报, 2021, 42(5): 216-229.
[6]	冯涛, 孔繁琪, 柳春岩, 马蓉, Maher Albettar. 基于区块链的双重可验证云存储方案[J]. 通信学报, 2021, 42(12): 192-201.
[7]	贾春福, 哈冠雄, 武少强, 陈杭, 李瑞琪. 加密去重场景下基于AONT和NTRU的密钥更新方案[J]. 通信学报, 2021, 42(10): 67-80.
[8]	蒲保兴,莫智懿. 双单播网络编码的构造方法[J]. 通信学报, 2020, 41(9): 92-103.
[9]	田俊峰,王彦骉,何欣枫,张俊涛,杨万贺,庞亚南. 数据因果一致性研究综述[J]. 通信学报, 2020, 41(3): 154-167.
[10]	柯文龙,王勇,叶苗,陈俊奇. Ceph云存储网络中一种业务优先级区分的多播流调度方法[J]. 通信学报, 2020, 41(11): 40-51.
[11]	孙磊,赵志远,王建华,朱智强. 云存储环境下支持属性撤销的属性基加密方案[J]. 通信学报, 2019, 40(5): 47-56.
[12]	张襄松,李晨,刘振华. 抗密钥泄露的支持密态数据去重的完整性审计方案[J]. 通信学报, 2019, 40(4): 95-106.
[13]	田苗苗,高闯,陈洁. 格上基于身份的云存储完整性检测方案[J]. 通信学报, 2019, 40(4): 128-139.
[14]	田俊峰,柴梦佳,齐鎏岭. 基于公有验证和私有验证的数据持有性验证方案[J]. 通信学报, 2019, 40(3): 48-59.
[15]	俞惠芳,李雯. 单/多源网络编码同态签名方案[J]. 通信学报, 2019, 40(11): 112-121.