支持高并发的Hadoop高性能加密方法研究

doi:10.11959/j.issn.1000-436x.2019224

Abstract

Abstract:

To address the problem that as preventing data leakage on Hadoop platform,the existing encryption schemes suffer from several problems (e.g.,single encryption algorithm,complicated key management,low encryption performance) and they cannot protect data stored in Hadoop effectively,a high-performance encryption and key management scheme for Hadoop was proposed.Firstly,a three-level key management system was extended with the domestic commercial cipher algorithm.Then,a new data structure for encryption zone key to reduce time consumption was designed.Finally,the computing process of data stream in parallel was scheduled.The experimental results show that compared with the existing Hadoop schemes,the proposed scheme can improve the efficiency of key management,and can speed up file encryption.

Key words: Hadoop data security, key management, commercial cipher algorithm, high performance encryption

CLC Number:

TP302

Wei JIN,Mingjie YU,Fenghua LI,Zhengkun YANG,Kui GENG. High-performance and high-concurrency encryption scheme for Hadoop platform[J]. Journal on Communications, 2019, 40(12): 29-40.

Figures/Tables 8

References 11

[1]	陈丽, 黄晋, 王锐 . Hadoop大数据平台安全问题和解决方案的综述[J]. 计算机系统应用, 2018,27(1): 1-9.
	CHEN L , HUANG J , WANG R . Overview on security issues and solutions of Hadoop big data platform[J]. Computer Systems ＆ Applications, 2018,27(1): 1-9.
[2]	梁胜昔, 秦军, 宋蕾 . HDFS 混合加密保护方案的设计[J]. 计算机时代, 2014(7): 17-19.
	LIANG S X , QIN J , SONG L . Design for protection scheme of hybrid encryption in HDFS[J]. Computer Era, 2014(7): 17-19.
[3]	DíAZ A F , BLOKHIN I , ORTEGA J . Secure data access in Hadoop using elliptic curve cryptography[C]// International Conference on Algorithms and Architectures for Parallel Processing. 2016: 136-145.
[4]	WANG F , KOHLER M , SCHAAD A . Initial encryption of large searchable data sets using Hadoop[C]// The 20th ACM Symposium on Access Control Models and Technologies. SACMAT, 2015: 165-168.
[5]	SONG Y , SHIN Y S , JANG M . Design and implementation of HDFS data encryption scheme using ARIA algorithm on Hadoop[C]// 2017 IEEE International Conference on Big Data and Smart Computing. IEEE, 2017: 84-90.
[6]	LIN H Y , SHEN S T , TZENG W G ,et al. Toward data confidential ity via integrating hybrid encryption schemes and Hadoop distributed file system[C]// 2012 IEEE 26th International Conference on Advanced Information Networking and Applications (AINA). IEEE, 2012: 740-747.
[7]	BHATOTIA P , RODRIGUES R , VERMA A . Shredder:GPU-accelerated incremental storage and computation[C]// The 10th USENIX conference on File and Storage Technologies. 2012.
[8]	COHEN J , ACHARYA S . Towards a trusted Hadoop storage platform:design considerations of an AES based encryption scheme with TPM rooted key protections[C]// The 2013 IEEE 10th International Conference on Ubiquitous Intelligence ＆ Computing and 2013 IEEE 10th International Conference on Autonomic ＆ Trusted Computing. IEEE, 2013: 444-451.
[9]	ZHOU W , XU Y , WANG G . Research on key management for multi-privileged group communications[C]// IEEE Trustcom/BigDataSE/ISPA. IEEE Computer Society, 2015: 151-158.
[10]	KANDAH F I , NICHOLS O , YANG L . Efficient key management for big data gathering in dynamic sensor networks[C]// International Conference on Computing. IEEE, 2017: 667-671.
[11]	ALBAKRI A , MADDUMALA M , HARN L . Hierarchical polynomial-based key management scheme in fog computing[C]// IEEE TrustCom/BigDataSE. IEEE, 2018: 1593-1597.

Metrics

Recommended 0

No Suggested Reading articles found!

[1]	Wei JIN, Fenghua LI, Mingjie YU, Yunchuan GUO, Ziyan ZHOU, Liang FANG. HDFS-oriented cryptographic key resource control mechanism [J]. Journal on Communications, 2022, 43(9): 27-41.
[2]	Zuobin YING, Yuanping SI, Jianfeng MA, Ximeng LIU. Blockchain-based distributed EHR fine-grained traceability scheme [J]. Journal on Communications, 2021, 42(5): 205-215.
[3]	LI Xuejun,ZHANG Dan,LI Hui. Efficient revocable attribute-based encryption scheme [J]. Journal on Communications, 2019, 40(6): 32-39.
[4]	Xiao-yong GUO,An-min FU,Bo-yu KUANG,Wei-jia DING. Secure deduplication and integrity audit system based on convergent encryption for cloud storage [J]. Journal on Communications, 2017, 38(Z2): 156-163.
[5]	Jin-bo XIONG,Feng-hua LI,Yan-chao WANG,Jian-feng MA,Zhi-qiang YAO. Research progress on cloud data assured deletion based on cryptography [J]. Journal on Communications, 2016, 37(8): 167-184.
[6]	Xiao-rui ZHONG,Chun-guang MA. Dynamic accumulators-based authenticated group key management scheme for heterogeneous wireless sensor network [J]. Journal on Communications, 2014, 35(3): 124-134.
[7]	. Dynamic accumulators-based authenticated group key management scheme for heterogeneous wireless sensor network [J]. Journal on Communications, 2014, 35(3): 14-134.
[8]	. On access to trusted virtual group under cloud computing [J]. Journal on Communications, 2013, 34(Z1): 27-215.
[9]	Peng LIANG,Chang-xiang SHEN,Zhen-hu NING. On access to trusted virtual group under cloud computing [J]. Journal on Communications, 2013, 34(Z1): 207-215.
[10]	Zhi-tao GUAN,Yue XU,Jun WU. Ternary polynomial based key management scheme for wireless sensor network [J]. Journal on Communications, 2013, 34(12): 71-78.
[11]	Tao WEN,Yong ZHANG,Quan GUO,Feng-kun LI. Dynamic group key management scheme for homogeneous wireless sensor networks [J]. Journal on Communications, 2012, 33(6): 164-173.
[12]	Chao WANG,Guang-yue HU,Huan-guo ZHANG. Lightweight security architecture design for wireless sensor network [J]. Journal on Communications, 2012, 33(2): 30-35.
[13]	Xi CHEN,Guang-song LI,You-liang TIAN,Jian-feng MA. On-demand key management based on social attribute for opportunistic networks [J]. Journal on Communications, 2012, 33(12): 93-99.
[14]	Lei HAN,Ji-qiang LIU,Zhen HAN,Xue-ye WEI. Pre-distribution asymmetric key management scheme for mobile ad hoc networks [J]. Journal on Communications, 2012, 33(10): 26-34.
[15]	Ya-hui LI,Wen-sheng NIU,Ya-di ZHANG,Jian-feng MA,Yu-long SHEN. Key management protocol for multi-level security UAV dynamic networking [J]. Journal on Communications, 2011, 32(11A): 39-44.

High-performance and high-concurrency encryption scheme for Hadoop platform

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 11

Related Articles 15

Metrics

Recommended 0