大数据机器学习系统研究进展

doi:10.11959/j.issn.2096-0271.2015.01.004

Abstract

Abstract:

To achieve efficient big data machine learning, we need to construct a unified big data machine learning system to support both machine learning algorithm design and big data processing. Designing an efficient, scalable and easy-to-use big data machine learning system still faces a number of challenges. Recently, the upsurge of big data technology has promoted rapid development of big data machine learning, making big data machine learning system to become a research hotspot. The basic concepts, research issues, technical characteristics, categories, and typical systems for big data machine learning system, were reviewed. Then a unified and cross-platform big data machine learning system, Octopus, was presented.

Key words: big data, machine learning, distributed and parallel computing, big data processing platform

Yihua Huang. Research Progress on Big Data Machine Learning System[J]. Big Data Research, 2015, 1(1): 35-54.

Figures/Tables 7

References 23

[1]	Banko M , Brill E , KIEKINTVELD C , . Scaling to very large corpora for natural language disambiguation. Proceedings of the 39th Annual Meeting on Association for Computational Linguistics (ACL)， Toulouse, France, 2001,26～33.
[2]	Brants T , Popat C A , Xu P , et al. Large language models in machine translation. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Language Learning， Prague, Czech Republic, 2007,858-867.
[3]	Wang Y , Zhao X M , Sun Z L , et al. Peacock: learning long-tail topic features for industrial applications. ACM Transactions on Intelligent Systems and Technology, 2014,9(4)
[4]	中国计算机学会大数据专家委员会. 2015年中国大数据发展趋势预测. 中国计算机学会通讯, 2014,11(1): 48-52.
	CCF Task Force on Big Data. Forecast for the development trend of big data in 2015 Communications of the China Computer Federation (CCCF), 2014,11(1): 48-52.
[5]	Gonzalez J E Emerging systems for large-scale machine learning. Proceedings of Tutorial on International Conference for Machine Learning(ICML) 2014， Beijing, China, 2014
[6]	中国计算机学会大数据专家委员会. 2014年中国大数据技术与产业发展白皮书. 2014中国大数据技术大会, 北京, 中国, 2014
	CCF Task Force on Big Data. White paper of China’s big data technology and industrial development in 2014 Proceedings of Big Data Conference China, Beijing, China, 2014
[7]	Boehm M , Tatikonda S , Reinwald B . et al. Hybrid parallelization strategies for large-scale machine learning in systemML. Proceedings of the VLDB Endowment， Hangzhou, China 2014
[8]	Markl V , YIN Z . Breaking the chains: on declarative data analysis and data independence in the big data era. Proceedings of the VLDB Endowment， Hangzhou, China 2014
[9]	Kraska T T . MLbase: a distributed machine-learning system. Proceedings of the 6th Conference on Innovative Data Systems Research(CIDR), Asilomar, CA, USA, 2013
[10]	Fan W F , Geerts F , Neven F , . Making queries tractable on big data with preprocessing: through the eyes of complexity theory. Proceedings of the VLDB Endowment, Trento, Italy, 2011:685～696.
[11]	Dean J , Ghemawat S . MapReduce:simplified data processing on large clusters. Communications of the ACM, 2004,51(1): 107～113.
[12]	Zaharia M , Chowdhury M , Das T , et al. Resilient distributed datasets:a fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation(NSDI), San Jose, CA, USA, 2012141-146.
[13]	Venkataraman S , Bodzsar E , Roy I , et al. Presto: distributed machine learning and graph processing with sparse matrices. Proceedings of the 8th ACM European Conference on Computer Systems(EuroSys), Prague, Czech Republic, 2013197-210.
[14]	Ghoting A , Krishnamurthy S , Pednault E , et al. SystemML: declarative machine learning on MapReduce. Proceedings of International Conference on Data Engineering (ICDE), Hannover, Germany, 2011231～242.
[15]	Boehm M , Tatikonda S , Reinwald B , et al. Hybrid parallelization strategies for large-scale machine learning in SystemML. Proceedings of the VLDB Endowment, Hangzhou, China, 2011231-242.
[16]	Low Y , Bickson D , Gonzalez J , et al. Distributed graphLab: a framework for machine learning and data mining in the cloud. Proceedings of the VLDB Endowment, Istanbul, Turkey, 2012716～727.
[17]	Li M , Andersen G D , Park W J , et al. Scaling distributed machine learning with the parameter server. Proceedings of Operating Systems Design and Implementation (OSDI), Broomfield, CD, USA, 2014；583～598.
[18]	Ho Q , Cipar J , Cui H W J , et al. More effective distributed ml via a stale synchronous parallel parameter server. Proceedings of Advances in Neural Information Processing Systems (NIPS), Nevada, USA, 2013：1223～1231.
[19]	Alexandrov A , Bergmann R , Ewen S , et al. The stratosphere platform for big data analytics. Vldb Journal, 2014,23(6):939-964.
[20]	Battré D , Ewen S , Hueske F , et al. Nephele/PACTs: a programming model and execution framework for web-scale analytical processing. Proceedings of ACM Symposium on Cloud Computing(SoCC), Indianapolis, Indiana, USA, 2010：119～130.
[21]	Dai W , Wei J , Zheng X , et al. Petuum:a framework for iterative-convergent distributed ML. Proceedings of Advances in Neural Information Processing Systems 26, Big Learning Workshop, California, USA, 2013
[22]	邹永强 . Mariana—腾讯深度学习平台的进展与应用. 2014年中国大数据技术大会，北京，中国， 2014
	Zou Y Q . Marina-the progress and application of deep learning platform of Tencent. Proceedings of Database Technology Conference China 2015， Beijing, China, 2014
[23]	刘伟 . 百度机器学习云平台. 2014年中国大数据技术大会，北京，中国， 2015
	Liu W . Machine learning cloud platform of Baidu Proceedings of Database Technology Conference China 2015， Beijing, China, 2015

Metrics

Recommended 0

No Suggested Reading articles found!

Research Progress on Big Data Machine Learning System

RichHTML

PDF下载

Knowledge

Cited

Abstract

Cite this article

share this article

Figures/Tables 7

References 23

Related Articles 15

Metrics

Recommended 0

[1]	Haihong QIAN, Maoyi WANG, Yun XIONG. Digital transformation in higher education:a systematic review [J]. Big Data Research, 2023, 9(3): 56-70.
[2]	Hong MEI, Xiaoyong DU, Hai JIN, Xueqi CHENG, Yunpeng CHAI, Xuanhua SHI, Xiaolong JIN, Yasha WANG, Chi LIU. Big data technologies forward-looking [J]. Big Data Research, 2023, 9(1): 1-20.
[3]	Yang SHEN, Menglong YU. Metaverse and big data: data insight and value connection in spatio-temporal intelligence [J]. Big Data Research, 2023, 9(1): 103-110.
[4]	Jing CHEN. Humanities big data and its application in the field of digital humanities [J]. Big Data Research, 2022, 8(6): 3-14.
[5]	Yuchu LUO, Hao WU, Yuhan GUO, Shaocong TAN, Can LIU, Ruike JIANG, Xiaoru YUAN. Visualization in digital humanities [J]. Big Data Research, 2022, 8(6): 74-93.
[6]	Lingli ZHANG, Qikai CHU, Guijuan WANG, Weihan ZHANG, Hui PU, Zhenjin SONG, Yadong WU. Text sentiment visual analysis technology and its application in humanities [J]. Big Data Research, 2022, 8(6): 56-73.
[7]	Tongzheheng ZHENG, Bin LI, Minxuan FENG, Bolin CHANG, Dongbo WANG. Explore the structuration of historical books:the construction and quantitative analysis of digital humanities database of the Biographies of the Shiji [J]. Big Data Research, 2022, 8(6): 40-55.
[8]	Jianhan WU, Shijing SI, Jianzong WANG, Jing XIAO. Threats and defenses of federated learning: a survey [J]. Big Data Research, 2022, 8(5): 12-32.
[9]	Wenlong LI, Yuan YUAN, Xiaopeng AN. Modus operandi of big data governance: some preliminary observations [J]. Big Data Research, 2022, 8(4): 34-45.
[10]	Qifeng TANG, Zhiqing SHAO, Yazhen YE. Authenticating and licensing architecture of data rights in data trade [J]. Big Data Research, 2022, 8(3): 40-53.
[11]	Chenhuizi WANG, Wei CAI. Digital economics in metaverse: state-of-the-art, characteristics, and vision [J]. Big Data Research, 2022, 8(3): 140-150.
[12]	Mei YANG, Wei LI, Siyuan QIAO, Wei LIU. Research on calculation method of China’s big data industry output value [J]. Big Data Research, 2022, 8(3): 151-160.
[13]	Deren LI, Guo ZHANG, Yonghua JIANG, Xin SHEN, Weiling LIU. Opportunities and challenges of geo-spatial information science from the perspective of big data [J]. Big Data Research, 2022, 8(2): 3-14.
[14]	Xiaolan QIU, Yuxin HU, Songtao SHANGGUAN, Kun FU. Remote sensing satellite big data high-recision integration processing technology [J]. Big Data Research, 2022, 8(2): 15-27.
[15]	Weiquan LIU, Cheng WANG, Yu ZANG, Qian HU, Shangshu YU, Baiqi LAI. A survey on information extraction technology based on remote sensing big data [J]. Big Data Research, 2022, 8(2): 28-57.