大数据时代的数据挖掘——从应用的角度看大数据挖掘

doi:10.11959/j.issn.2096-0271.2015041

Abstract

Abstract:

The technical characteristics, tasks, and difficulties of data mining in big data era were introduced.The system architecture of large-scale data mining was analyzed.Then, the developed FIU-Miner which is a fast, integrated, and user-friendly system for data mining, was introduced.FIU-Miner supports user-friendly rapid data mining task configuration, flexible cross-language program integration, and effective resource management in heterogeneous environments.Finally three successful real-world applications of FIU-Miner: advanced manufacturing data mining, spatial data mining, and business intelligence data mining, were presented to demonstrate its efficacy and effectiveness.

Key words: big data, data mining, FIU-Miner, advanced manufacturing, spatial data mining, business intelligence

CLC Number:

TP311.13

Figures/Tables 15

References 13

[1]	严霄凤, 张德馨 . 大数据研究. 计算机技术与发展, 2013,23(4): 168～172
	Yan X F , Zhang D X . Big data research. Computer Technology and Development, 2013,23(4): 168～172
[2]	李国杰 . 对大数据的再认识. 大数据, 2015001
	Li G J . Further understanding of big data. Big Data Research, 2015001
[3]	李涛 . 数据挖掘的应用与实践: 大数据时代的案例分析. 厦门: 厦门大学出版社, 2013
	Li T . Data Mining Where Theory Meets Practice. Xiamen: Xiamen Press, 2013
[4]	Hall M , Frank E , Holmes G , et al. The Weka data mining software: an update. SIGKDD Explorations, 2009,11(1):10～18
[5]	Owen S , Anil R , Dunning T , et al. Mahout in Action. Shelter Island: Manning Publications, 2011
[6]	Prekopcsak Z , Makrai G , Henk T , et al. Radoop: analyzing big data with rapid miner and hadoop. Proceedings of RapidMiner Community Meeting and Conference,, Dublin, Ireland, 2011
[7]	Yu L , Zheng J , Wu B , et al. Bc-pdm: data mining, social network analysis and text mining system based on cloud computing. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’12), Beijing, China, 2012
[8]	Zeng C Q , Jiang Y X , Zheng L , et al. Fiu-Miner: a fast, integrated, and user-friendly system for data mining in distributed environment. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’13), Chicago, Illinois, USA, 2013:1506～1509
[9]	Lei D , Hitt M A , Goldhar J D . Advanced manufacturing technology: organizational design and strategic flexibility. Organization Studies, 1996,17(3):501～523
[10]	Zheng L , Zeng C Q , Li L , et al. Applying data mining techniques to address critical process optimization needs in advanced manufacturing. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’14), New York, USA, 2014:1739～1748
[11]	Zhang M J , Wang H B , Lu Y , et al. TerraFly GeoCloud: an online spatial data analysis and visualization system. ACM Transactions on Intelligent Systems and Technology (TIST), 2015,6(3)
[12]	Zeng C Q , Li H T , Wang H B , et al. Optimizing online spatial data analysis with sequential query patterns. Proceedings of the 15th IEEE International Conference on Information Reuse and Integration, San Francisco, CA, USA, 2014
[13]	Li L , Shen C , Wang L , et al. iMiner:mining inventory data for intelligent management. Proceedings of the 23rd ACM International Conference on Information and Knowledge Management, Shanghai, China, 2014

Metrics

Recommended 0

No Suggested Reading articles found!

数据挖掘技术	评价标准	数据准备	流程配置	操作执行
传统数据挖掘技	评价内容	实现数据加载和存储流程	程序实现各个分析模块的	实现监控模块，人工控制
术工具库			依赖关系和调度顺序	和检测失败任务
	时间成本	若干小时	若干天	若干天
	人力成本	需要具备在分布式环境下编程的数据分析人员
等离子显示屏数	评价内容	使用定制的用户界面加载和	通过后台程序来配置任务，	监控任务的执行，支持失
据挖掘技术		存储数据	对用户透明	败任务诊断
	时间成本	简单点击配置	任务的自动调度和配置，若	简单点击查看若干小时
			干分钟
	人力成本	对业务人员不需要编程程序，具备基本的数据分析知识

[1]	Haihong QIAN, Maoyi WANG, Yun XIONG. Digital transformation in higher education:a systematic review [J]. Big Data Research, 2023, 9(3): 56-70.
[2]	Hong MEI, Xiaoyong DU, Hai JIN, Xueqi CHENG, Yunpeng CHAI, Xuanhua SHI, Xiaolong JIN, Yasha WANG, Chi LIU. Big data technologies forward-looking [J]. Big Data Research, 2023, 9(1): 1-20.
[3]	Yang SHEN, Menglong YU. Metaverse and big data: data insight and value connection in spatio-temporal intelligence [J]. Big Data Research, 2023, 9(1): 103-110.
[4]	Jing CHEN. Humanities big data and its application in the field of digital humanities [J]. Big Data Research, 2022, 8(6): 3-14.
[5]	Yuchu LUO, Hao WU, Yuhan GUO, Shaocong TAN, Can LIU, Ruike JIANG, Xiaoru YUAN. Visualization in digital humanities [J]. Big Data Research, 2022, 8(6): 74-93.
[6]	Tongzheheng ZHENG, Bin LI, Minxuan FENG, Bolin CHANG, Dongbo WANG. Explore the structuration of historical books:the construction and quantitative analysis of digital humanities database of the Biographies of the Shiji [J]. Big Data Research, 2022, 8(6): 40-55.
[7]	Wenlong LI, Yuan YUAN, Xiaopeng AN. Modus operandi of big data governance: some preliminary observations [J]. Big Data Research, 2022, 8(4): 34-45.
[8]	Qifeng TANG, Zhiqing SHAO, Yazhen YE. Authenticating and licensing architecture of data rights in data trade [J]. Big Data Research, 2022, 8(3): 40-53.
[9]	Chenhuizi WANG, Wei CAI. Digital economics in metaverse: state-of-the-art, characteristics, and vision [J]. Big Data Research, 2022, 8(3): 140-150.
[10]	Mei YANG, Wei LI, Siyuan QIAO, Wei LIU. Research on calculation method of China’s big data industry output value [J]. Big Data Research, 2022, 8(3): 151-160.
[11]	Deren LI, Guo ZHANG, Yonghua JIANG, Xin SHEN, Weiling LIU. Opportunities and challenges of geo-spatial information science from the perspective of big data [J]. Big Data Research, 2022, 8(2): 3-14.
[12]	Xiaolan QIU, Yuxin HU, Songtao SHANGGUAN, Kun FU. Remote sensing satellite big data high-recision integration processing technology [J]. Big Data Research, 2022, 8(2): 15-27.
[13]	Weiquan LIU, Cheng WANG, Yu ZANG, Qian HU, Shangshu YU, Baiqi LAI. A survey on information extraction technology based on remote sensing big data [J]. Big Data Research, 2022, 8(2): 28-57.
[14]	Jianqiang LIU, Xiaomin YE, Youguo LAN. Remote sensing big data from Chinese ocean satellites and its application service [J]. Big Data Research, 2022, 8(2): 75-88.
[15]	Hequn YANG, Xiaofeng WANG, Yanqing GAO, Yiwen LU, Bingxin MA, Xinyao WANG. Analysis of satellite big data requirements in numerical weather prediction [J]. Big Data Research, 2022, 8(2): 89-102.

Data Mining in the Era of Big Data:From the Application Perspective

RichHTML

PDF下载

Knowledge

Cited

Abstract

Cite this article

share this article

Figures/Tables 15

References 13

Related Articles 15

Metrics

Recommended 0