基于Hadoop云计算平台的图像分类与标注

doi:10.3969/j.issn.1000-0801.2014.02.008

Abstract

Abstract:

In order to effectively deal with the massive image and video data in internet，a solution for image classification and annotation based on Hadoop cloud platform was proposed.Firstly，a system based on cloud computing was given to crawl the raw data image from WWW.Secondly，a training image extractor based on pLSA （probabilistic latent semantic analysis）was presented to help users to get training set images effectively.Thirdly，the SVM model for the system was integrated，which could be used to classify or annotate novel images.According to the experiment，the system can both meet the functional requirement and achieve optimized performance for image data classification and annotation.

Key words: cloud computing, training set extraction, support vector machine, visual feature extraction

Jiyuan Lu,Chenghui Huang,Fang Hou,Bin Li. Image Classification and Annotation Based on Hadoop Cloud Computing Platform[J]. Telecommunications Science, 2014, 30(2): 65-69.

图像集	测试结果	聚类1	聚类2	聚类3	聚类4	聚类5	聚类6	聚类7	聚类8	聚类9	聚类10
摩托车	符合	44	62	11	6	38	14	1	0	68	5
	不符合	115	43	131	32	27	57	74	26	20	75
蝴蝶	符合	11	1	3	2	10	16	7	45	24	45
	不符合	8	50	40	54	21	3	39	29	13	39

1	Moosmann F ， Nowak E ， Jurie F . Randomized clustering forests for image classification. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2008，30（9）：1632～1646
2	ALIPR . Automatic photo tagging and visual image search. ， 2012
3	GazoPa . Similar image search. ， 2010
4	Cai D ， He X F ， Ma W Y ， et al. Organizing www images based on the analysis of page layout and web link structure. Proceedings of 2004 IEEE International Conference on Multimedia and Expo，ICME’04， Sorrento，Italy， 2004
5	Grangier D ， Bengio S . A discriminative kernel-based approach to rank images from text queries. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2008，30（8）：1371～1384
6	Griffin G ， Holub A ， Perona P . Caltech-256 Object Category Dataset. Technical Report，California Institute of Technology， 2007

[1]	Xue HAN. Damage toughness assessment method of power backbone communication network based on power big data [J]. Telecommunications Science, 2023, 39(5): 136-143.
[2]	Wenjuan XING, Bo LEI, Qianying ZHAO. Development status and trend prospect of computing power infrastructure [J]. Telecommunications Science, 2022, 38(6): 51-61.
[3]	Pingke DENG, Tongxu ZHANG, Nanxiang SHI, Tong ZHANG, Tianzhu SHAO, Shaowen ZHENG. Computing satellite networks—the novel development of computing-empowered space-air-ground integrated networks [J]. Telecommunications Science, 2022, 38(6): 71-81.
[4]	Jiangxing WU. Revolution of the development paradigm of network technology system—network of networks [J]. Telecommunications Science, 2022, 38(6): 3-12.
[5]	Shitong LI, Daying QUAN, Zeyu TANG, Yun CHEN, Xiaofeng WANG, Xiaoping JIN. Time-frequency image and high-order spectrum characteristics based radar signal recognition [J]. Telecommunications Science, 2022, 38(2): 84-91.
[6]	Kun MA, Lingyu XU, Xiaoping SHEN, Zhicheng GONG, Jianping LAN, Shuangxi CHEN, Jun QIAN. Virtual machine scheduling model based on Shapley value modified genetic algorithm in cloud computing [J]. Telecommunications Science, 2022, 38(12): 1-10.
[7]	Zhiyong LIU, Zhongjiang HE, Yilong RUAN, Junfeng SHAN, Chao ZHANG. Big data security features and operation practices [J]. Telecommunications Science, 2021, 37(5): 160-169.
[8]	Jian XU,Li JIN. A quantifiable cloud computing platform security evaluation model [J]. Telecommunications Science, 2020, 36(7): 163-167.
[9]	Yajie LI,Yongli ZHAO,Shoudong LIU,Jie ZHANG. Overview of research on fiber nonlinear equalization algorithm based on artificial intelligence [J]. Telecommunications Science, 2020, 36(3): 61-70.
[10]	Sining LUO,Hualong WANG,Hongyu LI,Wei PENG. Improved ant colony algorithm based cloud computing user task scheduling algorithm [J]. Telecommunications Science, 2020, 36(2): 95-100.
[11]	Bo LEI, Zengyi LIU, Xuliang WANG, Mingchuan ·ANG, ·unqing CHEN. Computing network:a new multi-access edge computing [J]. Telecommunications Science, 2019, 35(9): 44-51.
[12]	Yongmei GAO,Guanjie CHENG. Data-intensive service deployment based on edge computing [J]. Telecommunications Science, 2019, 35(7): 87-99.
[13]	Rongfang ZHANG,Dandan XU,Yuanguang WANG,Siyu PAN,Zhengmao LI. Application of machine learning in the fake user identification of IoT [J]. Telecommunications Science, 2019, 35(7): 136-144.
[14]	Zelin LU,Qiangzhi LI. Evolutionary logic and operational mechanism of E-commerce platform [J]. Telecommunications Science, 2019, 35(7): 152-158.
[15]	LEI Yuxiao,LI Gengfeng,HUANG Yuxiong,BIE Zhaohong. Support vector machine based fast Monte Carlo reliability evaluation method for composite power system [J]. Telecommunications Science, 2019, 35(6): 15-24.

Image Classification and Annotation Based on Hadoop Cloud Computing Platform

RichHTML

PDF下载

Knowledge

Cited

Abstract

Cite this article

share this article

Figures/Tables 6

References 6

Related Articles 15

Metrics

Recommended 0