基于短文本的食源性疾病事件探测技术

doi:10.11959/j.issn.2096-0271.2016022

Abstract

Abstract:

MicroBlog is a typical short text data source for event detection. Because of diversity, sparsity and debris in MicroBlog content, using existing event detection method is ineffective, and the event spatio-temporal information is inaccurate. To the end, a dynamic context window algorithm was proposed, improved the efficiency and precision of event detection of foodborne diseases based on MicroBlog. Moreover, an algorithm was developed which can get spatio-temporal information from MicroBlog more accurate. Finally, extensive experiments on event detection of foodborne diseases show the proposed method can help to expand the data source and improve the accuracy of time and space dimension.

Key words: short text, event detection, spatio-temporal information, MicroBlog, foodboorne disease

CLC Number:

TP399

Tiangang ZHU,Danhuai GUO,Xuezhi WANG,Jianhui LI,Yuanchun ZHOU. Foodborne diseases event detection based on short text[J]. Big Data Research, 2016, 2(2): 88-99.

Figures/Tables 5

References 38

[1]	中国互联网络信息中心. 第32次中国互联网络发展状况统计报告[R]. 北京：中国互联网络信息中心, 2013.
	CNNIC.The 32th Chinese Internet Development Report[R]. Beijing： CNNIC, 2013.
[2]	祝华新, 单学刚, 胡江春, 等. 2011年中国互联网舆情分析报告[R]. [出版地不详：出版者不详], 2011.
	ZHU H X , SHAN X G , HU J C , et al. 2011 China Internet Public Opinion Analysis Report[R]. [S.l.:s.n.], 2011.
[3]	LI R , LEI K H , KHADIWALA R , et al . Tedas: a twitter-based event detection and analysis system[C]// IEEE 28th International Conference on Data Engineering (ICDE), April 1-5, 2012, Arlington, Virginia, USA. New Jersey:IEEE Press, 2012:1273-1276.
[4]	GUPTA M , LI R , CHANG K C C . . Towards a social media analytics platform:event detection and user profiling for twitter[C]// The 23rd International World Wide Web Conference, April 7-11, 2014, Seoul, Korea. [S.l: s.n.], 2014:193-194.
[5]	LI C , SUN A , DATTA A . . Twevent: segment-based event detection from tweets[C]// The 21st ACM International Conference on Information and Knowledge Management, Oct 29-Nov 2, 2012, Maui, USA. New York: ACM Press, 2012:155-164.
[6]	LEE K , AGTAWAL A , CHOUDHARY A . . Real-time disease surveillance using twitter data: demonstration on flu and cancer[C]// The 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 11-14, 2013, Chicago, USA. New York: ACM Press, 2013:1474-1477.
[7]	黄永光, 刘挺, 车万翔, 等. 面向变异短文本的快速聚类算法[J]. 中文信息学报, 2007,21(2): 63-68.
	HUANG Y G , LIU T , CHE W X , et al. A fast clustering algorithm for abnormal and short texts[J]. Journal of Chinese Information Processing, 2007,21(2): 63-68.
[8]	杨震, 段立娟, 赖英旭. . 基于字符串相似性聚类的网络短文本舆情热点发现技术[J]. 北京工业大学学报, 2010,36(5): 669-673.
	YANG Z , DUAN L J , LAI Y X . Online public opinion hotspot detection and analysis based on short text clustering using string distance[J]. Journal of Beijing University of Technology, 2010,36(5): 669-673.
[9]	徐君飞, 张居作. . 2001-2010 年中国食源性疾病暴发情况分析[J]. 中国农学通报, 2012,28(27): 313-316.
	XU J F , ZHANG J Z . Analysis of foodborne disease outbreaks in China between 2001 and 2010[J]. Chinese Agricultural Science Bulletin, 2012,28(27): 313-316.
[10]	PARKER J , WEI Y , YATES A , et al . A framework for detecting public health trends with Twitter[C]// The 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, Aug 25-28, 2013, Niagara Falls, Canada. New Jersey: IEEE Press, 2013:556-563.
[11]	PETROVI? S , OSBORNE M , LAVRENKO V . . Streaming first story detection with application to Twitter[C]// Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics, June 2, 2010, Rochester, NY, USA. [S.l: s.n.], 2010:181-189.
[12]	MATHIOUDAKIS M , KOUDAS N . Twittermonitor: trend detection over the twitter stream.[C]// The 2010 ACM SIGMOD International Conference on Management of Data, June 6-11, 2010, Indianapolis, USA. New York: ACM Press, 2010: 1155-1158.
[13]	MARCHETTE D J , HOHMAN E . Tracking Disease Outbreaks Using Twitter[R]. [S.l: s.n.], 2014.
[14]	CHENG Z , CAVERLEE J , LEE K . . You are where you tweet: a content-based approach to geo-locating twitter users[C]// The 19th ACM International Conference on Information and Knowledge Management, October 26-30, 2010, Toronto, Canada, New York: ACM Press, 2010:759-768.
[15]	CULOTTA A . Towards detecting influenza epidemics by analyzing Twitter messages[C]// The 1st Workshop on Social Media Analytics, July 25, 2010, Washington DC, USA. [S.l: s.n.], 2010: 115-122.
[16]	THOM D , BOSCH H , KRüGER R , et al . Using large scale aggregated knowledge for social media location discovery[C]//IEEE 47th Hawaii International Conference on System Sciences (HICSS), January 6-9, 2014,Washington DC, USA. New Jersey: IEEE Press, 2014:1464-1473.
[17]	MAHMUD J , NICHOLS J , DREWS C . . Where is this tweet from？Inferring home locations of Twitter users[C]// The 6th International AAAI Conference on Weblogs and Social Media, June 4-8, 2012, Dublin, Ireland. Palo Alto: AAAI Press, 2012:511-514.
[18]	PAUL M J , DREDZE M . You are what you tweet: analyzing Twitter for public health[C]// The 6th International AAAI Conference on Weblogs and Social Media, June 4-7, 2011, Barcelona, Spain. Palo Alto: AAAI Press, 2011: 265-272.
[19]	SIGNORINI A , SEGRE A M , POLGREEN P M . . The use of Twitter to track levels of disease activity and public concern in the US during the influenza A H1N1 pandemic[J]. PLoS One, 2011,6(5):e19467.
[20]	HARRIS J K , MANSOUR R , CHOUCAIR B , et al . Health department use of social media to identify foodborne illness-Chicago, Illinois, 2013-2014[J]. MMWR Morb Mortal Wkly Rep, 2014,63(32):681-685.
[21]	PAUL M , DREDZE M . A model for mining public health topics from Twitter[D]. Baltimore: The Johns Hopkins University, 2011.
[22]	IMRAN M , CASTILLO C , DIAZ F , et al . Processing social media messages in mass emergency: a survey[J]. arXiv Preprint, 2014,arXiv:1407.7071.
[23]	SAYYADI H , HURST M , MAYKOV A . . Event detection and tracking in social streams[C]//The 3rd International AAAI Conference on Weblogs and Social Media,May 17-20, 2009, San Jose, California, USA. Palo Alto: AAAI Press, 2009:1-4.
[24]	SCALLAN E , HOEKSTRA R M , ANGULO F J , et al . Foodborne illness acquired in the United States-major pathogens[J]. Emerging Infectious Diseases, 2011,17(1): 1339-40.
[25]	ALVANAKI F , SEBASTIAN M , RAMAMRITHAM K , et al . EnBlogue:emergent topic detection in web 2.0 streams[C]// The 2011 ACM SIGMOD International Conference on Management of Data, June 12-16, 2011, Athens, Greece. New York: ACM Press, 2011: 1271-1274.
[26]	PAL A , COUNTS S . Identifying topical authorities in microblogs[C]// The 4th ACM International Conference on Web Search and Data Mining, February 9-12, 2011, Hong Kong, China. New York: ACM Press, 2011: 45-54.
[27]	CHEW C , EYSENBACH G . Pandemics in the age of Twitter: content analysis of tweets during the 2009 H1N1 outbreak[J]. PLoS One, 2010,5(11):e14118.
[28]	WENG J , LEE B S . Event detection in Twitter[C]// The 6th International AAAI Conference on Weblogs and Social Media, June 4-7, 2012, Barcelona, Spain. Palo Alto: AAAI Press, 2011: 401-408.
[29]	YANG Y , PIERCE T , CARBONELL J . . A study of retrospective and on-line event detection[C]//The 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, USA. New York:ACM Press, 1998: 28-36.
[30]	HUTWAGNER L C , MALONEY E K , BEAN N H , et al . Using laboratory-based surveillance data for prevention:an algorithm for detecting Salmonella outbreaks[J]. Emerging Infectious Diseases, 1997,3(3): 395.
[31]	STERN L , LIGHTFOOT D . Automated outbreak detection: a quantitative retrospective analysis[J]. Epidemiology and Infection, 1999,122(1): 103-110.
[32]	CHUNARA R , ANDREWS J R , BROWNSTEIN J S . . Social and news media enable estimation of epidemiological patterns early in the 2010 Haitian cholera outbreak[J]. The American Journal of Tropical Medicine and Hygiene, 2012,86(1): 39-45.
[33]	POLGREEN P M , CHEN Y , PENNOCK D M , et al . Using internet searches for influenza surveillance[J]. Clinical Infectious Diseases, 2008,47(11): 1443-1448.
[34]	ARAMAKI E , MASKAWA S , MORITA M . . Twitter catches the flu: detecting influenza epidemics using Twitter[C]//The Conference on Empirical Methods in Natural Language Processing, July 27-31, 2011, Edinburgh, UK. [S.l: s.n.], 2011: 1568-1576.
[35]	BUSANI L , SCAVIA G , LUZZI I , et al . Laboratory surveillance for prevention and control of foodborne zoonoses[J]. Annali Dell’Istituto Superiore Di Sanità, 2005,42(4): 401-404.
[36]	COLLIER N , DOAN S , KAWAZOE A , et al . BioCaster: detecting public health rumors with a web-based text mining system[J]. Bioinformatics, 2008,24(24): 2940-2941.
[37]	MIKOLOV T , SUTSKEVER I , CHEN K , et al . Distributed representations of words and phrases and their compositionality[J]. arXiv Preprint, 2013,arXiv:1310.4546.
[38]	刘知远 . 基于文档主题结构的关键词抽取方法研究[D]. 北京: 清华大学, 2011.
	LIU Z Y . Research on keyword extraction using document topical structure[D]. Beijing: Tsinghua University, 2011.

Metrics

Recommended 0

No Suggested Reading articles found!

方法	总数/条	正确数/条	准确率
TF/IDF	3 000	639	21.3%
TextRank	3 000	960	32.0%

方法	总数/条	正确数/条	准确率
TF/IDF	3 000	676	22.5%
TextRank	3 000	1 021	34.0%

总数/条	正确数/条	准确率
500	332	66.4%
1 000	647	64.7%
1 500	1 009	67.3%
2 000	1 280	64.0%
2 500	1 603	64.1%
3 000	2 005	66.8%

Foodborne diseases event detection based on short text

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 5

References 38

Related Articles 2

Metrics

Recommended 0

[1]	Zhiheng ZHANG, Xingpeng CHEN, Dan HUI. Research on public perception changes of the sudden environmental pollution event based on MicroBlog [J]. Big Data Research, 2016, 2(3): 60-72.
[2]	Xueqi Cheng, Yanyan Lan. Text Content Analysis for Web Big Data [J]. Big Data Research, 2015, 1(3): 62-71.