云计算环境下一种面向科学工作流不确定数据源的视图构造方法

doi:10.3969/j.issn.1000-0801.2013.03.017

Abstract

Abstract:

The view of data provenance in scientific workf1ow provides an approach of data abstraction and encapsu1ation by partitioning tasks in the data provenance graph（DPG）into a set of composite modu1es due to the data f1ow re1ations among them, so as to efficient1y decrease the work1oad consumed by researchers making ana1ysis on the data provenance and the time needed in doing data querying.Neverthe1ess, deve1oping and app1ying the scientific workf1ow systems in c1oud computing environments suffers the prob1em of uncertainty brought by the inaccuracy of data co11ection and unre1iabi1ity of data servers distributed in the internet.Concentrating on this scenario, the definitions of uncertain DPG and its sound view were presented first1y, and then a method for detecting the unsound view of DPG was proposed.A1so, a method for constructing sound and high-support view was presented, which is based on the data f1ow re1ations among the tasks and their first-order preceding tasks in the graph, and the 1oca1 expected support of the composite modu1es.A po1ynomia1-time a1gorithm was designed, and its maxima1 time comp1exity was a1so ana1yzed.Additiona11y, an examp1e and conduct comprehensive experiments were given to show the feasibi1ity and effectiveness of the method.

Key words: c1oud computing, scientific workf1ow, data provenance, view

Haiyang Hu,Zhanchen Liu,Hua Hu. Constructing View of Uncertain Data Provenance for Scientific Workflow in Cloud Computing[J]. Telecommunications Science, 2013, 29(3): 90-100.

Figures/Tables 7

References 24

1	IBM Blue Cloud Solution.
2	Sun Cloud Architecture Introduction White Paper.
3	Barroso LA , Dean J , Holzle U . Web search for a planet：the Google cluster architecture. IEEE Micro, 2003， 23(2): 22～28
4	International Telegraph Union（ITU）.
5	Organization for the Advancement of Structured Information Standards（OASIS）.
6	冯登国，张敏，张妍等. 云计算安全研究. 软件学报， 2011， 22(1): 71～83
7	郑湃，崔立真，王海洋等. 云计算环境下面向数据密集型应用的数据布局策略与方法. 计算机学报， 2010， 33(8): 1472～1480
8	Oinn T , Addis M , Ferris J , et al. Taverna:a tool for the composition and enactment of bioinformatics workf1ows. Bioinformatics, 2004, 20>(17): 3045～3054.
9	A1tintas I , Berkley C , Jaeger E , et al. Kepler：an extensible system for design and execution of scientific workflows. Proceedings of the 16th International Conference on Scientific and Statistical Database Management, Santorini Island，Greece 2004: 423～424.
10	Biton O , Boulakia S C , Davidson S B , et al. Querying and managing provenance through user views in scientific workflows. Proceedings of the 24th International Conference on Data Engineering, Cancun, Mexico 2008: 1072～1081.
11	Biton O , Davidson S B , Khanna S , et al. Optimizing user views for workflows. Proceedings of the 12th International Conference on Database Theory, St, Petersburg, Russia 2009: 310～323.
12	Cohen S , Boulakia S C , Davidson S B . Towards a model of provenance and user views in scientific workf1ows, Proceedings of Lecture Notes in Computer Science Data Integration in the Life Sciences, Hinxton, UK 2006: 264～279.
13	Shao Q , Chen Y , Tao S , et al. Easy Ticket:a ticket routing recommendation engine for enterprise problem resolution. Proceedings of the VLDB Endowment, Auckland 2008: 1436～1439.
14	Shao Q , Chen Y , Tao S , et al. Efficient ticket routing by resolution sequence mining. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas 2008: 605～613.
15	Shao Q , Sun P , Chen Y . Efficiently discovering critical workflows in scientific exp.lorations. Future Generation Computer System, 2009,25(5): 577～585.
16	Sun P , Liu Z Y , Susan D , et al. Detecting and resolving unsound workflow views for correct provenance analysis. Proceedings of the ACM SIGMOD International Conference on Management of Data, Rhode Island 2009: 549～562.
17	邹兆年，李建中，高宏等. 从不确定图中挖掘频繁子图模式. 软件学报， 2009， 20(11)： 2965～2976.
18	Chui C K , Kao B , Hung E . Mining frequent itemsets from uncertain data. Proceedings of the 11th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, Nanjing 2007: 47～58.
19	Zhou S G , Yu Z C , Jiang H L . Concepts, issues, and advances of searching in graph structured data. Communication, 2007,3(8): 59～65.
20	Shasha D , Wang T L , Guigno R . Algorithmic and applications of tee and graph searching. Proceedings of the 21st ACM SIGMOD-SIGART Symposium on Principles of Database Systems, Madison 2002: 39～52.
21	Yan X , Yu P S , Han J . Graph indexing:a frequent structure based approach. Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, Paris 2001: 335～346.
22	Hintsanen P , Toivonen H . Finding reliab1e subgraphs from large probabilistic graphs. Data Mining and Knowledge Discovery, 2008,17(1): 3～23.
23	Cheng J , Yu J , Lin X . Fast computing reachability labelings for large graphs with high compression rate. Proceedings of 11th International Conference on Extending Database Technology, Nantes 2008: 193～204.
24	Jin R , Hong H , Wang HX , et al. Computinglabel-constraint reachability in graph databases. Proceedings of the ACM SIGMOD International Conference on Management of Data, Indianapolis，Indiana 2010: 123～134.

Metrics

Recommended 0

No Suggested Reading articles found!

[1]	Feng LIN,Liujing XU,Xiaohua CHEN,Weiqiang QI,Ke CHEN,Tiantian ZHU. Method of Webshell detection based on multi-view feature fusion [J]. Telecommunications Science, 2020, 36(6): 125-132.
[2]	Yuanying XIAO,Yaodong YOU,Lixi XIANG. Causes and optimization of the false alarm rate of code review system [J]. Telecommunications Science, 2020, 36(12): 155-162.
[3]	Shuainan CUI,Zongju PENG,Wenhui ZOU,Fen CHEN,Hua CHEN. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion [J]. Telecommunications Science, 2019, 35(5): 104-112.
[4]	Changhao ZHANG,Zhiyong YU,Zhen ZHOU,Ruijie SHI,Xinyong WANG. User image construction framework based on big data fusion background for power grid business travel [J]. Telecommunications Science, 2019, 35(12): 148-154.
[5]	Yiqing ZHOU,Guojie LI. Convergence of communication and computing in future mobile communication systems [J]. Telecommunications Science, 2018, 34(3): 1-7.
[6]	Shipei WANG,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU. A quality assessment metric for stereoscopic image in free viewpoint video system [J]. Telecommunications Science, 2018, 34(3): 76-85.
[7]	Zhenjiang DONG,Dongzhuo ZHANG,Cheng HUANG,Haijun LIU. Technology of virtual reality video processing and streaming [J]. Telecommunications Science, 2017, 33(8): 45-52.
[8]	Hongyao JU. Service security monitoring mechanism for application server cluster [J]. Telecommunications Science, 2016, 32(6): 177-185.
[9]	Zisen ZHAO. Review of the development of China's optical fiber communication [J]. Telecommunications Science, 2016, 32(5): 5-9.
[10]	Qingyan Dai,Zhongjie Zhu. Stereo Image Segmentation Based on Graph Cut and Visual Correlation [J]. Telecommunications Science, 2015, 31(11): 77-84.
[11]	Tao Li,Hua Hu,Haiyang Hu. Random Dissemination Algorithm of Stete-Updating Message for Distributed Virtual Environments of P2P Architecture [J]. Telecommunications Science, 2014, 30(10): 78-88.
[12]	Yunhai Chen,Lanqiu Huang. Study on the Impact of Big Data Processing in Electronic Commerce [J]. Telecommunications Science, 2013, 29(3): 17-21.
[13]	Caixia Tao,Xiaojun Xie,Kang Chen,Lirong, Guo,Chun Liu. Design of Mobile Internet Big Data User Behavior Analysis Engine Based on Cloud Computing [J]. Telecommunications Science, 2013, 29(3): 27-31.
[14]	Bingyi Fang,Yunyong Zhang,Jun Wu,Lei Xu. Analysis on Mobile Internet Application Security Issues Based on the Cloud Computing Mode [J]. Telecommunications Science, 2013, 29(3): 41-47.
[15]	Dongmei Li,Shijun Yin,Jianyong Chen. Study on Differentiated Security Service Based on Cloud Computing [J]. Telecommunications Science, 2013, 29(3): 62-65.

Constructing View of Uncertain Data Provenance for Scientific Workflow in Cloud Computing

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 24

Related Articles 15

Metrics

Recommended 0