基于斜率密度聚类的相似文本标定

doi:10.3969/j.issn.1000-436x.2013.Z2.030

Abstract

Abstract:

Similar text positioning is an important part of plagiarism detection.The existing positioning method directly merges text or fingerprint to obtain similar text.Due to the disturb information in the similar text,the positioning accuracy is poor.The semantic features of the match fingerprints were analyzed,and a cluster method based on slope density for similar text positioning was proposed,which converts the text merge problem into dense sample points clustering problem,and improves the efficiency and accuracy of the positioning.Through the experiment on the PAN public corpus,the result shows it performs better than the PAN10 top three.This method has been used in the South China University of Technology 's feature professional teaching platform to detect the plagiarism of homework.

Key words: plagiarism detection, similar text positioning, cluster, fingerprint

Du ZOU,Wen-jun TANG,Wei-jiang LONG,Ling ZHANG. Similar text positioning method based on slope-density cluster[J]. Journal on Communications, 2013, 34(Z2): 157-162.

Figures/Tables 4

References 10

[11]	KASPRZAK J , BRANDEJS M , KRIPAC M . Finding plagiarism by evaluating document similarities[A]. 3rd PAN Workshop Uncovering Plagiarism,Authorship and Social Software Misuse[C]. 2009. 32-36.
[12]	ZOU D , LONG WJ , ZHANG L . A two-phase plagiarism detection method[A]. 2011 International Conference on Internet Technology and Applications[C]. Wuhan,China, 2011. 1-4.
[13]	POTTHAST M . Overview of the 1st International Competition on Plagiarism Detection[A]. 3rd PAN Workshop Uncovering Plagiarism,Authorship and Social Software Misuse[C]. 2009. 1-9.
[1]	MANBER U . Finding similar files in a large file system[A]. Proceedings of the Winter USENIX Conference[C]. San Francisco,CA, 1994. 1-10.
[2]	BRIN S , DAVIS J,GARCIA-MOLINA H . Copy detection mechanisms for digital documents[A]. Proceedings of the ACM SIGMOD Conference on Management of Data[C]. ACM,NY,USA, 1995. 126-141.
[3]	BRODER A Z . On the resemblance and containment of documents[A]. Proceedings of Compression and Complexity of Sequences 1997[C]. Salemo,Italy, 1997. 21-29.
[4]	BRODER A Z . Identifying and filtering near-duplicate documents[A]. Proceedings of Combinatorial Pattern Matching[C]. Springer Berlin Heidelberg,Germany, 2000. 1-10.
[5]	STEIN B , POTTHAST M . Applying Hash-based indexing in text-based information retrieval[A]. Proceedings of The 7th DutchBelgian Information Retrieval Workshop (DIR 07)[C]. Leuven,Belgium, 2007. 29-35.
[6]	CHARIKAR M S . Similarity estimation techniques from rounding algorithms[A]. Proceedings of The Thiry-Fourth Annual ACM Symposium on Theory of Computing[C]. ACM,NY,USA, 2002. 380-388.
[7]	SHIVAKUMAR N GARCIA-MOLINA H . Building a scalable and accurate copy detection mechanism[A]. Proceedings of The First ACM International Conference on Digital Libraries[C]. ACM,NY,USA, 1996. 160-168.
[8]	SCHLEIMER S , WILKERSON D S , AIKEN A . Winnowing:local algorithms for document fingerprinting[A]. Proceedings of The 2003 ACM SIGMOD International Conference on Management of Data[C]. ACM,New York, 2003. 76-85.
[9]	SEDIYONO A , MAHAMUD K R K . Algorithm of the Longest Commonly Consecutive Word for Plagiarism Detection in Text Based Document[A]. Proceedings of The Third International Conference on Digital Information Management[C]. London,UK, 2008. 253-259.
[10]	ZASLAVSKY A , BIA A , MONOSTORI K . Using copy-detection and text comparison algorithms for cross-referencing multiple editions of literary works[A]. Research and Advanced Technology for Digital Libraries[C]. Springer Berlin Heidelberg,Germany, 2001. 103-114.

Metrics

Recommended 0

No Suggested Reading articles found!

[1]	Ling MA, Qiliang FAN, Ting XU, Guanchen GUO, Shenglin ZHANG, Yongqian SUN, Yuzhi ZHANG. Scheduling framework based on reinforcement learning in online-offline colocated cloud environment [J]. Journal on Communications, 2023, 44(6): 90-102.
[2]	Shengxing YU, Zekai CHEN, Zhong CHEN, Ximeng LIU. DAGUARD: distributed backdoor attack defense scheme under federated learning [J]. Journal on Communications, 2023, 44(5): 110-122.
[3]	Yu DONG, Youpeng ZHANG. Conflict evidence combination method based on clustering weighting [J]. Journal on Communications, 2023, 44(3): 157-163.
[4]	Chengsheng YUAN, Qiang GUO, Zhangjie FU. Copyright protection algorithm based on differential privacy deep fake fingerprint detection model [J]. Journal on Communications, 2022, 43(9): 181-193.
[5]	Jing ZHAO, Jun LI, Chun LONG, Wei WAN, Jinxia WEI, Kai CHEN. Unsupervised detection method of RoQ covert attacks based on multilayer features [J]. Journal on Communications, 2022, 43(9): 224-239.
[6]	Feng ZHOU, Baosheng ZHANG, Wenbo ZHANG. Space-time division cluster DoA estimation algorithm based on UWA spread spectrum signal [J]. Journal on Communications, 2022, 43(8): 100-108.
[7]	Ao LI, Cong FENG, Yutong NIU, Shibiao XU, Yingtao ZHANG, Guanglu SUN. Multiview clustering method for view-unaligned data [J]. Journal on Communications, 2022, 43(7): 143-152.
[8]	Rong QIAN, Jianting XU, Kejun ZHANG, Hongyu DONG, Fangyuan XING. Research on HMM based link prediction method in heterogeneous network [J]. Journal on Communications, 2022, 43(5): 214-225.
[9]	Zenghua ZHAO, Yuefan TONG, Jiayang CUI. Device-independent Wi-Fi fingerprinting indoor localization model based on domain adaptation [J]. Journal on Communications, 2022, 43(4): 143-153.
[10]	Yimin MAO, Dejin GAN, Liefa LIAO, Zhigang CHEN. Parallel division clustering algorithm based on Spark framework and ASPSO [J]. Journal on Communications, 2022, 43(3): 148-163.
[11]	Zhongping ZHANG, Sen LI, Weixiong LIU, Shuxia LIU. Outlier detection algorithm based on fast density peak clustering outlier factor [J]. Journal on Communications, 2022, 43(10): 186-195.
[12]	Huiqin WANG, Wenbin HOU, Qingbin PENG, Minghua CAO, Rui HUANG, Ling LIU. Step-by-step classification detection algorithm of SPPM based on K-means clustering [J]. Journal on Communications, 2022, 43(1): 161-171.
[13]	Qiang HU, Jiaji SHEN, Guanghui JING, Junwei DU. Service clustering method based on description context feature words and improved GSDMM model [J]. Journal on Communications, 2021, 42(8): 176-187.
[14]	Chunfu JIA, Ruiqi LI, Yafei WANG. Privacy protection scheme of DBSCAN clustering based on homomorphic encryption [J]. Journal on Communications, 2021, 42(2): 1-11.
[15]	Liu LIU, Jianhua ZHANG, Yuanyuan FAN, Li YU, Jiachi ZHANG. Survey of application of machine learning in wireless channel modeling [J]. Journal on Communications, 2021, 42(2): 134-153.

Similar text positioning method based on slope-density cluster

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 4

References 10

Related Articles 15

Metrics

Recommended 0