The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Methods for identifying versioned and plagiarized documents
Abstract
The widespread use of on‐line publishing of text promotes storage of multiple versions of documents and mirroring of documents in multiple locations, and greatly simplifies the task of plagiarizing the work of others. We evaluate two families of methods for searching a collection to find documents that are coderivative, that is, are versions or plagiarisms of each other. The first, the ranking family, uses information retrieval techniques; extending this family, we propose the identity measure, which is specifically designed for identification of coderivative documents. The second, the fingerprinting family, uses hashing to generate a compact document description, which can then be compared to the fingerprints of the documents in the collection. We introduce a new method for evaluating the effectiveness of these techniques, and demonstrate it in practice. Using experiments on two collections, we demonstrate that the identity measure and the best fingerprinting technique are both able to accurately identify coderivative documents. However, for fingerprinting parameters must be carefully chosen, and even so the identity measure is clearly superior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Syntactic clustering of the Web
Broder, A. Z., Glassman, S. C., Manasse, M. S., & Zweig, G. (1997) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(97)00031-7 · Cited by 1,343
Managing gigabytes (2nd ed.): compressing and indexing documents and images
Witten, I. H., Moffat, A., & Bell, T. (1999) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 705
Finding similar files in a large file system
Manber, U. (1994) · USENIX Winter Technical Conference · Cited by 599
How reliable are the results of large-scale information retrieval experiments?
Zobel, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291014 · Cited by 579 · cited 1×
“tems [19]; however, they are not well-suited to this task.”
BackgroundSelf-citationCopy detection mechanisms for digital documents
Brin, S., Davis, J., & García-Molina, H. (1995) · Proceedings of the 1995 ACM SIGMOD international conference on Management of data - SIGMOD '95 · doi:10.1145/223784.223855 · Cited by 479
Exploring the similarity space
Zobel, J., & Moffat, A. (1998) · ACM SIGIR Forum · doi:10.1145/281250.281256 · Cited by 378
Self-citationSelf-indexing inverted files for fast text retrieval
Moffat, A., & Zobel, J. (1996) · ACM Transactions on Information Systems · doi:10.1145/237496.237497 · Cited by 361
Self-citationOverview of the Second Text Retrieval Conference (TREC-2)
Harman, D. (1995) · Information Processing & Management · doi:10.1016/0306-4573(94)00047-7 · Cited by 306
(1995) · Cited by 296
YAP3: improved detection of similarities in computer program and other texts
Wise, M. J. (1996) · Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education · doi:10.1145/236452.236525 · Cited by 294
Cited by
Detecting near-duplicates for web crawling
Manku, G. S., Jain, A., & Das Sarma, A. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242592 · Cited by 617
Efficient similarity joins for near duplicate detection
Xiao, C., Wang, W., Lin, X., & Yu, J. X. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367516 · Cited by 455
Finding near-duplicate web pages: a large-scale evaluation of algorithms
Henzinger, M. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148222 · Cited by 421
Efficient similarity joins for near-duplicate detection
Xiao, C., Wang, W., Lin, X., Yu, J. X., & Wang, G. (2011) · ACM Transactions on Database Systems · doi:10.1145/2000824.2000825 · Cited by 331
Detecting Phishing Web Pages with Visual Similarity Assessment Based on Earth Mover's Distance (EMD)
Fu, A. Y., Wenyin, L., & Deng, X. (2006) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2006.50 · Cited by 294
Cross-language plagiarism detection
Potthast, M., Barrón-Cedeño, A., Stein, B., & Rosso, P. (2011) · Language Resources and Evaluation · doi:10.1007/s10579-009-9114-z · Cited by 286
“All of the different kinds of plagiarism shown in Fig. 1 are addressed in the literature: the detection of exact copies (Brin et al. 1995; Hoad and Zobel 2003 ), the detection of modified copies (Stein 2005, 2007), and, for both of the former, their detection without reference collections (Meyer zu Eissen and Stein 20…”
BackgroundMining query logs: turning search usage data into knowledge
Silvestri, F. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000013 · Cited by 194
“Shingles have already been used in the past for clustering text collections, [50] and for detecting duplicate pages [63, 102].”
BackgroundStein, B., Lipka, N., & Prettenhofer, P. (2011) · Language Resources and Evaluation · doi:10.1007/s10579-010-9115-y · Cited by 194
Intrinsic Plagiarism Detection
Eissen, S. M. Z., & Stein, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11735106_66 · Cited by 184
State-of-the-art in detecting academic plagiarism
Meuschke, N., & Gipp, B. (2013) · International Journal for Educational Integrity · doi:10.21913/ijei.v9i1.847 · Cited by 112
“The substring set is the fingerprint; its elements are called minutiae (Hoad & Zobel, 2003).”
BackgroundInfluentialPlagiarism Detection Without Reference Collections
Meyer zu Eissen, S., Stein, B., & Kulig, M. (2007) · Studies in Classification, Data Analysis, and Knowledge Organization · doi:10.1007/978-3-540-70981-7_40 · Cited by 106
Near Similarity Search and Plagiarism Analysis
Stein, B., & zu Eissen, S. M. (2006) · Studies in Classification, Data Analysis, and Knowledge Organization · doi:10.1007/3-540-31314-1_52 · Cited by 62
Biomedical text mining for research rigor and integrity: tasks, challenges, directions
Kilicoglu, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx057 · Cited by 61
Detection of Plagiarism in Arabic Documents
Menai, M. E. B. (2012) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2012.10.10 · Cited by 49
“Fingerprinting [6] is among the most popular techniques in this category.”
BackgroundMethodInfluentialDesktop Tools for Offline Plagiarism Detection in Computer Programs
MOZGOVOY, M. (2006) · Informatics in Education · doi:10.15388/infedu.2006.08 · Cited by 46
“If fingerprint size is constant, the complexity of the work4 is O(N), whereN is the number of documents in the collection (Hoad and Zobel, 2003).”
BackgroundInfluentialPlagiarism: Taxonomy, Tools and Detection Techniques
Chowdhury, H. A., & Bhattacharyya, D. K. (2018) · arXiv · doi:10.48550/arxiv.1801.06323 · Cited by 41
Comparing and combining Content‐ and Citation‐based approaches for plagiarism detection
Pertile, S. D. L., Moreira, V. P., & Rosso, P. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23593 · Cited by 36
A coarse-to-fine framework to efficiently thwart plagiarism
Zhang, H., & Chow, T. W. S. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.08.023 · Cited by 31
APlag: A plagiarism checker for Arabic texts
El Bachir Menai, M., & Bagais, M. (2011) · 2011 6th International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2011.6028888 · Cited by 25
2L-APD: A Two-Level Plagiarism Detection System for Arabic Documents
(2018) · doi:10.2478/cait-2018-0011 · Cited by 24
A Plagiarism Detection System for Arabic Text-Based Documents
Jadalla, A., & Elnagar, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-30428-6_12 · Cited by 22
Metadata
- Authors
- Hoad, T. C., & Zobel, J.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2003-01-16
- Volume
- 54
- Issue
- 3
- Pages
- 203-215
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2164634022
- Cited by
- 330
- References
- 19
- FWCI
- 38.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.