CoChat

Source-code Similarity Detection and Detection Tools Used in Academia: A Systematic Review

Novak, Matija, Joy, Mike, Kermek, Dragutin · 2019 · ACM Transactions on Computing Education

The DOI matches its Crossref record; 174 of the 178 references it cites were found in a registry or an index.

Abstract

Teachers deal with plagiarism on a regular basis, so they try to prevent and detect plagiarism, a task that is complicated by the large size of some classes. Students who cheat often try to hide their plagiarism (obfuscate), and many different similarity detection engines (often called plagiarism detection tools) have been built to help teachers. This article focuses only on plagiarism detection and presents a detailed systematic review of the field of source-code plagiarism detection in academia. This review gives an overview of definitions of plagiarism, plagiarism detection tools, comparison metrics, obfuscation methods, datasets used for comparison, and algorithm types. Perspectives on the meaning of source-code plagiarism detection in academia are presented, together with categorisations of the available detection tools and analyses of their effectiveness. While writing the review, some interesting insights have been found about metrics and datasets for quantitative tool comparison and categorisation of detection algorithms. Also, existing obfuscation methods classifications have been expanded together with a new definition of “source-code plagiarism detection in academia.”

Overview

Integrity signals

Registry

Crossref · 10.1145/3313290

Cites

174 of 174 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 174 references

Research works printed but not linked: 16

  1. F. W. Blackwell . 1980. Computer assistance in detecting plagiarsim in student programs . California Education Computer Consortium , 28--30. F. W. Blackwell. 1980. Computer assistance in detecting plagiarsim in student programs. California Education Computer Consortium, 28--30.
  2. K. W. Bowyer and L. O. Hall . 1999. Experience using “MOSS” to detect cheating on programming assignments . In Proceedings of the 29th Annual Frontiers in Education Conference: Designing the Future of Science and Engineering Education , Vol. 3 . Stripes Publishing L.L.C, San Juan, Puerto Rico, USA, 13B3/18--13B3/22. K. W. Bowyer and L. O. Hall. 1999. Experience using “MOSS” to detect cheating on programming assignments. In Proceedings of the 29th Annual Frontiers in Education Conference: Designing the Future of Science and Engineering Education, Vol. 3. Stripes Publishing L.L.C, San Juan, Puerto Rico, USA, 13B3/18--13B3/22.
  3. 10.5555/1228662.1228664 · doi:10.5555/1228662.1228664
  4. Fintan Culwin , Anna Macleod , and Thomas Lancaster . 2001 . Source code plagiarism in UK HE computing schools . In Proceedings of the 2nd Annual LTSN-ICS Conference. LTSN Centre for Information and Computer Sciences , London, United Kingdom. Fintan Culwin, Anna Macleod, and Thomas Lancaster. 2001. Source code plagiarism in UK HE computing schools. In Proceedings of the 2nd Annual LTSN-ICS Conference. LTSN Centre for Information and Computer Sciences, London, United Kingdom.
  5. M. C. Johnson , C. Watson , S. Davidson , and D. Eschbach . 2004. Gene sequence inspired design plagiarism screening . In Proceedings of the Annual Conference and Exposition: Engineering Researchs New Heights. 6087--6105 . M. C. Johnson, C. Watson, S. Davidson, and D. Eschbach. 2004. Gene sequence inspired design plagiarism screening. In Proceedings of the Annual Conference and Exposition: Engineering Researchs New Heights. 6087--6105.
  6. B. Karthikeyan , V. Vaithiyanathan , and C. V. Lavanya . 2011 . Similarity detection in source code using data mining techniques . Eur. J. Sci. Res. 62 , 4 (2011), 500 -- 505 . B. Karthikeyan, V. Vaithiyanathan, and C. V. Lavanya. 2011. Similarity detection in source code using data mining techniques. Eur. J. Sci. Res. 62, 4 (2011), 500--505.
  7. T. Lancaster and M. Tetlow . 2005. Does automated anti-plagiarism have to be complex? Evaluating more appropriate software metrics for finding collusion . In Proceedings of the 22nd Annual Conference of the Australian Society for Computers in Tertiary Education. 361--370 . T. Lancaster and M. Tetlow. 2005. Does automated anti-plagiarism have to be complex? Evaluating more appropriate software metrics for finding collusion. In Proceedings of the 22nd Annual Conference of the Australian Society for Computers in Tertiary Education. 361--370.
  8. V. Mateljan , V. Juričić , and K. Peter . 2011. Analysis of programming code similarity by using intermediate language . In Proceedings of the 34th International Convention on Information and Communication Technology, Electronics and Microelectronics. 1235--1240 . V. Mateljan, V. Juričić, and K. Peter. 2011. Analysis of programming code similarity by using intermediate language. In Proceedings of the 34th International Convention on Information and Communication Technology, Electronics and Microelectronics. 1235--1240.
  9. A. Ohno and H. Murao . 2011 . A two-step in-class source code plagiarism detection method utilizing improved CM algorithm and SIM . Int. J. Innov. Comput. Inf. Contr. 7 , 8 (2011), 4729 -- 4739 . A. Ohno and H. Murao. 2011. A two-step in-class source code plagiarism detection method utilizing improved CM algorithm and SIM. Int. J. Innov. Comput. Inf. Contr. 7, 8 (2011), 4729--4739.
  10. G. K. Rambally and M. Lesage . 1990. An inductive inference approach to plagiarsim detection in computer-programs . In Proceedings of the National Educational Computing Conference (INTSOC’90) , 23--29. G. K. Rambally and M. Lesage. 1990. An inductive inference approach to plagiarsim detection in computer-programs. In Proceedings of the National Educational Computing Conference (INTSOC’90), 23--29.
  11. J. C. Rodriguez , E. Rubio Royo , and Z. Hernandez . 2011. USES OF VPL . In Proceedings of the 5th International Technology, Education and Development Conference. IATED-INT, 743--748 . J. C. Rodriguez, E. Rubio Royo, and Z. Hernandez. 2011. USES OF VPL. In Proceedings of the 5th International Technology, Education and Development Conference. IATED-INT, 743--748.
  12. A. Semerdzhiev and T. Trifonov . 2013. Practical aspects of plagiarsim detection in coputer science e-learning . In Proceedings of the 6th International Conference of Education, Research and Inovation. IATED-INT, 3953--3961 . A. Semerdzhiev and T. Trifonov. 2013. Practical aspects of plagiarsim detection in coputer science e-learning. In Proceedings of the 6th International Conference of Education, Research and Inovation. IATED-INT, 3953--3961.
  13. I. Smeureanu and B. Iancu . 2013. Source code plagiarsim detection method using ontologies . In Proceedings of the International Conference on Informatics in Economy. 594--597 . I. Smeureanu and B. Iancu. 2013. Source code plagiarsim detection method using ontologies. In Proceedings of the International Conference on Informatics in Economy. 594--597.
  14. N. D. Tselikas , M. Samarakou , D. Karolidis , P. Prentakis , and S. Athineos . 2014. Automatic plagiarism detection in programming laboratory courses . In Proceedings of the 7th IADIS International Conference Information Systems. IADIS, 232--238 . N. D. Tselikas, M. Samarakou, D. Karolidis, P. Prentakis, and S. Athineos. 2014. Automatic plagiarism detection in programming laboratory courses. In Proceedings of the 7th IADIS International Conference Information Systems. IADIS, 232--238.
  15. A. Wojdyga . 2013 . Towards intellectual property theft prevention: Economic significance of automatic software plagiarism verification . Act. Probl. Econ. 142 , 4 (2013), 300 -- 306 . A. Wojdyga. 2013. Towards intellectual property theft prevention: Economic significance of automatic software plagiarism verification. Act. Probl. Econ. 142, 4 (2013), 300--306.
  16. L. Zhang , Y. T. Zhuang , and Z. M. Yuan . 2007. A program plagiarism detection model based on information distance and clustering . In Proceedings of the 2007 International Conference on Intelligent Pervasive Computing. IEEE, 431--436 . L. Zhang, Y. T. Zhuang, and Z. M. Yuan. 2007. A program plagiarism detection model based on information distance and clustering. In Proceedings of the 2007 International Conference on Intelligent Pervasive Computing. IEEE, 431--436.

Cited by

Metadata

Authors
Novak, M., Joy, M., & Kermek, D.
Affiliations
  • University of Zagreb (HR)
  • University of Warwick (GB)
Venue
ACM Transactions on Computing Education
Published
2019-05-21
Volume
19
Issue
3
Pages
1-37
ISSN
1946-6226 (ISSN-L)
OpenAlex
W2945111072
Cited by
117
References
178
Citations by year
2026: 11 · 2025: 14 · 2024: 19 · 2023: 21 · 2022: 19 · 2021: 19 · 2020: 10 · 2019: 4
FWCI
22.73
Type
journal article
Language
en
Open access
closed
Locations
  • ACM Transactions on Computing Education (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (submittedVersion)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
Keywords
code plagiarism detection, academic dishonesty, plagiarism detection software, code obfuscation, similarity measures, programming education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.