Source-code Similarity Detection and Detection Tools Used in Academia: A Systematic Review
The DOI matches its Crossref record; 174 of the 178 references it cites were found in a registry or an index.
Abstract
Teachers deal with plagiarism on a regular basis, so they try to prevent and detect plagiarism, a task that is complicated by the large size of some classes. Students who cheat often try to hide their plagiarism (obfuscate), and many different similarity detection engines (often called plagiarism detection tools) have been built to help teachers. This article focuses only on plagiarism detection and presents a detailed systematic review of the field of source-code plagiarism detection in academia. This review gives an overview of definitions of plagiarism, plagiarism detection tools, comparison metrics, obfuscation methods, datasets used for comparison, and algorithm types. Perspectives on the meaning of source-code plagiarism detection in academia are presented, together with categorisations of the available detection tools and analyses of their effectiveness. While writing the review, some interesting insights have been found about metrics and datasets for quantitative tool comparison and categorisation of detection algorithms. Also, existing obfuscation methods classifications have been expanded together with a new definition of “source-code plagiarism detection in academia.”
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Hence, this has resulted in different interpretations of what is considered an indication of plagiarism for use in SCPDT evaluations, and how to evaluate SCPDTs in general [9].”
From Academic Source Code Plagiarism Detection by Measuring Program Behavioral Similarity (2021) · cites this paper as [9]
In the citing paper
“Furthermore, all known available SCPDTs implement structural measures of similarity only.”
From Academic Source Code Plagiarism Detection by Measuring Program Behavioral Similarity (2021) · cites this paper as [9]
In the citing paper
“The lack of similar approaches to SCPD is supported by the recent literature reviews [8], [9] that identify various structural and/or semantic SCPDTs, however, fail to identify any behavioural SCPDTs.”
From Academic Source Code Plagiarism Detection by Measuring Program Behavioral Similarity (2021) · cites this paper as [9]
In the citing paper
“All known proposed SCPDTs implement structural or semantic measures of similarity.”
From Academic Source Code Plagiarism Detection by Measuring Program Behavioral Similarity (2021) · cites this paper as [9]
In the citing paper
“We chose JPlag as it is state-of-the-art [32], open-source, and was used for the evaluation of Mossad [13].”
From Detecting Automatic Software Plagiarism via Token Sequence Normalization (2024) · cites this paper as [32]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Halstead, M. H. (1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,639
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394 · cited 1×
“(software engineering) [18], Spolaor and Benitti (learning theories) [159], and Breivold et al.”
MethodSchleimer, S., S, W. D., & Aiken, A. (2003) · Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data · doi:10.1145/872757.872770 · Cited by 1,099 · cited 2×
“The best example is the paper about the Winnowing algorithm [148], is one of the most referenced papers, but the paper was not picked up by the queries.”
BackgroundMethodPlagiarism in programming assignments
Joy, M., & Luck, M. (1999) · IEEE Transactions on Education · doi:10.1109/13.762946 · Cited by 299
Self-citationYAP3: improved detection of similarities in computer program and other texts
Wise, M. J. (1996) · Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education · doi:10.1145/236452.236525 · Cited by 294
Shared Information and Program Plagiarism Detection
Chen, X., Francia, B., Li, M., McKinnon, B., & Seker, A. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.830793 · Cited by 251
Computer algorithms for plagiarism detection
Parker, A., & Hamblen, J. O. (1989) · IEEE Transactions on Education · doi:10.1109/13.28038 · Cited by 216 · cited 8×
“Routine transformations, typically text substitutions, do not require a detailed understanding of the program” [131].”
BackgroundMethodInfluentialAn algorithmic approach to the detection and prevention of plagiarism
Ottenstein, K. J. (1976) · ACM SIGCSE Bulletin · doi:10.1145/382222.382462 · Cited by 208 · cited 2×
“Research into source-code plagiarism detection had already been performed in the 1970s, for example, a paper [130] from Ottenstein was published in 1976, but some mechanisms that he used to detect plagiarism had already been presented a few years earlier.”
BackgroundFaidhi, J. A. W., & Robinson, S. K. (1987) · Computers & Education · doi:10.1016/0360-1315(87)90042-x · Cited by 198 · cited 10×
“Another common classification are the six levels (plus level zero, which means no changes) from Faidhi and Robinson [42].”
BackgroundMethodInfluentialAn Approach to Source-Code Plagiarism Detection and Investigation Using Latent Semantic Analysis
Cosma, G., & Joy, M. (2012) · IEEE Transactions on Computers · doi:10.1109/tc.2011.223 · Cited by 176
Self-citation
Research works printed but not linked: 16
- F. W. Blackwell . 1980. Computer assistance in detecting plagiarsim in student programs . California Education Computer Consortium , 28--30. F. W. Blackwell. 1980. Computer assistance in detecting plagiarsim in student programs. California Education Computer Consortium, 28--30.
- K. W. Bowyer and L. O. Hall . 1999. Experience using “MOSS” to detect cheating on programming assignments . In Proceedings of the 29th Annual Frontiers in Education Conference: Designing the Future of Science and Engineering Education , Vol. 3 . Stripes Publishing L.L.C, San Juan, Puerto Rico, USA, 13B3/18--13B3/22. K. W. Bowyer and L. O. Hall. 1999. Experience using “MOSS” to detect cheating on programming assignments. In Proceedings of the 29th Annual Frontiers in Education Conference: Designing the Future of Science and Engineering Education, Vol. 3. Stripes Publishing L.L.C, San Juan, Puerto Rico, USA, 13B3/18--13B3/22.
- 10.5555/1228662.1228664 · doi:10.5555/1228662.1228664
- Fintan Culwin , Anna Macleod , and Thomas Lancaster . 2001 . Source code plagiarism in UK HE computing schools . In Proceedings of the 2nd Annual LTSN-ICS Conference. LTSN Centre for Information and Computer Sciences , London, United Kingdom. Fintan Culwin, Anna Macleod, and Thomas Lancaster. 2001. Source code plagiarism in UK HE computing schools. In Proceedings of the 2nd Annual LTSN-ICS Conference. LTSN Centre for Information and Computer Sciences, London, United Kingdom.
- M. C. Johnson , C. Watson , S. Davidson , and D. Eschbach . 2004. Gene sequence inspired design plagiarism screening . In Proceedings of the Annual Conference and Exposition: Engineering Researchs New Heights. 6087--6105 . M. C. Johnson, C. Watson, S. Davidson, and D. Eschbach. 2004. Gene sequence inspired design plagiarism screening. In Proceedings of the Annual Conference and Exposition: Engineering Researchs New Heights. 6087--6105.
- B. Karthikeyan , V. Vaithiyanathan , and C. V. Lavanya . 2011 . Similarity detection in source code using data mining techniques . Eur. J. Sci. Res. 62 , 4 (2011), 500 -- 505 . B. Karthikeyan, V. Vaithiyanathan, and C. V. Lavanya. 2011. Similarity detection in source code using data mining techniques. Eur. J. Sci. Res. 62, 4 (2011), 500--505.
- T. Lancaster and M. Tetlow . 2005. Does automated anti-plagiarism have to be complex? Evaluating more appropriate software metrics for finding collusion . In Proceedings of the 22nd Annual Conference of the Australian Society for Computers in Tertiary Education. 361--370 . T. Lancaster and M. Tetlow. 2005. Does automated anti-plagiarism have to be complex? Evaluating more appropriate software metrics for finding collusion. In Proceedings of the 22nd Annual Conference of the Australian Society for Computers in Tertiary Education. 361--370.
- V. Mateljan , V. Juričić , and K. Peter . 2011. Analysis of programming code similarity by using intermediate language . In Proceedings of the 34th International Convention on Information and Communication Technology, Electronics and Microelectronics. 1235--1240 . V. Mateljan, V. Juričić, and K. Peter. 2011. Analysis of programming code similarity by using intermediate language. In Proceedings of the 34th International Convention on Information and Communication Technology, Electronics and Microelectronics. 1235--1240.
- A. Ohno and H. Murao . 2011 . A two-step in-class source code plagiarism detection method utilizing improved CM algorithm and SIM . Int. J. Innov. Comput. Inf. Contr. 7 , 8 (2011), 4729 -- 4739 . A. Ohno and H. Murao. 2011. A two-step in-class source code plagiarism detection method utilizing improved CM algorithm and SIM. Int. J. Innov. Comput. Inf. Contr. 7, 8 (2011), 4729--4739.
- G. K. Rambally and M. Lesage . 1990. An inductive inference approach to plagiarsim detection in computer-programs . In Proceedings of the National Educational Computing Conference (INTSOC’90) , 23--29. G. K. Rambally and M. Lesage. 1990. An inductive inference approach to plagiarsim detection in computer-programs. In Proceedings of the National Educational Computing Conference (INTSOC’90), 23--29.
- J. C. Rodriguez , E. Rubio Royo , and Z. Hernandez . 2011. USES OF VPL . In Proceedings of the 5th International Technology, Education and Development Conference. IATED-INT, 743--748 . J. C. Rodriguez, E. Rubio Royo, and Z. Hernandez. 2011. USES OF VPL. In Proceedings of the 5th International Technology, Education and Development Conference. IATED-INT, 743--748.
- A. Semerdzhiev and T. Trifonov . 2013. Practical aspects of plagiarsim detection in coputer science e-learning . In Proceedings of the 6th International Conference of Education, Research and Inovation. IATED-INT, 3953--3961 . A. Semerdzhiev and T. Trifonov. 2013. Practical aspects of plagiarsim detection in coputer science e-learning. In Proceedings of the 6th International Conference of Education, Research and Inovation. IATED-INT, 3953--3961.
- I. Smeureanu and B. Iancu . 2013. Source code plagiarsim detection method using ontologies . In Proceedings of the International Conference on Informatics in Economy. 594--597 . I. Smeureanu and B. Iancu. 2013. Source code plagiarsim detection method using ontologies. In Proceedings of the International Conference on Informatics in Economy. 594--597.
- N. D. Tselikas , M. Samarakou , D. Karolidis , P. Prentakis , and S. Athineos . 2014. Automatic plagiarism detection in programming laboratory courses . In Proceedings of the 7th IADIS International Conference Information Systems. IADIS, 232--238 . N. D. Tselikas, M. Samarakou, D. Karolidis, P. Prentakis, and S. Athineos. 2014. Automatic plagiarism detection in programming laboratory courses. In Proceedings of the 7th IADIS International Conference Information Systems. IADIS, 232--238.
- A. Wojdyga . 2013 . Towards intellectual property theft prevention: Economic significance of automatic software plagiarism verification . Act. Probl. Econ. 142 , 4 (2013), 300 -- 306 . A. Wojdyga. 2013. Towards intellectual property theft prevention: Economic significance of automatic software plagiarism verification. Act. Probl. Econ. 142, 4 (2013), 300--306.
- L. Zhang , Y. T. Zhuang , and Z. M. Yuan . 2007. A program plagiarism detection model based on information distance and clustering . In Proceedings of the 2007 International Conference on Intelligent Pervasive Computing. IEEE, 431--436 . L. Zhang, Y. T. Zhuang, and Z. M. Yuan. 2007. A program plagiarism detection model based on information distance and clustering. In Proceedings of the 2007 International Conference on Intelligent Pervasive Computing. IEEE, 431--436.
Cited by
Exploring DeepSeek: A Survey on Advances, Applications, Challenges and Future Directions
Deng, Z., Ma, W., Han, Q., Zhou, W., Zhu, X., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2025.125498 · Cited by 224
SoK: Decentralized Finance (DeFi) Attacks
Zhou, L., Xiong, X., Ernstberger, J., Chaliasos, S., Wang, Z., Wang, Y., Qin, K., Wattenhofer, R., Song, D., & Gervais, A. (2023) · 2023 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46215.2023.10179435 · Cited by 200
Nasrabadi, M. Z., Parsa, S. A., Ramezani, M., Roy, C. K., & Ekhtiarzadeh, M. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111796 · Cited by 129
Combéfis, S. (2022) · Software · doi:10.3390/software1010002 · Cited by 96
A Systematic Mapping Study of Code Quality in Education
Keuning, H., Jeuring, J. T., & Heeren, B. J. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588777 · Cited by 66
Developing and reusing bioinformatics data analysis pipelines using scientific workflow systems
Djaffardjy, M., Marchment, G., Sebe, C., Blanchet, R., Belhajjame, K., Gaignard, A., Lemoine, F., & Cohen‐Boulakia, S. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.03.003 · Cited by 62
Academic Source Code Plagiarism Detection by Measuring Program Behavioral Similarity
Cheers, H., Lin, Y., & Smith, S. P. (2021) · IEEE Access · doi:10.1109/access.2021.3069367 · Cited by 59
“To aid in the detection of source code plagiarism, many Source Code Plagiarism Detection Tools (SCPDTs) [8], [9] have been proposed.”
BackgroundResultInfluentialDolos: Language‐agnostic plagiarism detection in source code
Maertens, R., Petegem, C. V., Strijbol, N., Baeyens, T., Jacobs, A. C., Dawyndt, P., & Mesuere, B. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12662 · Cited by 57
Measuring Software Obfuscation Quality–A Systematic Literature Review
Ebad, S. A., Darem, A. A., & Abawajy, J. (2021) · IEEE Access · doi:10.1109/access.2021.3094517 · Cited by 52
Similarity Detection Techniques for Academic Source Code Plagiarism and Collusion: A Review
Karnalim, O., Simon, & Chivers, W. (2019) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale48000.2019.9225953 · Cited by 49
Importance of the Open Data Assessment: An Insight Into the (Meta) Data Quality Dimensions
Šlibar, B., Oreški, D., & Ređep, N. B. (2021) · SAGE Open · doi:10.1177/21582440211023178 · Cited by 40
Weisz, J. D., Kumar, S. V., Muller, M., Browne, K.-E., Goldberg, A., Heintze, K. E., & Bajpai, S. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3706670 · Cited by 37
Stop Reinventing the Wheel! Promoting Community Software in Computing Education
Blanchard, J. J., Hott, J. R., Berry, V., Carroll, R., Edmison, B., Glassey, R. J., Karnalim, O., Plancher, B., & Russell, S. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3571785.3574129 · Cited by 37
Choosing Code Segments to Exclude from Code Similarity Detection
Simon, Karnalim, O., Sheard, J., Dema, I., Karkare, A., Leinonen, J., Liut, M., & McCauley, R. A. (2020) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3437800.3439201 · Cited by 36
Source Code Plagiarism Detection in Academia with Information Retrieval: Dataset and the Observation
Karnalim, O., Setia, B. U. D. I., Toba, H., & Joy, M. S. (2019) · Informatics in Education · doi:10.15388/infedu.2019.15 · Cited by 35
Self-citationEducating Students about Programming Plagiarism and Collusion via Formative Feedback
Karnalim, O., Simon, Chivers, W., & Panca, B. S. (2022) · ACM Transactions on Computing Education · doi:10.1145/3506717 · Cited by 34
Understanding Trigger-Action Programs Through Novel Visualizations of Program Differences
Zhao, V., Zhang, L., Wang, B., Littman, M. L., Lu, S., & Ur, B. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445567 · Cited by 31
Source Code Clone Detection Using Unsupervised Similarity Measures
Martínez-Gil, J. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-56281-5_2 · Cited by 29
Source Code Plagiarism Detection in an Educational Context: A Literature Mapping
Aniceto, R. C., de Holanda, M. T., Castanho, C. D., & Silva, D. D. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637155 · Cited by 28
Machine Learning Approaches to Code Similarity Measurement: A Systematic Review
Zhang, Z., & Saber, T. (2025) · IEEE Access · doi:10.1109/access.2025.3553392 · Cited by 25
Chen, J., Lin, W. Y., Cai, S., Yin, Y., Chen, H., & Towey, D. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111772 · Cited by 24
Supporting the Detection of Software Supply Chain Attacks through Unsupervised Signature GenerationPreprint
Ohm, M., Kempf, L., Boes, F., & Meier, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02235 · Cited by 24
A Large-Scale Study of Model Integration in ML-Enabled Software Systems
Sens, Y., Knopp, H., Peldszus, S. M., & Berger, T. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00185 · Cited by 23
Constructing More Complete Control Flow Graphs Utilizing Directed Gray-Box Fuzzing
Zhu, K.-L., Lu, Y., Huang, H., Yu, L., & Zhao, J. (2021) · Applied Sciences · doi:10.3390/app11031351 · Cited by 23
Explanation in Code Similarity Investigation
Karnalim, O., & Simon, N. P. (2021) · IEEE Access · doi:10.1109/access.2021.3073703 · Cited by 21
Maintaining Academic Integrity in Programming: Locality-Sensitive Hashing and Recommendations
Karnalim, O. (2023) · Education Sciences · doi:10.3390/educsci13010054 · Cited by 20
Review of Code Similarity and Plagiarism Detection Research Studies
Lee, G., Kim, J., Choi, M.-S., Jang, R.-Y., & Lee, R. (2023) · Applied Sciences · doi:10.3390/app132011358 · Cited by 20
Assessment Automation of Complex Student Programming Assignments
Novak, M., & Kermek, D. (2024) · Education Sciences · doi:10.3390/educsci14010054 · Cited by 19
Self-citationCheers, H., Lin, Y., & Smith, S. P. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09990-4 · Cited by 19
Automated Detection of AI-Obfuscated Plagiarism in Modeling Assignments
Sağlam, T., Hahner, S., Schmid, L., & Burger, E. (2024) · Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training · doi:10.1145/3639474.3640084 · Cited by 17
Requirements for modelling tools for teaching
Kienzle, J., Zschaler, S., Barnett, W., Sağlam, T., Bucchiarone, A., Abrahão, S., Syriani, E., Kolovos, D. S., Lethbridge, T. C., Mustafiz, S., et al. (2024) · Software & Systems Modeling · doi:10.1007/s10270-024-01192-y · Cited by 16
Impact of Several Low-Effort Cheating-Reduction Methods in a CS1 Class
Vahid, F., Downey, K., Pang, A., & Gordon, C. L. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569731 · Cited by 14
Preprocessing for Source Code Similarity Detection in Introductory Programming
Karnalim, O., Simon, & Chivers, W. (2020) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3428029.3428065 · Cited by 14
Semantic Similarity Search for Source Code Plagiarism Detection: An Exploratory Study
Ebrahim, F., & Joy, M. S. (2024) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3649217.3653622 · Cited by 13
Self-citationAP-Coach: formative feedback generation for learning introductory programming concepts
Duong, T. N. B., Shar, L. K., & Shankararaman, V. (2022) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale54877.2022.00060 · Cited by 12
Flowchart-Based Cross-Language Source Code Similarity Detection
Zhang, F., Li, G., Liu, C., & Song, Q. (2020) · Scientific Programming · doi:10.1155/2020/8835310 · Cited by 11
Htet, E. E., Wai, K. H., Aung, S. T., Funabiki, N., Lu, X., Kyaw, H. H. S., & Kao, W.-C. (2024) · Analytics · doi:10.3390/analytics3010004 · Cited by 11
iGnnVD: A novel software vulnerability detection model based on integrated graph neural networks
Chen, J., Yin, Y., Cai, S., Wang, W., Wang, S., & Chen, J. (2024) · Science of Computer Programming · doi:10.1016/j.scico.2024.103156 · Cited by 11
Flow Chart Generation-Based Source Code Similarity Detection Using Process Mining
Zhang, F., Li, L., Liu, C., & Zeng, Q. (2020) · Scientific Programming · doi:10.1155/2020/8865413 · Cited by 11
Token-based plagiarism detection for metamodels
Sağlam, T., Hahner, S., Wittler, J. W., & Kühn, T. (2022) · Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings · doi:10.1145/3550356.3556508 · Cited by 10
“However, simple obfuscation attacks are typical for students [12].”
BackgroundMethodInfluentialWork-in-Progress: Syntactic Code Similarity Detection in Strongly Directed Assessments
Karnalim, O., Simon, Ayub, M., Kurniawati, G., Nathasya, R. A., & Wijanto, M. C. (2021) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon46332.2021.9454152 · Cited by 10
Layered similarity detection for programming plagiarism and collusion on weekly assessments
Karnalim, O., Simon, N. P., & Chivers, W. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22553 · Cited by 10
Detecting Automatic Software Plagiarism via Token Sequence Normalization
Sağlam, T., Brödel, M., Schmid, L., & Hahner, S. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639192 · Cited by 9
Discovering and exploring cases of educational source code plagiarism with Dolos
Maertens, R., Van Neyghem, M., Geldhof, M., Van Petegem, C., Strijbol, N., Dawyndt, P., & Mesuere, B. (2024) · SoftwareX · doi:10.1016/j.softx.2024.101755 · Cited by 9
An Experimental Comparison of Three Code Similarity Tools on Over 1,000 Student Projects
Horváth, M., & Pietriková, E. (2024) · IEEE World Symposium on Applied Machine Intelligence and Informatics (SAMI) · doi:10.1109/sami60510.2024.10432863 · Cited by 9
Watcher: Cloud-Based Coding Activity Tracker for Fair Evaluation of Programming Assignments
Kim, Y., Lee, K., & Park, H. (2022) · Sensors · doi:10.3390/s22197284 · Cited by 9
Somers, R., Cunningham, S., Dart, S., Thomson, S., Chua, C., & Pickering, E. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3234914 · Cited by 9
Advanced Detection of Source Code Clones via an Ensemble of Unsupervised Similarity Measures
Martínez-Gil, J. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-89277-6_5 · Cited by 9
Identifying plagiarised programming assignments based on source code similarity scores
Cheers, H., & Lin, Y. (2022) · Computer Science Education · doi:10.1080/08993408.2022.2060633 · Cited by 9
A Proposed Model for Source Code Reuse Detection in Computer Programs
Setoodeh, Z., Moosavi, M. R., Fakhrahmad, S. M., & Bidoki, S. M. (2021) · Iranian Journal of Science and Technology Transactions of Electrical Engineering · doi:10.1007/s40998-020-00403-8 · Cited by 8
Charitsis, C., Piech, C., & Mitchell, J. C. (2022) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3491140.3528269 · Cited by 8
Preventing Automatic Code Plagiarism Generation Through Token String Normalization
Brödel, M. (2023) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000165371 · Cited by 8
Iturbide, J. V., Llorens Largo, F., Álvarez, D. L., & Marqués-Andrés, M. (2023) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · Cited by 8
Gandhi, N., Gopalan, K., & Prasad, P. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1393723 · Cited by 7
A novel approach for software vulnerability detection based on ensemble learning model
Xuan, C. D., Quang, D. B., & Quang, V. D. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110848 · Cited by 7
Barros, B., Conejo, R., Ruiz-Sepúlveda, A., & Triguero‐Ruiz, F. (2021) · Applied Sciences · doi:10.3390/app11199328 · Cited by 7
Material Survey on Source Code Plagiarism Detection in Programming Courses
Alexandra-Cristina, C., & Olteanu, A.-C. (2022) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt55010.2022.00119 · Cited by 7
Purwaningrum, S., Susanto, A., & Kristiningsih, A. (2023) · Jurnal Nasional Teknik Elektro dan Teknologi Informasi (JNTETI) · doi:10.22146/jnteti.v12i3.6375 · Cited by 7
Bokor, T. (2023) · Corvinus Research Archive (Corvinus University of Budapest) · Cited by 7
TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic DesignPreprint
Chen, C., Zhong, M., Fan, Y., Shi, J., & Sun, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.21239 · Cited by 7
How Students Plagiarize Modeling Assignments
Sağlam, T., Schmid, L., Hahner, S., & Burger, E. (2023) · 2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C) · doi:10.1109/models-c59198.2023.00032 · Cited by 6
“Regarding programming assignments, the forms of plagia-rism are well researched [5].”
BackgroundMethodDetecting Source Code Plagiarism in Student Assignment Submissions Using Clustering Techniques
Mehsen, R. S., Kazi, M. M., & Joshi, H. (2024) · Journal of Techniques · doi:10.51173/jt.v6i2.1851 · Cited by 6
de Campos, D. S., & Ferreira, D. J. (2020) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie44824.2020.9274098 · Cited by 6
A Selective Review of Computing Education Research
Malmi, L., & Johri, A. (2023) · Routledge eBooks · doi:10.4324/9781003287483-31 · Cited by 6
Identifying Plagiarised Programming Assignments with Detection Tool Consensus
Cheers, H., Lin, Y., & Yan, W. (2022) · Informatics in Education · doi:10.15388/infedu.2023.05 · Cited by 6
The False-Positive Rate of Automated Plagiarism Detection for SQL Assessments
Kleerekoper, A., & Schofield, A. (2019) · doi:10.1145/3351287.3351290 · Cited by 6
Sağlam, T., & Schmid, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20158 · Cited by 6
Maisch, R. (2024) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000172813 · Cited by 6
Topical Analysis of Programming Education Research Literature
Malmi, L., López‐Pernas, S., Nguyen, H., Apiola, M., & Saqr, M. (2025) · ACM Transactions on Computing Education · doi:10.1145/3767734 · Cited by 5
Detecting GenAI assistance in programming assessments with over-uniqueness and sample matching
Karnalim, O., Toba, H., Wijanto, M. C., Setiawan, Y. D., Surantha, N., & Liut, M. (2026) · Discover Computing · doi:10.1007/s10791-025-09884-9 · Cited by 5
Mitigating Obfuscation Attacks on Software Plagiarism Detectors via Subsequence Merging
Sağlam, T., Niehues, N., Hahner, S., & Schmid, L. (2025) · IEEE International Conference on Software Engineering Education and Training (CSEE&T) · doi:10.1109/cseet66350.2025.00028 · Cited by 5
A mesterséges intelligencia és egyéb felforgató technológiák hatásainak átfogó vizsgálata
(2023) · Corvinus Research Archive (Corvinus University of Budapest) · Cited by 5
Franclinton, R., Karnalim, O., & Ayub, M. (2020) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v16i10.14289 · Cited by 5
Work in Progress: An Automated Management System for References in Programming Code
Pangestu, M. A., & Simon (2021) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon46332.2021.9454112 · Cited by 5
Using improved context-based code description for robust algorithmic binding to changing code
Goloveshkin, A., & Mikhalkovich, S. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.10.024 · Cited by 5
Um Método de Detecção de Plágio para Sistemas Juiz On-line baseado no Comportamento dos Alunos
de Oliveira, D. B. F., Filho, R. M. L., Oliveira, E., de Carvalho, L. S. G., Pereira, F. D., Colonna, J. G., & Menezes, A. (2021) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2021.21839 · Cited by 5
WOJR: A Recommendation System for Providing Similar Problems to Programming Assignments
Yoshimura, R., Sakamoto, K., Washizaki, H., & Fukazawa, Y. (2022) · Applied System Innovation · doi:10.3390/asi5030053 · Cited by 5
Karnalim, O., Simon, & Chivers, W. (2023) · Computer Science Education · doi:10.1080/08993408.2023.2178063 · Cited by 5
Pang, A., & Vahid, F. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588855 · Cited by 5
Mitigating Automated Obfuscation Attacks on Software Plagiarism Detection Systems
Sağlam, T. (2025) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000179018 · Cited by 5
Software Plagiarism Detection on Intermediate Representation
Heneka, N. R. (2023) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000168422 · Cited by 5
Plagiarism Detection Tool Based on Programming Activity Logs
Meier, H. H., Lepp, M., & Kütt, R. (2024) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon60312.2024.10578885 · Cited by 4
A Plagiarism Detection Architecture Based on OpenStack Services
Vodă, G., & Alexandrescu, A. (2023) · International Conference on System Theory, Control and Computing (ICSTCC) · doi:10.1109/icstcc59206.2023.10308433 · Cited by 4
Maisch, R., Hagel, N., & Bartel, A. (2025) · European Conference on Software Engineering Education (ECSEE) · doi:10.1145/3723010.3723019 · Cited by 4
Power, J. F., & Waldron, J. T. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3366928 · Cited by 4
Charitsis, C., Piech, C., & Mitchell, J. C. (2021) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3430895.3460161 · Cited by 4
Programming Plagiarism and Collusion: Student Perceptions and Mitigating Strategies in Indonesia
Karnalim, O., Kautsar, I. A., Aditya, B. R., Udjaja, Y., Nendya, M. B., & Kotama, I. N. D. (2021) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale52509.2021.9678917 · Cited by 4
Martínez-Gil, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.08903 · Cited by 4
Intelligent Match Merging to Prevent Obfuscation Attacks on Software Plagiarism Detectors
Niehues, N. (2023) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000167446 · Cited by 4
Novak, M., Joy, M. S., & Mirza, O. M. (2021) · doi:10.1109/temscon-eur52034.2021.9488644 · Cited by 3
Self-citationEnhancement of Plagiarism Detection Techniques via Watermarking
Ryman, D., Imbrie, P. K., & Kastner, J. (2022) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie56618.2022.9962396 · Cited by 3
Source code protection against unauthorised copying and analysis in IoT devices
Hyla, T., & Byczyk, S. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.836 · Cited by 3
Detection of Source Code Plagiarism Utilizing an Approach Based on Machine Learning
Mehsen, R. S., & Joshi, H. (2024) · International Journal of Computing · doi:10.47839/ijc.23.1.3438 · Cited by 3
Identifying Social Networks of Programmers using Text Mining for Code Similarity Detection
Xylogiannopoulos, K. F., & Karampelas, P. (2020) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam49781.2020.9381381 · Cited by 3
Test case recommendation based on balanced distance of test targets
Sun, W., Zhang, Q., Fang, C., Chen, Y., Wang, X., & Wang, Z. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106994 · Cited by 3
Techniques for detecting and deterring cheating in home exams in programming
Sindre, G., & Haugset, B. (2022) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie56618.2022.9962547 · Cited by 3
Three Approaches for Detecting Direct Output Cheating in Program Online Judge Systems
Qiu, J. H., Shi, C., & Lv, Y. (2023) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194023500043 · Cited by 3
Quantitative Symbolic Similarity Analysis
Sarker, L. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3605238 · Cited by 3
Token-based Plagiarism Detection for Statecharts
Strittmatter, J. (2023) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000165276 · Cited by 3
Same Same But Different: Preventing Refactoring Attacks on Software Plagiarism Detection
Maisch, R., Schmid, L., Sağlam, T., & Niehues, N. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773225 · Cited by 2
Metadata
- Authors
- Novak, M., Joy, M., & Kermek, D.
- Affiliations
- University of Zagreb (HR)
- University of Warwick (GB)
- Venue
- ACM Transactions on Computing Education
- Published
- 2019-05-21
- Volume
- 19
- Issue
- 3
- Pages
- 1-37
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W2945111072
- Cited by
- 117
- References
- 178
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 19 · 2023: 21 · 2022: 19 · 2021: 19 · 2020: 10 · 2019: 4
- FWCI
- 22.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computing Education (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (submittedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- code plagiarism detection, academic dishonesty, plagiarism detection software, code obfuscation, similarity measures, programming education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.