Using Machine Learning to Detect ‘Multiple-Account’ Cheating and Analyze the Influence of Student and Problem Features
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts are used to obtain correct answers that are later submitted in the master account which gives the student credit to obtain a certificate. In previous research, we developed an algorithm to identify and label submissions that were cheated using the CAMEO method; this algorithm relied on the IP of the submissions. In this study, we use this tagged sample of submissions to i) compare the influence of student and problems characteristics on CAMEO and ii) build a random forest classifier that detects submissions as CAMEO without relying on IP, achieving sensitivity and specificity levels of 0.966 and 0.996, respectively. Finally, we analyze the importance of the different features of the model finding that student features are the most important variables towards the correct classification of CAMEO submissions, concluding also that student features have more influence on CAMEO than problem features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Variable selection using random forests
Genuer, R., Poggi, J.-M., & Tuleau-Malot, C. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.03.014 · Cited by 2,619
Detecting Student Misuse of Intelligent Tutoring Systems
Baker, R. S., Corbett, A. T., & Koedinger, K. R. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30139-4_50 · Cited by 353
Research works printed but not linked: 25
- 10.1016/j.compedu.2017.01.015 · DOI
- baker, 2008, Why students engage in “gaming the system, J Interact Learn Res, 19
- 10.1103/PhysRevSTPER.6.010104 · DOI · Paper page
- 10.1007/s11257-011-9106-8 · DOI · Paper page
- arroyo, 2005, Inferring learning and attitudes from a Bayesian network of log file data, Proc 12th Int Conf Artif Intell, 33
- baker, 2009, Educational software features that encourage and discourage gaming the system, Proc 14th Int Conf Artificial Intell, 475
- 10.1007/978-3-642-13388-6_23 · DOI
- 10.1007/s11257-010-9086-0 · DOI
- bogle, 2000, Effect of perspective, type of student, and gender on the attribution of cheating, Proc Oklahoma Academic Sci Oklahoma City, 80, 91
- 10.32614/RJ-2015-018 · DOI · Paper page
- galbraith, 2010, Understanding incivility in online teaching, J Adult Edu, 39
- louppe, 2013, Understanding variable importances in forests of randomized trees, Proc Int Conf Adv Neural Inform Process Syst, 431
- 10.3200/JECE.39.2.116-125 · DOI · Paper page
- yousef, 2014, MOOCs: A review of the state-of-the-art, Proc 6th Int Conf Comput Supported Edu, 9
- 10.1145/3041021.3054161 · DOI
- siemens, 2013, Massive open online courses: Innovation in education, Open Educational Resources Innovation Research and Practice, 5, 5
- 10.1145/2876034.2876037 · DOI
- 10.1016/j.compedu.2016.04.008 · DOI
- alexandron, 2016, Detecting cheaters in MOOCs using item response theory and learning analytics, Proc 6th Workshop Personalization Approaches Learn Environ
- lambert, 2003, Collegiate academic dishonesty revisited: What have they done, how often have they done it, who does it, and why did they do it, J Electronic Soc, 7, 1
- balbuena, 2015, Prevalence, motives, and views of academic dishonesty in higher education, Pabico Asia Pacific Journal of Multidisciplinary Research, 3, 69
- 10.1080/10508422.2015.1051661 · DOI
- 10.1016/j.compedu.2012.06.001 · DOI
- 10.1016/j.compedu.2014.12.016 · DOI
- 10.1080/10508422.2015.1009630 · DOI
Cited by
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852
“Improving the performance of management platforms: A review study revealed that AI has signi fi cantly enhanced the performance of management platforms by completing routines, laboring tasks, and increasing security (Khan & Alotaibi, 2020; Li, 2021; Ruiperez-Valiente et al., 2019; Tang & Hai, 2021).”
The impact of ChatGPT on higher education
Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1206936 · Cited by 519
A systematic review on machine learning models for online learning and examination systems
Kaddoura, S., Popescu, D. E., & Hemanth, J. D. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.986 · Cited by 75
Data-driven detection and characterization of communities of accounts collaborating in MOOCs
Ruipérez-Valiente, J. A., Jaramillo-Morillo, D., Joksimović, S., Kovanović, V., Muñoz-Merino, P. J., & Gašević, D. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.07.003 · Cited by 26
Self-citation
Metadata
- Authors
- Ruiperez-Valiente, J. A., Munoz-Merino, P. J., Alexandron, G., & Pritchard, D. E.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2019-01-01
- Volume
- 12
- Issue
- 1
- Pages
- 112-122
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W2780493198
- Cited by
- 60
- References
- 3
- FWCI
- 10.37
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Madrid Regional Government (S2013/ICE-2715)
- Spanish Ministry of Economy and Competitiveness (TIN2014-53199-C3-1-R)
- European Erasmus+ projects MOOC Maker) (561533-EPP-1-2015-1-ES-EPPKA2-CBHE-JP)
- SHEILA (562080-EPP-1-2015-BE-EPPKA3-PI-FORWARD)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Machine Learning to Detect ‘Multiple-Account’ Cheating and Analyze the Influence of Student and Problem Features. https://app.cochat.ai/papers/10.1109/tlt.2017.2784420
- The paper
- Ruiperez-Valiente, J. A., Munoz-Merino, P. J., Alexandron, G., & Pritchard, D. E. (2019). Using Machine Learning to Detect ‘Multiple-Account’ Cheating and Analyze the Influence of Student and Problem Features. IEEE Transactions on Learning Technologies. https://doi.org/10.1109/tlt.2017.2784420
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.