A Systematic Review of Online Exams Solutions in E-Learning: Techniques, Tools, and Global Adoption
Open accessAbstract
E-learning in higher education is exponentially increased during the past decade due to its inevitable benefits in critical situations like natural disasters (e.g. COVID-19 pandemic etc.) and war circumstances. The reliable, fair, and seamless execution of online exams in E-learning is highly significant. Particularly, online exams are conducted on E-learning platforms without the physical presence of students and instructors at the same place. This poses several issues like integrity and security during online exams. To address such issues, researchers frequently proposed different techniques and tools. However, a study summarizing and analyzing latest developments, particularly in the area of online examination, is hard to find in the literature. In this article, a Systematic Literature Review (SLR) of online examination is performed to select and analyze 53 studies published during the last five years (i.e. Jan 2016 to July 2020). Subsequently, five leading online exams features targeted in the selected studies are identified. Moreover, underlying development approaches for the implementation of online exams solutions are explored. Furthermore, 16 important techniques / algorithms and 11 datasets are presented. In addition to this, 21 online exams tools proposed in the selected studies are identified. Additionally, 25 leading existing tools used in the selected studies are also presented. Finally, the participation of countries in online exam research is investigated. Key factors for the global adoption of online exams are identified and compared with major online exams features. This facilitates the selection of right online exam system for a particular country on the basis of existing E-learning infrastructure and overall cost. To conclude, the findings of this article provide a solid platform for the researchers and practitioners of the domain to select appropriate features along with underlying development approaches, tools, and techniques for the implementation of a particular online exams solution as per given requirements.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AAs allow for a more accurate measure of the learner's abilities by dynamically changing the difficulty of the questions based on the student's performance evidence.
“These AAs allow for a more accurate measure of the learner's abilities by dynamically changing the difficulty of the questions based on the student's performance evidence [213,214].”
From Leveraging AI in E-Learning: Personalized Learning and Adaptive Assessment through Cognitive Neuropsychology—A Systematic Analysis (2024) · cites this paper as [214]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2004) · Cited by 5,198 · see citing works
EMNIST: an extension of MNIST to handwritten lettersPreprint
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05373 · Cited by 442 · see citing works
Butler-Henderson, K. A., & Crawford, J. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.104024 · Cited by 288 · see citing works
Review and discussion: E-learning for academia and industry
Chang, V. I. C. (2016) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.12.007 · Cited by 222 · see citing works
Automated Online Exam Proctoring
Atoum, Y., Chen, L., Liu, A. X., Hsu, S. D. H., & Liu, X. (2017) · IEEE transactions on multimedia · doi:10.1109/tmm.2017.2656064 · Cited by 214 · see citing works
Envisioning the use of online tests in assessing twenty-first century learning: a literature review
Boitshwarelo, B., Reedy, A. K., & Billany, T. (2017) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-017-0055-7 · Cited by 144 · see citing works
The impact of proctored online exams on the educational experience
Milone, A. S., Cortese, A. M., Balestrieri, R. L., & Pittenger, A. L. (2016) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2016.08.037 · Cited by 134 · see citing works
E-exam Cheating Detection System
Bawarith, R. H., Abdullah, A., Anas, D., & Dr., P. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080425 · Cited by 112 · see citing works
Addressing cheating when using test bank questions in online Classes
Golden, J., & Kohlbeck, M. J. (2020) · Journal of Accounting Education · doi:10.1016/j.jaccedu.2020.100671 · Cited by 109 · see citing works
An intelligent system for online exam monitoring
Prathish, S., Narayanan, S. A., & Bijlani, K. (2016) · doi:10.1109/infosci.2016.7845315 · Cited by 104 · see citing works
A Design of Continuous User Verification for Online Exam Proctoring on M-Learning
Asep, H. S. G., & Bandung, Y. (2019) · doi:10.1109/iceei47359.2019.8988786 · Cited by 76 · see citing works
A Conceptual Framework for Detecting Cheating in Online and Take‐Home Exams
D’Souza, K. A., & Siegfeldt, D. V. (2017) · Decision Sciences Journal of Innovative Education · doi:10.1111/dsji.12140 · Cited by 74 · see citing works
PageFocus: Using paradata to detect and prevent cheating on online achievement tests
Diedenhofen, B., & Musch, J. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0800-7 · Cited by 73 · see citing works
A New Model of Automatic and Continuous Online Exam Monitoring
Moukhliss, G., Belhadaoui, H., & Hilali, R. F. (2019) · International Conference on Systems of Collaboration Big Data, Internet of Things & Security (SysCoBIoTS) · doi:10.1109/syscobiots48768.2019.9028027 · Cited by 65 · see citing works
Proposed features of an online examination interface design and its optimal values
Karim, N. A., & Shukur, Z. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.07.013 · Cited by 57 · see citing works
Detecting probable cheating during online assessments based on time delay and head pose
Chuang, C.-Y., Craig, S. D., & Femiani, J. C. (2017) · Higher Education Research & Development · doi:10.1080/07294360.2017.1303456 · Cited by 57 · see citing works
Cheat-resistant multiple-choice examinations using personalization
Manoharan, S. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.11.007 · Cited by 55 · see citing works
Video summarization for remote invigilation of online exams
Cote, M., Jean, F., Albu, A. B., & Capson, D. W. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477704 · Cited by 52 · see citing works
Nandini, V., & Maheswari, P. U. (2018) · The Journal of Supercomputing · doi:10.1007/s11227-018-2381-y · Cited by 48 · see citing works
Anwar, M. W., Rashid, M., Azam, F., et al. (2020) · IEEE Access · doi:10.1109/access.2020.2999544 · Cited by 46 · see citing works
Self-citationOnline Examination System with Cheating Prevention Using Question Bank Randomization and Tab Locking
Chua, S. S., Bondad, J. B., Lumapas, Z. R., & Garcia, J. D. L. (2019) · doi:10.1109/incit.2019.8912065 · Cited by 44 · see citing works
Face Recognition Method for Online Exams
Sukmandhani, A. A., & Sutedja, I. (2019) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech.2019.8843831 · Cited by 43 · see citing works
Exam paper generation based on performance prediction of student group
Wu, Z., He, T., Mao, C., et al. (2020) · Information Sciences · doi:10.1016/j.ins.2020.04.043 · Cited by 41 · see citing works
Convolutional Neural Network based Virtual Exam Controller
Garg, K., Verma, K., Patidar, K., Tejra, N. K., & Patidar, K. (2020) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs48265.2020.9120966 · Cited by 39 · see citing works
Ensuring Online Exam Integrity Through Continuous Biometric Authentication
Traoré, I., Nakkabi, Y., Saad, S., Sayed, B., Ardigo, J. D., & Quinan, P. M. D. F. (2017) · Springer eBooks · doi:10.1007/978-3-319-48947-6_6 · Cited by 37 · see citing works
Research on Abnormal Behavior Detection of Online Examination Based on Image Information
Hu, S., Jia, X., & Fu, Y. (2018) · International Conference on Intelligent Human-Machine Systems and Cybernetics · doi:10.1109/ihmsc.2018.10127 · Cited by 37 · see citing works
Automatically assessed electronic exams in programming courses
Rajala, T., Kaila, E., Lindén, R., Kurvinen, E., Lokkila, E., Laakso, M., & Salakoski, T. (2016) · Australasian Computer Science Week Multiconference (ACSW) · doi:10.1145/2843043.2843062 · Cited by 36 · see citing works
Process mining based approach to performance evaluation in computer‐aided examinations
Baykasoğlu, A., Özbel, B. K., Dudaklı, N., Subulan, K., & Şenol, M. E. (2018) · Computer Applications in Engineering Education · doi:10.1002/cae.21971 · Cited by 34 · see citing works
A Dynamic Profile Questions Approach to Mitigate Impersonation in Online Examinations
Ullah, A., Xiao, H., & Barker, T. (2018) · Journal of Grid Computing · doi:10.1007/s10723-018-9442-6 · Cited by 30 · see citing works
Fog-Assisted Secure Data Exchange for Examination and Testing in E-learning System
Kausar, S., Xu, H., Ullah, A., et al. (2020) · Mobile Networks and Applications · doi:10.1007/s11036-019-01429-x · Cited by 26 · see citing works
Integrated and secure web‐based examination management system
Al‐Hawari, F., Alshawabkeh, M., Althawbih, H. H. V., et al. (2019) · Computer Applications in Engineering Education · doi:10.1002/cae.9 · Cited by 24 · see citing works
Development of Continuous Authentication System on Android-Based Online Exam Application
Aisyah, S., Bandung, Y., & Subekti, L. B. (2018) · International Conference on Information Technology Systems and Innovation · doi:10.1109/icitsi.2018.8695954 · Cited by 22 · see citing works
Gesture based misbehavior detection in online examination
Fan, Z., Xu, J., Liu, W., & Cheng, W. (2016) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2016.7581586 · Cited by 20 · see citing works
Holistic Development of Computer Engineering Curricula Using Y-Chart Methodology
Rashid, M., & Tasadduq, I. A. (2014) · IEEE Transactions on Education · doi:10.1109/te.2014.2304930 · Cited by 17 · see citing works
An Examination System Automation Using Natural Language Processing
Das, I., Sharma, B., Rautaray, S. S., et al. (2019) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/icces45898.2019.9002048 · Cited by 15 · see citing works
An Application to Discover Cheating in Digital Exams
Opgen-Rhein, J., Küppers, B., & Schroeder, U. (2018) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3279720.3279740 · Cited by 14 · see citing works
Prototype of Online Examination on MoLearn Applications Using Text Similarity to Detect Plagiarism
Lemantara, J., Sunarto, M. J. D., Hariadi, B., et al. (2018) · International Conference on Information Technology, Computer, and Electrical Engineering · doi:10.1109/icitacee.2018.8576922 · Cited by 13 · see citing works
Intelligent On-line Exam Management and Evaluation System
Tashu, T. M., Esclamado, J. P., & Horváth, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22244-4_14 · Cited by 13 · see citing works
Adapting Engineering Examinations from Paper to Online
Andersen, K., Thorsteinsson, S. E., Thorbergsson, H., & Gudmundsson, K. S. (2020) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon45650.2020.9125273 · Cited by 13 · see citing works
The Design and Application of an Web-Based Online Examination System
Jiang, J., Wu, B., Chang, L., Liu, K., & Hao, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-38778-5_27 · Cited by 12 · see citing works
Virtualization methods for securing online exam
Natawiguna, A., & Liem, M. M. I. (2016) · International Conference on Data and Software Engineering · doi:10.1109/icodse.2016.7936145 · Cited by 11 · see citing works
Introducing TAMEx model for availability of e-exam in wireless environment
Sukadarmika, G., Hartati, R. S., Linawati, L., & Sastra, N. P. (2018) · International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact.2018.8350741 · Cited by 11 · see citing works
An application of online exam in discrete mathematics course
Qiong, C. (2018) · doi:10.1145/3210713.3210734 · Cited by 9 · see citing works
Towards academic affect modeling through experimental hybrid gesture recognition algorithm
Abisado, M., Gerardo, B. D., Vea, L. A., et al. (2018) · International Conference on Data Science and Information Technology (DSIT) · doi:10.1145/3239283.3239305 · Cited by 9 · see citing works
Automatic exam grading by a mobile camera
Wagstaff, B., Lu, C., & Chen, X. '. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3308557.3308661 · Cited by 9 · see citing works
A Virtual Dialogue Assistant for Conducting Remote Exams
Matveev, A., Makhnytkina, O. V., Lizunova, I. A., Vinogradova, T., Chirkovskiy, A., Svischev, A., & Mamaev, N. (2020) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct48808.2020.9087557 · Cited by 9 · see citing works
Security of Online Examinations
Sabbah, Y. (2017) · Data analytics · doi:10.1007/978-3-319-59439-2_6 · Cited by 8 · see citing works
Secure online examination by using graphical own image password scheme
Mathapati, M., Kumaran, T. S., Kumar, A. K., et al. (2017) · doi:10.1109/icstm.2017.8089144 · Cited by 8 · see citing works
Data Mining with Fuzzy Method Towards Intelligent Questions Categorization in E-Learning
Mahatme, V. P., & Bhoyar, K. K. (2016) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn.2016.140 · Cited by 8 · see citing works
An e-Exam Platform Approach to Enhance University Academic Student’s Learning Performance
Albastroiu, R., Iova, A., Gonçalves, F., et al. (2018) · Studies in computational intelligence · doi:10.1007/978-3-319-99626-4_35 · Cited by 8 · see citing works
A Multi-factor Authentication Method for Security of Online Examinations
Ullah, A., Xiao, H., & Barker, T. (2018) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-05928-6_13 · Cited by 8 · see citing works
Item-based approach for online exam performance and its application
Ketui, N., Homjun, K., Poonyasiri, K., et al. (2016) · International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) · doi:10.1109/ecticon.2016.7561297 · Cited by 7 · see citing works
Formal analysis and offline monitoring of electronic exams
Kassem, A., Falcone, Y., & Lafourcade, P. (2017) · Formal Methods in System Design · doi:10.1007/s10703-017-0280-0 · Cited by 7 · see citing works
Using Aadhaar for Continuous Test-Taker Presence Verification in Online Exams
Subramanian, N. S., Narayanan, S., Soumya, M. D., et al. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-7563-6_2 · Cited by 7 · see citing works
Modeling Filipino Academic Affect during Online Examination using Machine Learning
Abisado, M., Rodriguez, R. L., Arias, A. R. V., et al. (2019) · doi:10.1145/3349266.3351387 · Cited by 7 · see citing works
An Online Lab Examination Management System (OLEMS) to Avoid Malpractice
Kolhar, M., Alameen, A. A. M., & Gharsseldien, Z. M. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9889-z · Cited by 6 · see citing works
Research and development of intelligent online examination monitoring system
Shi, J., Li, H., Gu, H., et al. (2017) · International Conference on Computer Science and Education · doi:10.1109/iccse.2017.8085463 · Cited by 6 · see citing works
Exam Wizard: A novel e-assessment system
Vomvyras, D., Andreatos, A. S., & Douligeris, C. (2019) · South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM) · doi:10.1109/seeda-cecnsm.2019.8908372 · Cited by 6 · see citing works
Alrubaish, F. A., Humaid, G. A., Alamri, R. M., et al. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-36368-0_25 · Cited by 6 · see citing works
An author co‐citation analysis: Examining the intellectual structure of e‐learning from 1981 to 2014
McCoy, C., Yu, A., & Ramazanova, S. (2015) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2015.145052010090 · Cited by 4 · see citing works
Key Components of an E-Learning Module in Statistics for Computer Science Students
Andersson, C., & Kroisandt, G. (2018) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2018.8468753 · Cited by 4 · see citing works
Pathways to Successful Online Testing: eExams with the “Secure Exam Environment” (SEE)
Frankl, G., Napetschnig, S., & Schartner, P. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-21151-6_12 · Cited by 4 · see citing works
Online assessment system based on IMS-QTI specification
Boussakuk, M., Ghazi, M. E., Bouchboua, A., & Ouremchi, R. (2019) · Mediterranean Congress of Telecommunications (CMT) · doi:10.1109/cmt.2019.8931309 · Cited by 4 · see citing works
Evaluation of online assignments and quizzes using Bayesian Networks
Ettarres, Y. (2016) · Lecture notes in educational technology · doi:10.1007/978-981-10-2419-1_7 · Cited by 3 · see citing works
A Novel Automated Assessment Technique in e-Learning Using Short Answer Type Questions
Kar, S. P., Chatterjee, R., & Mandal, J. K. (2017) · Communications in computer and information science · doi:10.1007/978-981-10-6427-2_12 · Cited by 3 · see citing works
An Interactive Mobile Technology to Improve the Usability of Exam Application for Disabled Student
Fanani, L., Brata, A. H., & Riski Puspa Dewi, D. P. (2019) · International Conference on Education and Multimedia Technology (ICEMT) · doi:10.1145/3345120.3345149 · Cited by 3 · see citing works
Pathways to Successful Online Testing: eExams with the “Secure Exam Environment” (SEE)
Frankl, G., Napetschnig, S., & Schartner, P. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-97807-9_15 · Cited by 2 · see citing works
Automatically generating exams via programmable plug-ins, and generic XML exam support
Sultan, S., & Salman, A. A. (2019) · International Conference on e-Education, e-Business, e-Management and e-Learning · doi:10.1145/3306500.3306504 · Cited by 2 · see citing works
Analysis and Design of Item Bank System Based on Improved Genetic Algorithm
Zhang, J. (2018) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3194452.3194478 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- N. A. Karim and Z. Shukur, ''Review of user authentication methods in online examination,'' Asian J. Inf. Technol., vol. 14, no. 5, pp. 166-175, 2015.
- G. Frankl, P. Schartner, and G. Zebedin, ''The 'secure exam environment' for online testing at the Alpen-Adria-Universität Klagenfurt/Austria,'' in Proc. World Conf. E-Learn. Corporate, Government, Healthcare, Higher Educ., 2011, pp. 498-505.
- Eng., Comput. Netw. Social Media Conf. (SEEDA-CECNSM), Sep. 2019, pp. 1-6.
- M. Rashid, ''A systematic approach of data preparation for ABET accred- itation,'' Int. J. Eng. Educ., vol. 37, no. 1, pp. 1-13, 2021.
Cited by
Sorted by citations
Halkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328 · see citing works
“These AAs allow for a more accurate measure of the learner’s abilities by dynamically changing the difficulty of the questions based on the student’s performance evidence [213,214].”
Madni, S. H. H., Ali, J., Husnain, H. A., Masum, M. H., Mustafa, S., Shuja, J., Maray, M., & Hosseini, S. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.915596 · Cited by 58 · see citing works
Wang, S., Kong, X., & Wang, N. (2024) · 2024 13th International Conference on Educational and Information Technology (ICEIT) · doi:10.1109/iceit61397.2024.10540849 · Cited by 13 · see citing works
- Authors
- Muzaffar, A. W., Tahir, M., Anwar, M. W., Chaudry, Q., Mir, S. R., & Rasheed, Y.
- Affiliations
- Saudi Electronic University (SA)
- National University of Sciences and Technology (PK)
- University of Ha'il (SA)
- ORCID
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 32689-32712
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3093107392
- Cited by
- 149
- References
- 69
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 32 · 2023: 34 · 2022: 42 · 2021: 16 · 2020: 1
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- Deanship of Scientific Research, Saudi Electronic University (ELI-CCI20134)
- Topics
- Social Sciences › Safety Research › Academic integrity and plagiarism
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Physical Sciences › Computer Science › Information Systems › Educational Technology and E-Learning
- Keywords
- online examinations, online learning, higher education, examination integrity, exam security, COVID-19 pandemic, online learning platforms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
