Rethinking online assessment strategies: Authenticity versus AI chatbot intervention
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
As artificial intelligence (AI) and chatbot technologies like ChatGPT continue to evolve, educators grapple with the risks and benefits these advances bring to online assessment. The democratisation of AI-based technologies, while offering personalised learning experiences, threatens online assessment legitimacy and academic integrity. This paper critically examines the intersection of AI chatbots and online assessments, in the context of their impact on the design of authentic online assessments. The widespread usage of AI chatbots has caused serious problems for the validity of online tests because of the possibility of student abuse. This underlines the need for ‘authentic assessments’ that concentrate on higher-order cognitive skills, problem-solving, creative thinking, and collaborative talents and calls for a reevaluation of conventional assessment methods. These types of assessments not only align with the evolving pedagogical needs of the 21st century but also present tasks that are significantly challenging for AI chatbots to replicate, thereby preserving their integrity. Conversely, the paper also explores how AI can facilitate the assessment process by automating certain tasks, providing personalised learning experiences, and supporting collaborative assessments. The era of AI chatbots presents an opportunity to rethink and enhance online assessments, making them more authentic, meaningful, and resistant to AI-assisted malpractice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Defining Twenty-First Century Skills
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012) · Assessment and Teaching of 21st Century Skills · doi:10.1007/978-94-007-2324-5_2 · Cited by 1,809
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · cited 1×
“…open-ended nature of responses and the diversity of valid solutions To mitigate these challenges, educators might consider using rubrics that specify criteria for different levels of performance, allowing for a more objective and structured evaluation of students’ work (Jonsson & Svingby, 2007).”
BackgroundA five-dimensional framework for authentic assessment
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004) · Educational Technology Research and Development · doi:10.1007/bf02504676 · Cited by 916
ChatGPT in higher education: considerations for academic integrity and student learning
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.17 · Cited by 853 · cited 1×
“However, they concurrently pose challenges to the authenticity of learning outcomes, as they can be misused to automate or assist in traditional assessments (Daniel, 2020, Rudolph et al., 2023a, Sullivan et al., 2023).”
BackgroundThe impact of artificial intelligence on learner–instructor interaction in online learning
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00292-9 · Cited by 788 · cited 1×
“According to Seo et al. (2021), if ChatGPT and other AI models are used for rapid and superficial learning, they may hinder the development of graduate-level skills such as critical thinking and problem-solving.”
The role of ChatGPT in higher education: Benefits, challenges, and future research directions
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.29 · Cited by 561 · cited 6×
“According to Seo et al. (2021), if ChatGPT and other AI models are used for rapid and superficial learning, they may hinder the development of graduate-level skills such as critical thinking and problem-solving.”
BackgroundInfluentialCrawford, J., Cowling, M., & Allen, K.-A. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.3.02 · Cited by 547 · cited 4×
“This method equips students with vital skills for interacting with systems like ChatGPT in future professional environments.”
BackgroundInfluential
Cited by
Crafting personalized learning paths with AI for lifelong learning: a systematic literature review
Bayly-Castaneda, K., Ramirez-Montoya, M.-S., & Morita-Alexander, A. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1424386 · Cited by 156
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.2.12 · Cited by 132
Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania
Rudolph, J., Mohamed Ismail, F. M., & Popenici, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/54fs5e77 · Cited by 189
Parsakia, K. (2023) · Health Nexus · doi:10.61838/hn.1.1.14 · Cited by 89
Saihi, A., Ben-Daya, M., Hariga, M., & As'ad, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100274 · Cited by 75
Enough of the chit-chat: A comparative analysis of four AI chatbots for calculus and statistics
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.2.22 · Cited by 50
Hassoulas, A., Powell, N., Roberts, L., Umla-Runge, K., Gray, L., & Coffey, M. J. (2023) · Journal of Applied Learning and Teaching · doi:10.37074/jalt.2023.6.2.13 · Cited by 28
Ahmad, M., Subih, M., Fawaz, M., Alnuqaidan, H., Abuejheisheh, A., Naqshbandi, V., & Alhalaiqa, F. (2024) · Journal of Applied Learning and Teaching · doi:10.37074/jalt.2024.7.1.10 · Cited by 18
(2024) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2024.7.1.33 · Cited by 16
A Three-Step Approach to Shift from Assessment Integrity to Assurance of Learning in the Age of AI
Thite, S. D., Danish, N., Florez, G. O., & Rougieux, F. (2024) · 2024 World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC) · doi:10.1109/weef-gedc63419.2024.10854944 · Cited by 3
Navigating AI Adoption: Challenges and Suggested Solutions for College Lecturers
Ahlam, A., Huda, S., Hala, H., Nimer, B., & Wajeeh, D. (2025) · 2025 International Conference on Smart Learning Courses (SCME) · doi:10.1109/scme62582.2025.11104880 · Cited by 2
“Ifelebuegu [21] reported that AI chatbots have created a unique integrity challenge for assessments, pushing educators to reevaluate their methods.”
Metadata
- Venue
- Journal of Applied Learning & Teaching
- Publisher
- Open Access Publishing Association
- Published
- 2023-07-03
- Volume
- 6
- Issue
- 2
- ISSN
- 2591-801X (ISSN-L)
- OpenAlex
- W4382894734
- Cited by
- 58
- References
- 20
- FWCI
- 13.63
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.