Rethinking online assessment strategies: Authenticity versus AI chatbot intervention
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
As artificial intelligence (AI) and chatbot technologies like ChatGPT continue to evolve, educators grapple with the risks and benefits these advances bring to online assessment. The democratisation of AI-based technologies, while offering personalised learning experiences, threatens online assessment legitimacy and academic integrity. This paper critically examines the intersection of AI chatbots and online assessments, in the context of their impact on the design of authentic online assessments. The widespread usage of AI chatbots has caused serious problems for the validity of online tests because of the possibility of student abuse. This underlines the need for ‘authentic assessments’ that concentrate on higher-order cognitive skills, problem-solving, creative thinking, and collaborative talents and calls for a reevaluation of conventional assessment methods. These types of assessments not only align with the evolving pedagogical needs of the 21st century but also present tasks that are significantly challenging for AI chatbots to replicate, thereby preserving their integrity. Conversely, the paper also explores how AI can facilitate the assessment process by automating certain tasks, providing personalised learning experiences, and supporting collaborative assessments. The era of AI chatbots presents an opportunity to rethink and enhance online assessments, making them more authentic, meaningful, and resistant to AI-assisted malpractice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · cited 1×
“…open-ended nature of responses and the diversity of valid solutions To mitigate these challenges, educators might consider using rubrics that specify criteria for different levels of performance, allowing for a more objective and structured evaluation of students’ work (Jonsson & Svingby, 2007).”
BackgroundA five-dimensional framework for authentic assessment
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004) · Educational Technology Research and Development · doi:10.1007/bf02504676 · Cited by 916
ChatGPT in higher education: considerations for academic integrity and student learning
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.17 · Cited by 853 · cited 1×
“However, they concurrently pose challenges to the authenticity of learning outcomes, as they can be misused to automate or assist in traditional assessments (Daniel, 2020, Rudolph et al., 2023a, Sullivan et al., 2023).”
BackgroundThe impact of artificial intelligence on learner–instructor interaction in online learning
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00292-9 · Cited by 788 · cited 1×
“According to Seo et al. (2021), if ChatGPT and other AI models are used for rapid and superficial learning, they may hinder the development of graduate-level skills such as critical thinking and problem-solving.”
The role of ChatGPT in higher education: Benefits, challenges, and future research directions
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.29 · Cited by 561 · cited 6×
“According to Seo et al. (2021), if ChatGPT and other AI models are used for rapid and superficial learning, they may hinder the development of graduate-level skills such as critical thinking and problem-solving.”
BackgroundInfluentialCrawford, J., Cowling, M., & Allen, K.-A. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.3.02 · Cited by 547 · cited 4×
“This method equips students with vital skills for interacting with systems like ChatGPT in future professional environments.”
BackgroundInfluentialWhat ChatGPT means for universities: Perceptions of scholars and students
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.22 · Cited by 431 · cited 1×
“Concerns exist regarding factual bias and information falsification by these chatbots (Dwivedi et al., 2023; Firat, 2023).”
Background
Cited by
Crafting personalized learning paths with AI for lifelong learning: a systematic literature review
Bayly-Castaneda, K., Ramirez-Montoya, M.-S., & Morita-Alexander, A. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1424386 · Cited by 156
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.2.12 · Cited by 132
Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania
Rudolph, J., Mohamed Ismail, F. M., & Popenici, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/54fs5e77 · Cited by 189
Parsakia, K. (2023) · Health Nexus · doi:10.61838/hn.1.1.14 · Cited by 89
Saihi, A., Ben-Daya, M., Hariga, M., & As'ad, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100274 · Cited by 75
Metadata
- Venue
- Journal of Applied Learning & Teaching
- Publisher
- Open Access Publishing Association
- Published
- 2023-07-03
- Volume
- 6
- Issue
- 2
- ISSN
- 2591-801X (ISSN-L)
- OpenAlex
- W4382894734
- Cited by
- 58
- References
- 18
- FWCI
- 13.63
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rethinking online assessment strategies: Authenticity versus AI chatbot intervention. https://app.cochat.ai/papers/10.37074/jalt.2023.6.2.2
- The paper
- Rethinking online assessment strategies: Authenticity versus AI chatbot intervention. (2023). Journal of Applied Learning & Teaching. https://doi.org/10.37074/jalt.2023.6.2.2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.