CoChat

Generative Artificial Intelligence in Tertiary Education: Assessment Redesign Principles and Considerations

Lye, Che Yee, Lim, Lyndon · 2024 · Education Sciences
Cited by 54

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

The emergence of generative artificial intelligence (AI) such as ChatGPT has sparked significant assessment concerns within tertiary education. Assessment concerns have largely revolved around academic integrity issues among students, such as plagiarism and cheating. Nonetheless, it is also critical to consider that generative AI models trained on information retrieved from the Internet could produce biased and discriminatory outputs, and hallucination issues in large language models upon which generative AI acts provide made-up and untruthful outputs. This article considers the affordances and challenges of generative AI specific to assessments within tertiary education. It illustrates considerations for assessment redesign with the existence of generative AI and proposes the Against, Avoid and Adopt (AAA) principle to rethink and redesign assessments. It argues that more generative AI tools will emerge exponentially, and hence, engaging in an arms race against generative AI and policing the use of these technologies may not address the fundamental issues in assessments.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/educsci14060569

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 16

  1. Park, A.; Maloney, J. Potential affordances of generative AI in language education: Demonstrations and an evaluative framework. Teach. Engl. Technol. 2023, 23, 4-24. [CrossRef]
  2. Wang, N.; Wang, X.; Su, Y.-S. Critical analysis of the technological affordances, challenges and future directions of generative AI in education: A systematic review. Asia Pac. J. Educ. 2024, 44, 139-155. [CrossRef] · DOI · Paper page
  3. Ajzen, I. Perceived Behavioral Control, Self-Efficacy, Locus of Control, and the Theory of Planned Behavior. J. Appl. Soc. Psychol. 2002, 32, 665-683. [CrossRef] · DOI · Paper page
  4. Alleyne, P.; Phillips, K. Exploring academic dishonesty among university students in barbados: An extension to the theory of planned behaviour. J. Acad. Ethics 2011, 9, 323-338. [CrossRef] · DOI
  5. Hendy, N.T.; Montargot, N. Understanding Academic dishonesty among business school students in France using the theory of planned behavior. Int. J. Manag. Educ. 2019, 17, 85-93. [CrossRef] · DOI · Paper page
  6. Stone, T.H.; Jawahar, I.M.; Kisamore, J.L. Using the theory of planned behavior and cheating justifications to predict academic misconduct. Career Dev. Int. 2009, 14, 221-241. [CrossRef] · DOI · Paper page
  7. Uzuna, A.M.; Kilisb, S. Investigating antecedents of plagiarism using extended theory of planned behavior. Comput. Educ. 2020, 144, 103700. [CrossRef] · DOI
  8. Archer, E. The assessment purpose triangle: Balancing the purposes of educational assessment. Front. Educ. 2017, 2, 41. [CrossRef] · DOI
  9. Newton, P.E. Clarifying the purposes of educational assessment. Assess. Educ. Princ. Pol. Pract. 2007, 14, 149-170. [CrossRef]
  10. Brookhart, S.M. Successful students' formative and summative uses of assessment information. Assess. Educ. Princ. Pol. Pract. 2001, 8, 153-169. [CrossRef]
  11. Black, P.; Harrison, C.; Hodgen, J.; Marshall, B.; Serret, N. Validity in teachers' summative assessments. Assess. Educ. Princ. Pol. Pract. 2010, 17, 215-232. [CrossRef]
  12. Black, P.; Harrison, C.; Lee, C.; Marshall, B.; William, D. Assessment for Learning-Putting It into Practice; Open University Press: Maidenhead, UK, 2003.
  13. Forde-Leaves, N.; Walton, J.; Tann, K. A framework for understanding assessment practice in higher education. Assess. Eval. High. Educ. 2023, 48, 1076-1091. [CrossRef] · DOI
  14. Tomas, C.; Jessop, T. Struggling and juggling: A comparison of student assessment loads across research and teaching-intensive universities. Assess. Eval. High. Educ. 2019, 44, 1-10. [CrossRef] · DOI · Paper page
  15. Anderson, L.W.; Krathwohl, D.R.; Bloom, B.S. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives; Complete Edition; Longman: London, UK, 2001.
  16. O'Sullivan, B.; Cheng, L. Lessons from the Chinese imperial examination system. Lang. Test. Asia 2022, 12, 52. · DOI

Cited by

Metadata

Authors
Lye, C. Y., & Lim, L.
Affiliations
Teaching & Learning Centre, Singapore University of Social Sciences, 463 Clementi Road, Singapore 599494, Singapore
Venue
Education Sciences
Publisher
MDPI AG
Published
2024-05-26
Volume
14
Issue
6
Pages
569
ISSN
2227-7102
Cited by
54
References
10
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.