Designing assessments in the generative AI era: A tailored assessment framework for ICT tertiary education
Open accessAbstract
The rapid expansion of generative artificial intelligence (GenAI) as a disruptive force in modern times presents tertiary education with both unprecedented opportunities and profound challenges for assessment design. As GenAI can create plausible assessment responses with limited student engagement, many traditional assessments are now at risk of becoming obsolete. Assessment reform is particularly important in ICT programs, where GenAI can readily generate assessment content, such as coding, and algorithms, and technologically savvy students may be prone to misuse it rather than engage in authentic learning. Consequently, sector-wide discussions are centred on how to redesign assessment to enable the appropriate and ethical use of GenAI while ensuring students genuinely achieve the expected learning outcomes. Despite calls for updated strategies from quality assurance bodies, a significant gap remains between the pace of GenAI advancement and the implementation of such assessment reforms. The objective of this study is to identify how educators can design assessments for ICT tertiary students that accurately measure student learning outcomes in an era of widespread access to GenAI tools. Using a qualitative interpretivist approach and thematic analysis of scholarly and institutional practice documents, this research proposes the GENESIS framework (GenAI-Enabled Strategic and Instructional System for Assessment), a five-pillar, institution-wide model emphasising shifts in institutional values, governance, and support as prerequisites for sustainable assessment reform. GENESIS is complemented by the Assessment Design Matrix (ADM), a tripartite structure integrating graduate competencies, assessment strategies, and assessment methods. ADM provides a practical, hands-on guide for assessment designers to craft integrity-focused assessments that assess ICT graduate competencies. Together, GENESIS and ADM propose a structured, discipline-tailored framework to ensure assessments continue to validly measure student learning within the GenAI ecosystem.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Large language models generate plausible essays, summaries, laboratory write-ups, and examination responses with limited student engagement.
“As large language models generate plausible essays, summaries, laboratory write-ups, and examination responses with limited student engagement (Ahangama, 2026)”
From OTE Reconstructing the Assessment System of the Undergraduate Course “Plant Physiology” in the AI Era: A Framework for Authentic and AI-Resilient Task Design (2026) · cites this paper as Ahangama, 2026
Theme 1–Values & Dispositions (page unavailable) discusses students submitting AI-generated content as their own work, and Theme 7–Assessment Methods describes staged essays intended to foster authentic engagement. These support the general concern that AI can substitute for student work, but our copy does not substantiate the specific list of summaries, laboratory write-ups, and examination responses, or establish that LLMs produce all of them plausibly with limited student engagement. (LLM, conf=0.78)
Experimental — accuracy not yet measuredThe proliferation of generative artificial intelligence (GenAI) has fundamentally challenged the validity of traditional assessments in higher education.
“The proliferation of generative artificial intelligence (GenAI) has fundamentally challenged the validity of traditional assessments in higher education.”
From OTE Reconstructing the Assessment System of the Undergraduate Course “Plant Physiology” in the AI Era: A Framework for Authentic and AI-Resilient Task Design (2026) · cites this paper as Ahangama, 2026
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789 · see citing works
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1× · see citing works
“The rapid evolution of GenAI has outpaced the development of effective integration frameworks for academic assessment (Kasneci et al. 2023).”
Clarke, V., & Braun, V. (2017) · The Journal of Positive Psychology · doi:10.1080/17439760.2016.1262613 · Cited by 6,543 · see citing works
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084 · see citing works
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · see citing works
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079 · see citing works
A Step-by-Step Process of Thematic Analysis to Develop a Conceptual Model in Qualitative Research
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023) · International Journal of Qualitative Methods · doi:10.1177/16094069231205789 · Cited by 2,243 · see citing works
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852 · cited 1× · see citing works
“For example, studies by Luo (2024), Christodorescu et al. (2024), Chiu (2024), and Pinho et al. (2025) underscore the importance of aligning academic integrity policies with the realities of GenAI.”
Conducting a Qualitative Document Analysis
Morgan, H. (2022) · The Qualitative Report · doi:10.46743/2160-3715/2022.5044 · Cited by 719 · see citing works
Luo (Jess), J. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2309963 · Cited by 366 · cited 2× · see citing works
“Luo (2024) and An et al. (2025) further stress the necessity of establishing clear, responsible use guidelines.”
McDonald, N., Johri, A., Ali, A., & Collier, A. H. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100121 · Cited by 295 · cited 1× · see citing works
“It’s widespread adoption, triggered concerns over academic integrity (Cotton et al. 2024), intellectual property, privacy, and equity (McDonald et al. 2025).”
Perkins, M., Furze, L., Roe, J., & MacVaugh, J. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/q3azde36 · Cited by 291 · cited 1× · see citing works
“Recent assessment frameworks and guidelines proposed within the sector have introduced several promising directions such as the traffic light systems (Corbin et al. 2025), the two-lane approach (Curtis, 2025), and the AI Assessment Scale (AIAS) (Perkins et al. 2024).”
Talk is cheap: why structural assessment changes are needed for a time of GenAI
Corbin, T., Dawson, P., & Liu, D. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2503964 · Cited by 107 · see citing works
Nikolic, S., Wentworth, I., Sheridan, L., Moss, S., Duursma, E., Jones, R. A., Ros, M., & Middleton, R. (2024) · Australasian Journal of Educational Technology · doi:10.14742/ajet.9643 · Cited by 102 · cited 1× · see citing works
“Institutional responses ranged from proactive adoption to cautious resistance, reflecting ongoing uncertainty about GenAI’s role in assessment design (Nikolic et al. 2024).”
Flagged first, then by citations
Research works printed but not linked: 28
- Almomani, H., Patel, N., & Donyai, P. (2023). News media coverage of the problem of purchasing fake prescription medicines on the internet: Thematic analysis. JMIR Form Res, 7, Article e45147. https://doi.org/10.2196/45147 · DOI
- An, Y., Yu, J. H., & James, S. (2025). Investigating the higher education institutions' guidelines and policies regarding the use of generative AI in teaching, learning, research, and administration. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-025-00507-3 · DOI
- Baskara, X. R. (2024). Generative AI as an enabler of sustainable education: theoretical perspectives and future directions. Br J Teach Educ Pedagog, 3(3), 122-134. https://doi.org/10.32996/bjtep.2024.3.3.9 · DOI
- Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27-40. h t t p s : / / d o i . o r g / 1 0 . 3 3 1 6 / Q R J 0 9 0 2 0 2 7 · DOI · Paper page
- o a Cabellos, B., de Aldama, C., & Pozo, J. I. (2024). University teachers' beliefs about the use of generative artificial intelligence for teaching and learning. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1468900 · DOI
- Chen, W., Boggero, A., Del Puente, G., Olcese, M., Prestia, D., Jahrami, H., Chalghaf, N., Guelmami, N., Azaiez, F., & Bragazzi, N. L. (2021). Googling for suicide-content and quality analysis of suicide-related websites: Thematic analysis. JMIR Form Res, 5(11), Article e29146. https://doi.org/10.2196/29146 · DOI
- Christodorescu M, Craven R, Feizi S, Gong N, Hoffmann M, Jha S, Jiang Z, Kamarposhti MS, Mitchell J, Newman J, Probasco E, Qi Y, Shams K, Turek M. Securing the future of GenAI: policy and technology. 2024. https://doi.org/10.48550/arXiv.2407.12999. · DOI
- Clarke, V., & Braun, V. (2013). Teaching thematic analysis: Overcoming challenges and developing strategies for effective learn- ing. Psychologist, 26(2), 1-13.
- Curtis, G. J. (2025). The two-lane road to hell is paved with good intentions: Why an all-or-none approach to generative AI, integrity, and assessment is insupportable. Higher Education Research and Development. h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 7 2 9 4 3 6 0 . 2 0 2 5 . 2 4 7 6 5 1 · DOI
- Danaher, J. (2024). Generative AI and the future of equality norms. Cognition, 251, Article 105906. h t t p s : / / d o i . o r / 1 0 . 1 0 1 6 / j . c o g n i t i o n . 4 . 1 0 5 9 · DOI
- Hsiao, C. H., & Tang, K. Y. (2025). Beyond acceptance: an empirical investigation of technological, ethical, social, and indi- vidual determinants of GenAI-supported learning in higher education. Education and Information Technologies, 30(8), 10725-10750. https://doi.org/10.1007/s10639-024-13263-0 · DOI
- Ilieva, G., Yankova, T., Ruseva, M., & Kabaivanov, S. (2025). A framework for generative AI-driven assessment in higher education. Information (Switzerland), 16(6). https://doi.org/10.3390/info16060472 · DOI
- Izadi, R., Bahrami, M. A., Sarikhani, Y., & Bastani, P. (2023). Qualitative document analysis on Iranian contents and trends of popu- lation policies: lessons learned and avenues for future. Heliyon. h t t p s : / / d o i . o r g / 1 0 . 1 0 1 6 / j . h e l i y o n . 2 0 2 3 . e 1 7 3 7 7 Ahangama International Journal of Educational Technology in Higher Education (2026) 23:9 · DOI
- Kallio, H., Voutilainen, A., Viinamäki, L., & Kangasniemi, M. (2020). In-service training to enhance the competence of health and social care professionals: a document analysis of web-based training reports. Nurse Education Today, 92, Article 104493. https://doi.org/10.1016/j.nedt.2020.104493 · DOI
- Kangwa, D., Msafiri, M. M., & Fute, A. (2025). Balancing innovation and ethics: promote academic integrity through support and effective use of GenAI tools in higher education. AI Ethics, 5(4), 3497-3530. https://doi.org/10.1007/s43681-025-00689-6 · DOI · Paper page
- Khreibi RA. Global guidance on the use of GenAI in educational research. In: Prompt engineering and generative AI applications for teaching and learning (pp. 53-66). IGI Global Scientific Publishing. 2025. h t t p s : / / d o i . o r g / 1 0 . 4 0 1 8 / 9 7 9 -8 -3 6 9 3 -7 3 3 2 -3 . c h 0 · DOI
- Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practice, 25(4), 6-20.
- Nguyen, A., Duong, A. T., Nguyen, D. T. B., Lai, V. T. T., & Dang, B. (2025). Guidelines for learning design and assessment for genera- tive artificial intelligence-integrated education: a unified view. Information and Learning Science. h t t p s : / / d o i . o r g / 1 0 . 1 1 0 8 / I L S -1 1 -2 0 2 4 -0 1 4 · DOI · Paper page
- Orr, S. H., Eberman, L. E., Rivera, M. J., Orr, S. H., & Eberman, L. E. (2024). Educational outcomes of the DAT: a document review and thematic analysis. Clinic Pract Athl Train, 7(1), 3.
- Pinho, I., Costa, A. P., & Pinho, C. (2025). Generative AI governance model in educational research. Front Educ. h t t p s : / / d o i . o r g / 1 0 . 3 3 8 9 / f e d u c . 2 0 2 5 . 1 5 9 4 3 · DOI
- Rasul, T., Nair, S., Kalendra, D., Balaji, M. S., Santini, FdeO., Ladeira, W. J., Rather, R. A., Yasin, N., Rodriguez, R. V., Kokkalis, P., Murad, M. W., & Hossain, M. U. (2024). Enhancing academic integrity among students in GenAI Era:A holistic framework. Int J Manag Educ, 22(3), Article 101041. https://doi.org/10.1016/j.ijme.2024.101041 · DOI · Paper page
- Sarshar, M., Yazdani, S., Jadidfard, M. P., & Shams, L. (2021). Thematic analysis of the policies of Iran's health higher education. Journal of Education Health Promotion, 10(1), Article 217. https://doi.org/10.4103/jehp.jehp_1063_20 · DOI
- Scarparolo, G., & Porta, T. (2025). Examining the Australian educational landscape of differentiation through document analysis. Australian Educational Researcher. https://doi.org/10.1007/s13384-025-00805-9 · DOI
- Shanto, S. S., Ahmed, Z., & Jony, A. I. (2025). A proposed framework for achieving higher levels of outcome-based learning using generative AI in education. Educ Technol Q, 2025(1), 1-15. https://doi.org/10.55056/etq.788 · DOI
- Shen Y, Wang Z, Fan Y. Ethical issues and value tensions in the context of GenAI-assisted learning. In: Learning with generative artificial intelligence. Routledge; 2025. pp. 222-253
- Tillmanns, T., Salomão Filho, A., Rudra, S., Weber, P., Dawitz, J., Wiersma, E., Dudenaite, D., & Reynolds, S. (2025). Mapping tomor- row's teaching and learning spaces: A systematic review on GenAI in higher education. Trends High Educ, 4(1), Article 2. https://doi.org/10.3390/higheredu4010002 · DOI
- Wang, C., Chen, Y., Hu, Z., Li, Y., & Gu, X. (2025). The journey of challenges and victories: exploring the transformation action framework in the GenAI era from multifaceted policies. Educational Technology Research and Development. h t t p s : / / d o i . o r g / 1 0 . 1 0 0 7 / s 1 1 4 2 3 -0 2 5 -1 0 5 3 5 -5 · DOI
- Zlotnikova, I., Hlomani, H., Mokgetse, T., & Bagai, K. (2025). Establishing ethical standards for GenAI in university education: A roadmap for academic integrity and fairness. Journal of Information, Communication and Ethics in Society, 23(2), 188-216. https://doi.org/10.1108/JICES-07-2024-0104 · DOI
Cited by
Sorted by citations
Peng, J. (2026) · World Journal of Educational Research · doi:10.22158/wjer.v13n2p127
- Authors
- Ahangama, N.
- Corresponding author
- Ahangama, Nadeera
- ORCID
- Ahangama, Nadeera
- Venue
- International Journal of Educational Technology in Higher Education
- Published
- 2026-03-04
- Volume
- 23
- Issue
- 1
- ISSN
- 2365-9440 (ISSN-L)
- OpenAlex
- W7133336059
- Cited by
- 21
- References
- 15
- Citations by year
- 2026: 21
- FWCI
- 95.42
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- International Journal of Educational Technology in Higher Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Safety Research › Academic integrity and plagiarism
- Keywords
- generative AI, assessment design, assessment reform, ICT education, higher education, graduate competencies, academic integrity, assessment validity, institutional governance, quality assurance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review