Artificial Intelligence for Student Assessment: A Systematic Review
Open accessThe DOI matches its Crossref record; 60 of the 61 references it cites were found in a registry or an index; 19 of the 73 sources its claims cite were checked for support.
Abstract
This paper analyzes the use of AI for student assessment based on a systematic review and concludes that pedagogy is often not reflected, formative evaluation is common, and more educationally focused research is needed.
Overview
CoChat Summary
TL;DR
This systematic review of 22 studies, selected from 454 initial records, finds that AI in student assessment is used mainly for formative assessment and automatic grading, while pedagogical models are often not reflected. It concludes that teacher training and more pedagogically focused research are needed, especially beyond higher education.
Key findings
- From 454 papers found, 449 remained after duplicates were removed, and 22 were selected; most selected studies focused on higher education, with some examples at secondary level, and the predominant author country was the USA (4 contributions), followed by Greece (3).
- Of the 22 selected papers, 15 had AI for formative assessment as their starting point, and 10 explicitly stated that the system used grades students automatically.
- Only one study clearly addressed pedagogical models underpinning AI use; three others mentioned pedagogical rationale, mainly collaboration or argument maps, and recent work focused more on technical aspects than pedagogy.
- Three studies compared AI use with non-use: Goel and Joyner found students who used AI performed better; Grivokostopoulou et al. found AI and manual grading were very similar and correlated; Samarakou et al. found those who used AI scored 17% higher than those who did not.
Methods
- Systematic review following the PRISMA Statement, searching Scopus and Web of Science in March 2021 with terms including “Artificial Intelligence,” “Machine Learning,” “Education,” “Assessment,” and “Evaluation”; inclusion criteria were peer-reviewed empirical research published 2010–2020 in English or Spanish.
- Titles and abstracts were evaluated independently by two reviewers using Rayyan in blind mode, with a third party resolving discrepancies; full texts were then reviewed, and coding/data extraction used Rayyan tags, a spreadsheet, and Mendeley.
- After screening, 339 studies were excluded after title/abstract review, 68 full texts were discarded for not meeting criteria, and 10 were excluded for lack of access, leaving 22 studies for analysis.
Limitations
- The paper states that the study found a small number of articles focused on student assessment relative to the large number of AI applications, and it calls for further research, mainly at educational levels other than higher education, plus teacher training.
- The paper states that the method was applied rigorously to guarantee validity relative to the eligibility criteria.
- Evident from the text: the search was limited to Scopus and Web of Science, English and Spanish, and 2010–2020; 10 full texts were excluded because they were not accessible; the final set of 22 studies was mostly higher education and STEM/health contexts, limiting generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
16 Valid · 4 Not valid · 24 Not checked · 43 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“three of them determine the need to give early feedback as an essential aspect in the educational process [22,37,42]”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4.2. Pedagogical Model Used
What the sources say
- Not matchedcites [22] Samarakou, 2016, Evaluation of an intelligent open learning system for engineering education, Knowl. Manag. E-Learning Int. J.
We searched by its title and found no matching paper.
- Not matchedcites [37] Ouguengay, 2015, A neuro-fuzzy inference system for the evaluation of reading/writing competencies acquisition in an e-learning environnement, J. Theor. Appl. Inf. Technol.
We searched by its title and found no matching paper.
- Supportedcites [42] Grivokostopoulou, 2017, An Educational System for Learning Search Algorithms and Automatically Assessing Student Performance, Int. J. Artif. Intell. Educ. source
The Feedback Provision section (page not provided) calls feedback an important factor in learning and says the system provides meaningful, immediate feedback. This supports the claim as it applies to this cited work; the other two cited works are not assessed here. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is only one study [18] that clearly addresses aspects related to pedagogical models that support the work to be developed subsequently.”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4.2. Pedagogical Model Used
What the sources say
- Supportedcites [18] Conejo, 2013, Statistical Techniques to Explore the Quality of Constraints in Constraint-Based Modeling Environments, Int. J. Artif. Intell. Educ. source
The paper is a study of constraint-based models for learning environments. Its Constraint-Based Modeling section says that estimates of student knowledge drive instructional strategies and discusses improving a tutor’s pedagogical actions. The claim’s judgment that this is the only relevant study belongs to the citing authors, not to the cited paper. (LLM, conf=0.84)
boostedSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“On the other hand, the work of Grivokostopoulou et al. [42] made a comparison between the results obtained with AI and the teaching assessments made by hand to check the accuracy of this technology.”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4.5. Comparison between IA Use and Non-Use
What the sources say
- Supportedcites [42] Grivokostopoulou, 2017, An Educational System for Learning Search Algorithms and Automatically Assessing Student Performance, Int. J. Artif. Intell. Educ. source
The Results section says the authors compared the automated assessment system with the tutor’s assessment, using accuracy and other metrics. The passage does not give a page number. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Three other studies [21,38,39] also hint at their pedagogical rationale, which is mainly based on collaboration.”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 5. Discussion and Conclusions
What the sources say
- Supportedcites [21] Santos, 2014, Involving Users to Improve the Collaborative Logical Framework, Sci. World J. source
The Background describes collaborative learning as engaging students through social interaction and developing teamwork skills. That supports the citing sentence’s characterization of this study’s pedagogical rationale as mainly based on collaboration. (LLM, conf=0.91)
- Supportedcites [38] Kaila, 2016, Redesigning an Object-Oriented Programming Course, ACM Trans. Comput. Educ. source
The Abstract (page unavailable) says the redesign focused on active learning methods and student collaboration. The Introduction and “Step 2: Encouraging Collaboration” (pages unavailable) explain why collaboration was incorporated and how it shaped the tutorials. This supports the citing sentence’s hedged characterization of the study’s pedagogical rationale. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [39] Rapanta, 2016, The Use of Argument Maps as an Assessment Tool in Higher Education, Int. J. Educ. Res. source
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“As for the papers that focus on formative assessment, it is clear that the idea of using AI for this task lies in the help that this technology can provide to teachers when they have a large number of students [41], or based on the idea that learning improves the more immediate the feedback given to students [21].”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 5. Discussion and Conclusions
What the sources say
- Could not verifycites [21] Santos, 2014, Involving Users to Improve the Collaborative Logical Framework, Sci. World J. sourceExperimental — accuracy not yet measured
Section 4, “Formative Evaluation” (page unavailable), describes user studies to improve the design of a collaborative learning tool, not formative assessment of students. Section 3.3.3 describes personalized recommendations, but does not say that learning improves when students receive feedback sooner. Searches for immediate feedback and timely feedback found no passage establishing the attributed claim. (LLM, conf=0.76)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
36 more claims · 2 with their cited sources checked
Create a free account to see all 87 claims and to verify the 3 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 16
- Borderline: one of the tests for a substantial claim is unclear. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It can revolutionize the way assessments are conducted by providing real-time feedback to students [23].”
From New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Specifically, AI can be trained to grade a range of subjects and assessments including essays, problem-solving questions, and even graphing assessments [23].”
From New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023) · cites this paper as [23]
Experimental — accuracy not yet measuredIn the citing paper
“These outcomes highlight the fact that machines are far from human intelligence and emotions and cannot undertake the role of teachers (González-Calatayud et al., 2021;Zhang & Aslan, 2021).”
From A systematic review of literature reviews on artificial intelligence in education (AIED): a roadmap to a future research agenda (2024) · cites this paper as González-Calatayud et al., 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Artificial Intelligence for Student Assessment: A Systematic Review > 5. Discussion and Conclusions
“| Phattanapon et al. [36] | 2011 | Artificial intelligence in medicine | Thailand | Computer science and Dentistry | Dental study |”
§ Artificial Intelligence for Student Assessment: A Systematic Review > References
“36. Rhienmora, P.; Haddawy, P.; Suebnukarn, S.; Dailey, M.N. Intelligent dental training simulator with objective skill assessment and feedback.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Artificial Intelligence for Student Assessment: A Systematic Review > 5. Discussion and Conclusions
“only 22 studies are mainly focused on student assessment.The majority of them have been published in the last five years, and in the USA.”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 5. Discussion and Conclusions
“| USA | 4 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Of the 449 articles reviewed after eliminating duplicates, a total of 339 studies were excluded because they did not comply with the established criteria after reading the abstract and title.The full text of the remaining 100 papers was reviewed”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4. Results
Reported 100 · recomputed 110
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4.5. Comparison between IA Use and Non-Use
“four levels related to student grades”
§ Artificial Intelligence for Student Assessment: A Systematic Review > 4.5. Comparison between IA Use and Non-Use
“very low, low, medium, good, and excellent”
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2_v1 · Cited by 8,090
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
An Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Chatterjee, S., & Bhattacharjee, K. K. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10159-7 · Cited by 747 · cited 1×
“Chatterjee and Bhattacharjee [26] analyze AI to manage resources on educational organizations.”
BackgroundHuman- versus Artificial Intelligence
Korteling, J. E. (., van de Boer-Visschedijk, G. C., Blankendaal, R. A. M., Boonekamp, R. C., & Eikelboom, A. R. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.622364 · Cited by 619
Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies
Cope, B., Kalantzis, M., & Searsmith, D. (2021) · Educational Philosophy and Theory · doi:10.1080/00131857.2020.1728732 · Cited by 518 · cited 3×
“The comparison between human and artificial intelligence is really interesting [7,8].”
BackgroundDesign of online intelligent English teaching platform based on artificial intelligence techniques
Sun, Z., Anbarasan, M., & Praveen Kumar, D. (2021) · Computational Intelligence · doi:10.1111/coin.12351 · Cited by 409 · cited 3×
“[46] indicates that “artificial intelligence (AI) is the combination of intelligence, that is, machines capable of demonstrating human intelligence and of making decisions with human skills”; AI is therefore intended to “build highly advanced machines that can make smart decisions” (p.”
BackgroundEnabling Technologies for Urban Smart Mobility: Recent Trends, Opportunities and Challenges
Paiva, S., Ahad, M., Tripathi, G., Feroz, N., & Casalino, G. (2021) · Sensors · doi:10.3390/s21062143 · Cited by 395 · cited 1×
“AI is applied to different contexts, so we can see applications to architecture in smart buildings and smart cities [6], smart mobility [9], medicine [10–12], smart industry (the 4th industrial revolution, as some authors [13] remark) and also smart education or smart classrooms [14].”
BackgroundInteligencia artificial y sus implicaciones en la educación superior
Ocaña-Fernández, Y., Valenzuela-Fernández, L. A., & Garro-Aburto, L. L. (2019) · Propósitos y Representaciones · doi:10.20511/pyr2019.v7n2.274 · Cited by 358
Research works printed but not linked: 1
- Ouguengay, 2015, A neuro-fuzzy inference system for the evaluation of reading/writing competencies acquisition in an e-learning environnement, J. Theor. Appl. Inf. Technol., 81, 600
Cited by
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181
New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution
Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023) · Sustainability · doi:10.3390/su151612451 · Cited by 1,089
“Specifically, AI can be trained to grade a range of subjects and assessments including essays, problem-solving questions, and even graphing assessments [27].”
BackgroundArtificial Intelligence in Education: A Systematic Literature Review
Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124167 · Cited by 977
Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions
Kooli, C. (2023) · Sustainability · doi:10.3390/su15075614 · Cited by 666
Artificial Intelligence in Education: AIEd for Personalised Learning Pathways
Tapalova, O., & Zhiyenbayeva, N. (2022) · Electronic Journal of e-Learning · doi:10.34190/ejel.20.5.2597 · Cited by 633
Discourses of artificial intelligence in higher education: a critical literature review
Bearman, M., Ryan, J., & Ajjawi, R. (2023) · Higher Education · doi:10.1007/s10734-022-00937-2 · Cited by 545
“While there are some publications outside of the journals listed in Table 1, particularly in the field of feedback and assessment (e.g. Bearman & Luckin, 2020; González-Calatayud et al., 2021), there is scope for further inquiry, particularly empirical work (Bates et al., 2020).”
BackgroundOkunlaya, R. O., Syed Abdullah, N., & Alias, R. A. (2022) · Library Hi Tech · doi:10.1108/lht-07-2021-0242 · Cited by 333
Halkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328
“By leveraging learner models, AA can select appropriate test questions from a large pool based on the student’s abilities and learning style [86–89].”
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100156 · Cited by 309
Mustafa, M. Y., Tlili, A., Lampropoulos, G., Huang, R., Jandrić, P., Zhao, J., Salha, S., Xu, L., Panda, S., Kinshuk, et al. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00350-5 · Cited by 235
“We need to prioritize a responsible approach that fosters critical AI literacy among all stakeholders and the society at large (González-Calatayud et al., 2021).”
InfluentialTrabelsi, Z., Alnajjar, F., Parambil, M. M. A., Gochoo, M., & Ali, L. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010048 · Cited by 212
Fu, Y., & Weng, Z. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100306 · Cited by 195
Artificial Intelligence Applications in K-12 Education: A Systematic Literature Review
Zafari, M., Bazargani, J. S., Sadeghi-Niaraki, A., & Choi, S.-M. (2022) · IEEE Access · doi:10.1109/access.2022.3179356 · Cited by 185
Zheng, L., Niu, J., Zhong, L., & Gyasi, J. F. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2015693 · Cited by 183
Khlaif, Z. N., Ayyoub, A., Hamamra, B., Bensalem, E., Mitwally, M. A. A., Ayyoub, A., Hattab, M. K., & Shadid, F. (2024) · Education Sciences · doi:10.3390/educsci14101090 · Cited by 177
Generative AI in Education: Pedagogical, Theoretical, and Methodological Perspectives
Noroozi, O., Soleimani, S., Farrokhnia, M., & Banihashem, S. K. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.845 · Cited by 165
“Furthermore, GenAI can offer educators efficient, accurate, and impartial assessment services by automating the grading of homework (González-Calatayud et al., 2021).”
A qualitative systematic review on AI empowered self-regulated learning in higher education
Lan, M., & Zhou, X. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00319-0 · Cited by 159
Jukiewicz, M. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101522 · Cited by 126
Artificial Intelligence in Education: Mathematics Teachers’ Perspectives, Practices and Challenges
Tashtoush, M. A., Wardat, Y., AlAli, R. M., & Saleh, S. G. (2024) · Iraqi Journal for Computer Science and Mathematics · doi:10.52866/ijcsm.2024.05.01.004 · Cited by 183
“Teachers' impressions of AIED systems differ depending on their pedagogical beliefs, teaching experiences, prior experience with educational technology, and the effectiveness and necessity of a specific technology, which may influence their desire to accept new educational technology [10, 15].”
BackgroundOpesemowo, O. A. G., & Adekomaya, V. (2024) · International Journal of Learning, Teaching and Educational Research · doi:10.26803/ijlter.23.3.4 · Cited by 113
Gökçearslan, Ş., Tosun, C., & Erdemir, Z. G. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.600 · Cited by 112
“…sciences include the use of AI in language education (Liang et al., 2023), artificial intelligence in teacher education (Salas-Pilco et al., 2020), trends in AI-supported e-learning (Tang et al., 2023), and the use of artificial intelligence for assessment (González-Calatayud et al., 2021).”
BackgroundAljuaid, H. (2024) · Arab World English Journal · doi:10.24093/awej/chatgpt.2 · Cited by 129
“Third, learners and educators hold that AI influences creative thinking in terms of better and instant feedback (Chiu et al., 2023; González-Calatayud et al., 2021) and improved time management (Akgun & Greenhow, 2022; Fyfe, 2023; Gardner et al., 2021).”
BackgroundFošner, A. (2024) · Sustainability · doi:10.3390/su16198668 · Cited by 183
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100284 · Cited by 91
Chou, C.-M., Shen, T.-C., Shen, T.-C., & Shen, C.-H. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10866-9 · Cited by 139
“…models and learning analytics has spurred personal tutors, intelligent support for collaborative learning, and intelligent virtual reality categories of AI software applications in education (González-Calatayud et al., 2021; Guan et al., 2020; Luckin et al., 2016; Zawacki-Richter et al., 2019).”
BackgroundKhairullah, S. A., Harris, S., Hadi, H. J., Sandhu, R. A., Ahmad, N., & Alshara, M. A. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1548104 · Cited by 207
Role of AI in Blended Learning: A Systematic Literature Review
Park, Y., & Doo, M. Y. (2024) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v25i1.7566 · Cited by 81
“…studies have attempted to clarify the various concepts (Caner, 2012; Cronje, 2020; Driscoll, 2002; Friesen, 2012), develop several models (Graham et al., 2013), and categorize the cases of blended learning (Graham, 2006; Horn & Staker, 2014; Margulieux et al., 2016; Park et al., 2016; Singh, 2003).”
BackgroundInfluentialHwang, S. (2022) · Sustainability · doi:10.3390/su142013185 · Cited by 80
Advancements in artificial intelligence transforming medical education: a comprehensive overview
Khakpaki, A. (2025) · Medical Education Online · doi:10.1080/10872981.2025.2542807 · Cited by 128
“AI-powered tools enable automated grading, real-time feedback, and performance tracking, optimizing the assessment process and providing personalized learning pathways for medical students [26–28].”
Artificial Intelligence in Health Professions Education assessment: AMEE Guide No. 178
Masters, K., MacNeil, H., Benjamin, J., Carver, T., Nemethy, K., Valanci-Aroesty, S., Taylor, D. C. M., Thoma, B., & Thesen, T. (2025) · Medical Teacher · doi:10.1080/0142159x.2024.2445037 · Cited by 80
“…learning activities, adapt-ability, automation, and feasibility to promote self-regulated learning and performance prediction of the learner [53,54], providing frequent feedback to learners in real-time to develop specific skills, leading to enhanced learning outcomes while providing…”
Chen, A., Zhang, Y., Jia, J., Liang, M., Cha, Y., & Lim, C. P. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13064 · Cited by 67
A Review of Artificial Intelligence Adoption in Second-Language Learning
Almelhes, S. (2023) · Theory and Practice in Language Studies · doi:10.17507/tpls.1305.21 · Cited by 78
Kooli, C., & Yusuf, N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2338330 · Cited by 63
ChatGPT and higher education assessments: More opportunities than concerns?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.2.32 · Cited by 60
Could the Use of AI in Higher Education Hinder Students With Disabilities? A Scoping Review
Pierrès, O., Christen, M., Schmitt-Koopmann, F. M., & Darvishy, A. (2024) · IEEE Access · doi:10.1109/access.2024.3365368 · Cited by 59
The Use of Mixed, Augmented and Virtual Reality in History of Art Teaching: A Case Study
Almenara, J. C., Cejudo, M. D. C. L., & Martínez-Roig, R. (2022) · Applied System Innovation · doi:10.3390/asi5030044 · Cited by 82
Redefining creative education: a case study analysis of AI in design courses
Zailuddin, M. F. N. O., Harun, N. A. N., Rahim, H. A. A., Kamaruzaman, A. F., Berahim, H., Harun, M. H., & Ibrahim, Y. (2024) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-01-2024-0019 · Cited by 117
Examining AI Use in Educational Contexts: A Scoping Meta-Review and Bibliometric Analysis
Fu, Y., Weng, Z., & Wang, J. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00442-w · Cited by 57
Shishehgar, S., Murray‐Parahi, P., Alsharaydeh, E., Mills, S., & Liu, X. (2025) · International Nursing Review · doi:10.1111/inr.70045 · Cited by 133
“Previous research into AI in health education and practice has focused on educational outcomes (Feigerlova et al. 2025), the use of generative AI in student assessment, and student perceptions of using AI (González-Calatayud et al. 2021).”
Revell, T., Yeadon, W., Cahilly-Bretzin, G., Clarke, I., Manning, G., Jones, J., Mulley, C., Pascual, R. J., Bradley, N., Thomas, D., et al. (2024) · International Journal for Educational Integrity · doi:10.1007/s40979-024-00161-8 · Cited by 51
“In contrast, the humanities, a field rich in nuance and interpretation, remains underrepresented in AI assessment explorations (González-Calatayud et al. 2021).”
BackgroundAlejandro, I. M. V., Sanchez, J. M. P., Sumalinog, G. G., Mananay, J. A., Goles, C. E., & Fernandez, C. B. (2024) · STEM Education · doi:10.3934/steme.2024024 · Cited by 74
Henadirage, A., & Gunarathne, N. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00439-5 · Cited by 48
“For instance, González-Calatayud et al. (2021) and Akgun and Greenhow (2021) discovered that AI including GenAI has been embraced for the automated assessment of student work.”
A Systematic Review of Generative AI and (English Medium Instruction) Higher Education
Bannister, P., Santamaría-Urbieta, A., & Alcalde-Peñalver, E. (2023) · Aula Abierta · doi:10.17811/rifie.52.4.2023.401-409 · Cited by 48
Between tech and text: the use of generative AI in Palestinian universities - a ChatGPT case study
Hamamra, B., Mayaleh, A., & Khlaif, Z. N. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2380622 · Cited by 47
Garcia, M. B., Arif, Y. M., Khlaif, Z. N., Zhu, M., Almeida, R., de Almeida, R. S., & Masters, K. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-3661-8.ch001 · Cited by 49
Denecke, K., Glauser, R., & Reichenpfader, D. (2023) · Trends in Higher Education · doi:10.3390/higheredu2040039 · Cited by 87
Öğrencilerin Yapay Zeka Okuryazarlığı Üzerine Bir İnceleme
Elçiçek, M. (2024) · Bilgi ve İletişim Teknolojileri Dergisi · doi:10.53694/bited.1460106 · Cited by 65
Mixed, Augmented and Virtual, Reality Applied to the Teaching of Mathematics for Architects
Almenara, J. C., Osuna, J. B., & Martínez-Roig, R. (2021) · Applied Sciences · doi:10.3390/app11157125 · Cited by 57
“Our last reflections will focus on possible lines of research for the future, amongst which stand out: systematic reviews [64,65], replicating the research work with other students enrolled in architecture studies, even from other universities, complementing the information collection tools with a test to analyze acad…”
BackgroundKumar, S., Gunn, A., Rose, R., Pollard, R., Johnson, M. C., & Ritzhaupt, A. D. (2024) · Online Learning · doi:10.24059/olj.v28i3.4501 · Cited by 78
“Systematic reviews of AIEd note that there is often a lack of critical examination of ethical implications when integrating AI in education (Gonzalez-Calatayud et al., 2021; Zawacki-Ricker et al., 2019; Zhang & Aslan, 2021), however, IDs in this study reflected deeply on ethical concerns, including…”
Ethical Considerations for Artificial Intelligence in Educational Assessments
Lim, T., Gottipati, S., & Cheong, M. L. F. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0205-7.ch003 · Cited by 75
Fokides, E., & Peristeraki, E. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12912-8 · Cited by 72
“This characteristic positions ChatGPT as a tool with significant potential to advance the feedback process across a variety of educational assessments, including but not limited to multiple-choice, essay, fill-in-the-blanks, and short-answer formats (González-Calatayud et al., 2021; Sein, 2022).”
Chat or cheat? Academic dishonesty, risk perceptions, and ChatGPT usage in higher education students
Ortiz-Bonnin, S., & Blahopoulou, J. (2025) · Social Psychology of Education · doi:10.1007/s11218-025-10080-2 · Cited by 80
Xiao, Y., Zhang, T., & He, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37238 · Cited by 64
“For instance, research indicates that AI chatbots can reduce language learning anxiety by providing a low-pressure environment for practice, where learners can converse freely without the fear of judgment [16].”
BackgroundRetractedImpact of Artificial Intelligence On Higher Learning Institutions
Lainjo, B., & Tsmouche, H. (2023) · International Journal of Education Teaching and Social Sciences · doi:10.47747/ijets.v3i2.1028 · Cited by 63
King, S. A., Boyer, J., Bell, T., & Estapa, A. T. (2022) · JMIR Serious Games · doi:10.2196/41097 · Cited by 57
“Although absent from studies of teacher training, artificial intelligence (AI)—or software capable of independently acquiring, processing, and acting upon information [20]—is emerging as a force in education through the growing implementation of chatbots, automated assessment, facial recognition, and other functions t…”
BackgroundIntegration of AI with Higher Education Innovation: Reforming Future Educational Directions
Shi, J., & Xuwei, Z. (2023) · International Journal of Science and Research (IJSR) · doi:10.21275/sr231023183401 · Cited by 72
A Review of Artificial Intelligence in K-12 Education
Azzam, A., & Charles, T. (2024) · Open Journal of Applied Sciences · doi:10.4236/ojapps.2024.148137 · Cited by 37
Cabellos, B., de Aldama, C., & Pozo, J.-I. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1468900 · Cited by 35
AI in medical education: uses of AI in construction type A MCQs
Rezigalla, A. A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05250-3 · Cited by 36
“In medical education, AI applications have been linked to feedback, simulation-based training in medicine, adaptive learning systems, generated assessment tasks, self-assessment, automatic student work scores, and virtual operative assistant creation [18].”
BackgroundA Method for Predicting the Academic Performances of College Students Based on Education System Data
Liu, C., Wang, H., & Yuan, Z. (2022) · Mathematics · doi:10.3390/math10203737 · Cited by 45
The Role of Artificial Intelligence in Shaping the Future of Education: Opportunities and Challenges
Іванашко, О., Козак, А., Knysh, T., & Honchar, K. (2024) · Futurity Education · doi:10.57125/fed.2024.03.25.08 · Cited by 60
“Other concerns are related to a digital divide between AI-enhanced learning experiences and resource-limited classroom (Kamalov et al., 2023), assessment of students’ emotions or behaviors (González -Calatayud et al., 2021; Leon et al., 2023).”
BackgroundTorre, D. M., & Schuwirth, L. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2409936 · Cited by 41
“For example, the Virtual Operative Assistant in medicine offers automatic feedback to students based on predetermined performance metrics [117].”
Kotsis, K. Τ. (2024) · European Journal of Contemporary Education and E-Learning · doi:10.59324/ejceel.2024.2(3).04 · Cited by 41
Kaliisa, R., Misiejuk, K., López-Pernas, S., & Saqr, M. (2026) · Educational Psychology · doi:10.1080/01443410.2025.2553639 · Cited by 33
“Such real-time responsiveness can enhance the learning experience, as students are provided with actionable assessments that can be immediately incorporated into their study strategies (gonzález-Calatayud et al., 2021).”
Han, B., Nawaz, S., Buchanan, G., & McKay, D. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00456-4 · Cited by 32
“…2019 ), address educational challenges such as institutional retention and students’ experiences (Colvin et al., 2016 ), assess students’ performance (González-Calatayud et al., 2021 ), identify ‘at-risk’ students (Queiroga et al., 2022 ), visualize learning patterns and provide automated feedback…”
Evaluating the evaluators: a comparative study of AI and Teacher Assessments in Higher Education
Coşkun, T. K., & Alper, A. (2024) · Digital Education Review · doi:10.1344/der.2024.45.124-140 · Cited by 58
Deroncele-Acosta, Á., Sayán-Rivera, R. M. E., López, Á. D. M., & Norabuena-Figueroa, E. (2025) · Applied System Innovation · doi:10.3390/asi8030083 · Cited by 77
de la Torre, A., & Baldeon-Calisto, M. (2024) · International Symposium on Digital Forensics and Security (ISDFS) · doi:10.1109/isdfs60797.2024.10527283 · Cited by 62
“For instance, Gonz´alez-Calatayud, Prendes-Espinosa, & Roig-Vila [16] concentrated on the utilization of AI for student assessment, while Pinto, Abreu, Costa, & Paiva [17] directed their attention towards machine learning’s ability to predict student’s performance and employability, grading…”
BackgroundGRAD-AI: An automated grading tool for code assessment and feedback in programming course
Gambo, I., Abegunde, F.-J., Gambo, O. O., Ogundokun, R. O., Babatunde, A. N., & Lee, C. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13218-5 · Cited by 50
“…areas: learning with AI (utilizing AI tools in education), learning about AI (educating individuals on the use of AI tools in education), and preparing for AI (understanding the transformative potential of these tools) (González-Calatayud et al., 2021; Liu et al., 2024a, b, c; Xu et al., 2024a, b).”
The Impact of AI on Inclusivity in Higher Education: A Rapid Review
Conceição, J. M. C., & van der Stappen, E. (2025) · Education Sciences · doi:10.3390/educsci15091255 · Cited by 52
“The two main advantages revolve around time saving for educators and helping students understand their mistakes and learn more effectively (Hooda et al., 2022; Hahn et al., 2021; Calatayud et al., 2021).”
Misiejuk, K., López-Pernas, S., Kaliisa, R., & Saqr, M. (2025) · Journal of Learning Analytics · doi:10.18608/jla.2025.8591 · Cited by 30
Sánchez, J. L. S., & Moreno-García, J. (2024) · Edutec Revista Electrónica de Tecnología Educativa · doi:10.21556/edutec.2024.89.3577 · Cited by 79
Flipped Learning and Artificial Intelligence
López-Villanueva, D., Campión, R. S., & Palau, R. (2024) · Electronics · doi:10.3390/electronics13173424 · Cited by 47
Agostini, D., & Picasso, F. (2024) · Intelligenza Artificiale · doi:10.3233/ia-240033 · Cited by 46
“Improved parallelisation, reduced training time, and better benchmarks in several tasks compared to the once prevalent recursive and convolutional neural networks [63] have been crucial to its success.”
Dumitru, C., Muttashar Abdulsahib, G., Ibrahim Khalaf, O., & Bennour, A. (2026) · Technology and Disability · doi:10.1177/10554181251355428 · Cited by 27
Preparing Teachers of the Future in the Era of Artificial Intelligence
Isma’il, A., Aliu, A., Ibrahim, M., & Sulaiman, A. (2024) · Journal of Artificial Intelligence Machine Learning and Neural Network · doi:10.55529/jaimlnn.44.31.41 · Cited by 80
Who is Helping Whom? Student Concerns about AI-Teacher Collaboration in Higher Education Classrooms
Han, B., Coghlan, S., Buchanan, G., & McKay, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711104 · Cited by 31
Transmission Network Planning in Super Smart Grids: A Survey
Adnan, M., Ghadi, Y. Y., Ahmed, I., & Ali, M. (2023) · IEEE Access · doi:10.1109/access.2023.3296152 · Cited by 34
Exploring Educators’ Perceptions: Artificial Intelligence Integration in Higher Education
Amado-Salvatierra, H. R., Morales, M., Hernández-Rizzardini, R., & Rosales, M. (2024) · IEEE World Engineering Education Conference (EDUNINE) · doi:10.1109/edunine60625.2024.10500578 · Cited by 38
“AI also plays a key role in creating adaptive, personalized learning environments by analyzing student data to tailor educational content [10].”
BackgroundEthical use of artificial intelligence and new technologies in Education 5.0
Smyrnaiou, Z., Liapakis, A., & Bougia, A. (2023) · Journal of Artificial Intelligence, Machine Learning and Data Science · doi:10.51219/jaimld/anastasios-liapakis/15 · Cited by 22
Sow, S., Ranjan, S., Seleiman, M. F., Alkharabsheh, H. M., Kumar, M., Kumar, N., Padhan, S. R., Roy, D. K., Nath, D., Gitari, H. I., et al. (2024) · Phyton · doi:10.32604/phyton.2024.052241 · Cited by 44
Iranmanesh, A., & Lotfabadi, P. (2024) · AI & Society · doi:10.1007/s00146-024-02111-x · Cited by 34
Nathaniel, J., Oyelere, S. S., Suhonen, J. T., & Tedre, M. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100460 · Cited by 58
“…Koutcheme et al., 2023; Wermelinger, 2023), automatically generating programming exercises (Zavala & Mendoza, 2018), improving error messages (Leinonen et al., 2023), creating debugging quizzes (Logacheva et al., 2024), and automating grading (Gonz ´ alez-Calatayud et al., 2021; Ho et al., 2024).”
Transforming Rural and Underserved Schools with AI-Powered Education Solutions
Leong, W. Y. (2024) · ASM Science Journal · doi:10.32802/asmscj.2023.1895 · Cited by 22
Setyaningsih, E., Asrori, M., Ngadiso, Sumardi, S., Zainnuri, H., & Hariyanti, Y. (2024) · Voices of English Language Education Society · doi:10.29408/veles.v8i3.27700 · Cited by 52
“However, as González-Calatayud et al. (2021) noted, early studies up to 2020 largely emphasized technical aspects of AI, often neglecting the underlying pedagogical frameworks.”
Costa, M. L. (2025) · Education Sciences · doi:10.3390/educsci15030352 · Cited by 21
“This aligns with existing research (C.-H. Chen & Chang, 2024; Heeg & Avraamidou, 2023; González-Calatayud et al., 2021) highlighting AI’s potential for personalized learning, targeted assistance, and improved teaching methodologies.”
Teaching and Learning with AI in Higher Education: A Scoping Review
Kuka, L., Hörmann, C., & Sabitzer, B. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-04286-7_26 · Cited by 22
Innovations in Introductory Programming Education: The Role of AI with Google Colab and Gemini
Llerena-Izquierdo, J., Reyes, J. M., Ayala-Carabajo, R., & Martínez, C. M. A. (2024) · Education Sciences · doi:10.3390/educsci14121330 · Cited by 62
Teckwani, S. H., Wong, A. H., Luke, N. V., & Low, I. C. C. (2024) · AJP Advances in Physiology Education · doi:10.1152/advan.00137.2024 · Cited by 33
Almubarak, A., Alhalabi, W., Albidewi, I., & Alharbi, E. (2024) · Discover Applied Sciences · doi:10.1007/s42452-024-06117-4 · Cited by 25
“Researchers and educators worldwide have been interested in incorporating AI into evaluating several aspects of the education field, including students, teachers, content, teaching, etc. [27, 28].”
Sreedhar, R., Chang, L., Gangopadhyaya, A., Shiels, P. W., Loza, J., Chi, E., Gabel, E., & Park, Y. S. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-09050-9 · Cited by 29
“6 LLMs can use a dialogue-based format to analyze written responses, 12 but unlike NLP and ML, they do not require significant effort or expertise to achieve desired outcomes.”
Lim, T., Gottipati, S., & Cheong, M. L. F. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00556-8 · Cited by 41
“…and complexity in AI systems, emphasizing the importance of simpler models when feasible, and the necessity of a sound theoretical basis for applying AI in assessments, incorporating pedagogical principles and AI training for meaningful implementation (González-Calatayud et al., 2021).”
Uso de tecnologías avanzadas para la educación científica
Arabit-García, J., García-Tudela, P. A., & Espinosa, M. P. P. (2021) · Revista Iberoamericana de Educación · doi:10.35362/rie8714591 · Cited by 51
“En González-Calatayud et al. (2021) se desarrolla una revisión sistemática de la literatura a través de la que se recogen numerosos ejemplos de sistemas de tutoría y sistemas de evaluación apoyados en la inteligencia artificial.”
BackgroundSelf-citationQuo Vadis, University? A Roadmap for AI and Ethics in Higher Education
Sirvent, F. C., Roger‐Monzó, V., & Rodrigues, R. G. (2024) · The Electronic Journal of e-Learning · doi:10.34190/ejel.22.6.3267 · Cited by 43
Quince, Z., & Nikolic, S. (2025) · European Journal of Engineering Education · doi:10.1080/03043797.2025.2482830 · Cited by 47
“Most AI assessment implementations conducted to date have focussed on using formative assessment to guide feedback (González-Calatayud, Prendes-Espinosa, and Roig-Vila 2021).”
Akinsemolu, A. A., & Onyeaka, H. N. (2025) · Journal of language and Education · doi:10.17323/jle.2025.22118 · Cited by 40
Integration of AI helping teachers in traditional teaching roles
Jiménez, A. F. (2024) · European Public & Social Innovation Review · doi:10.31637/epsir-2024-664 · Cited by 32
“It can provide support for non-native English speakers and create a dynamic, interactive classroom (González-Calatayud et al., 2021).”
BackgroundInfluentialGenerative AI and the social functions of educational assessment
Broadfoot, P., & Rockey, J. C. (2025) · Oxford Review of Education · doi:10.1080/03054985.2025.2455549 · Cited by 24
“González-Calatayud et al. (2021) conducted a systematic review of 452 academic papers in the field of AI and assessment more generally and concluded that the two main uses were formative evaluation on the one hand and the automatic grading of students on the other.”
Principal Leadership in Developing the Competence of Islamic Religious Education Teachers
Illah, A., Mansur, R., Hidayatullah, M. F., et al. (2022) · Nidhomul Haq Jurnal Manajemen Pendidikan Islam · doi:10.31538/ndh.v7i3.2658 · Cited by 17
“416 | Nidhomul Haq, Vol 7, Issue 3, 2022 is rote, the supporting teacher will automatically be required to memorize it first before carrying out teaching and assessment (Dick & Carey, 1977; González-Calatayud et al., 2021).”
BackgroundArtificial Intelligence in Anatomy Teaching and Learning: A Literature Review
Pandurangam, G., Gurajala, S., & Nagajyothi, D. (2024) · National Journal of Clinical Anatomy · doi:10.4103/njca.njca_103_24 · Cited by 25
Metadata
- Authors
- González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R.
- Affiliations
- Department of Statistics, Mathematics and Computer Sciences, Miguel Hernández University, 03202 Elche, Spain
- Department of Didactic and School Organization, University of Murcia, 30100 Murcia, Spain
- University of Alicante (ES)
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2021-06-12
- Volume
- 11
- Issue
- 12
- Pages
- 5467
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3171148899
- Semantic Scholar
- 783dead4fd1aa29ee019a2f324e859a6b3dcb332
- Cited by
- 503
- References
- 59
- Citations by year
- 2026: 87 · 2025: 167 · 2024: 169 · 2023: 51 · 2022: 24 · 2021: 5
- FWCI
- 9.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Educational Technology and Pedagogy
- Keywords
- artificial intelligence in education, student assessment, automated grading, formative assessment, AI-based tutoring, teacher professional development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.