A Conceptual Framework for Human–AI Hybrid Adaptivity in Education
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Continuously interwoven explanation of AI behavior and exploratory adaptation can improve both AI and human learning.
“Continuously interwoven explanation of AI behavior and exploratory adaptation can improve both AI and human learning (Holstein et al. 2020).”
From Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence (2023) · cites this paper as Holstein et al. 2020
The Conceptual Framework section (page unavailable) describes co-learning in which humans and AI help one another improve over time. Decision Augmentation (page unavailable) discusses AI support for human professional development and human feedback that helps AI learn. The copy does not support the more specific claim that continuously interwoven explanations of AI behavior and exploratory adaptation produce those improvements. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,821 · see citing works
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5376 · Cited by 4,217 · see citing works
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323 · see citing works
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · see citing works
An introduction to human factors engineering
Wickens, C. D. (1997) · Cited by 1,711 · see citing works
Artificial Intelligence: A New Synthesis
(1998) · Elsevier eBooks · doi:10.1016/c2009-0-27773-7 · Cited by 1,207 · see citing works
Intelligent Tutoring Goes To School in the Big City
Koedinger, K. R., Anderson, J. R., Hadley, W. H., & Mark, M. A. (2018) · doi:10.1184/r1/6470153 · Cited by 1,105 · see citing works
Fox, C. (2013) · Routledge eBooks · doi:10.4324/9781315009810-7 · Cited by 1,066 · see citing works
Vinkhuyzen, R. E., Verschure, P. F. M. J., & Newell, A. (1994) · The American Journal of Psychology · doi:10.2307/1422886 · Cited by 831 · see citing works
Heffernan, N. T., & Heffernan, C. L. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0024-x · Cited by 616 · see citing works
Soller, A., Martínez‐Monés, A., Jermann, P., & Muehlenbrock, M. (2005) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2005-15(4)02 · Cited by 611 · see citing works
A review of recent advances in learner and skill modeling in intelligent learning environments
Desmarais, M. C., & Baker, R. S. (2011) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9106-8 · Cited by 457 · see citing works
Schoenfeld, A. H. (2010) · Routledge eBooks · doi:10.4324/9780203843000 · Cited by 437 · see citing works
Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity
Holstein, K., McLaren, B. M., & Aleven, V. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.3 · Cited by 429 · see citing works
Self-citationStupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425 · see citing works
Design for classroom orchestration
Dillenbourg, P. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.04.013 · Cited by 386 · see citing works
Handbook of Research on Learning and Instruction
(2016) · Routledge eBooks · doi:10.4324/9781315736419 · Cited by 289 · see citing works
Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems
Aleven, V., Roll, I., McLaren, B. M., & Koedinger, K. R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0089-1 · Cited by 258 · see citing works
Self-citationStudent Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235 · see citing works
Self-citationHolstein, K., McLaren, B. M., & Aleven, V. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-23204-7_14 · Cited by 189 · see citing works
Self-citationInstruction Based on Adaptive Learning Technologies
Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2025) · Routledge eBooks · doi:10.4324/9781003484776-26 · Cited by 184 · see citing works
Self-citationIntelligent tutors as teachers' aides
Holstein, K., McLaren, B. M., & Aleven, V. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027451 · Cited by 179 · see citing works
Self-citationOrchestrating technology enhanced learning: a literature review and a conceptual framework
Prieto, L. P., Dlab, M. H., Gutié, I., rrez, N. A., Abdulwahed, M. S., & Balid, W. (2011) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2011.045449 · Cited by 174 · see citing works
Susan Bull, A., & Kay, J. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0090-8 · Cited by 165 · see citing works
Williams, J. J., Kim, J., Rafferty, A. N., Maldonado, S., Gajos, K. Z., Lasecki, W. S., & Heffernan, N. T. (2016) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2876034.2876042 · Cited by 147 · see citing works
Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration
Lakkaraju, H., Kamar, E. S., Caruana, R., & Horvitz, E. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10821 · Cited by 146 · see citing works
Mathematics teacher noticing seeing through teachers' eyes
Sherin, M. G. (2011) · Cited by 140 · see citing works
Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers
Aleven, V., McLaren, B. M., Sewall, J., van Velsen, M., Popescu, O., Demi, S., Ringenberg, M. A., & Koedinger, K. R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0088-2 · Cited by 139 · see citing works
Self-citationThe Evolution of Research on Digital Education
Dillenbourg, P. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0106-z · Cited by 136 · see citing works
Adaptive Intelligent Support to Improve Peer Tutoring in Algebra
Walker, E., Rummel, N., & Koedinger, K. R. (2013) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0001-9 · Cited by 127 · see citing works
Self-citationWhat information should CSCL teacher dashboards provide to help teachers interpret CSCL situations?
van Leeuwen, A., Rummel, N., & van Gog, T. (2019) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-019-09299-x · Cited by 105 · see citing works
Self-citationMartínez‐Maldonado, R., Clayphan, A. J., Yacef, K., & Kay, J. (2014) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2014.2365027 · Cited by 104 · see citing works
Teaching the Teacher: Tutoring SimStudent Leads to More Effective Cognitive Tutor Authoring
Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0020-1 · Cited by 84 · see citing works
Developing Emotion-Aware, Advanced Learning Technologies: A Taxonomy of Approaches and Features
Harley, J. M., Lajoie, S. P., Frasson, C., & Hall, N. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0126-8 · Cited by 84 · see citing works
Tissenbaum, M., & Slotta, J. (2019) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-019-09306-1 · Cited by 79 · see citing works
How Mastery Learning Works at Scale
RITTER, S., Yudelson, M. V., Fancsali, S. E., & Berman, S. R. (2016) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2876034.2876039 · Cited by 78 · see citing works
Schofield, J. W., Eurich‐Fulcer, R., & Britt, C. L. (1994) · American Educational Research Journal · doi:10.3102/00028312031003579 · Cited by 72 · see citing works
Echeverria, V., Martinez-Maldonado, R., Buckingham Shum, S., Chiluiza, K., Granda, R., & Conati, C. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.6 · Cited by 70 · see citing works
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms
An, P., Holstein, K., d'Anjou, B., Eggen, B., & Bakker, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376277 · Cited by 69 · cited 8× · see citing works
“…some technologies are designed to present information to humans with low-level, minimally pre-interpreted data (e.g., “number of help requests”) [4, 5, 16], several of the AIEd systems discussed above, including APTA , the Help Tutor , and Lumilo rely upon advanced student modeling techniques…”
BackgroundInfluentialSelf-citationCreem-Regehr, S. H., & Kunz, B. R. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.82 · Cited by 65 · see citing works
Rodríguez‐Triana, M. J., Prieto, L. P., Martínez‐Monés, A., Asensio-Pérez, J. I., & Dimitriadis, Y. A. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170364 · Cited by 61 · see citing works
One framework to rule them all? Carrying forward the conversation started by Wise and Schwarz
Rummel, N. (2018) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-018-9273-2 · Cited by 49 · see citing works
Self-citationOrchestration tools to support the teacher during student collaboration: a review
van Leeuwen, A., & Rummel, N. (2019) · Unterrichtswissenschaft · doi:10.1007/s42010-019-00052-9 · Cited by 47 · see citing works
Self-citationDesign and evaluation of teacher assistance tools for exploratory learning environments
Mavrikis, M., Gutiérrez-Santos, S., & Poulovassilis, A. (2016) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2883851.2883909 · Cited by 44 · see citing works
An, P., Bakker, S., Ordanovski, S., Taconis, R., Paffen, C. L. E., & Eggen, B. H. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300321 · Cited by 44 · see citing works
Myers, G. E. (2017) · Yale University Press eBooks · doi:10.12987/9780300158045-006 · Cited by 43 · see citing works
Automated detection of proactive remediation by teachers in reasoning mind classrooms
Miller, W. L., Baker, R. S., Labrum, M. J., Petsche, K., Liu, Y., & Wagner, A. Z. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723607 · Cited by 40 · see citing works
Intelligent teaching assistant systems
Yacef, K. (2003) · doi:10.1109/cie.2002.1185885 · Cited by 39 · see citing works
Studying Teacher Orchestration Load in Technology-Enhanced Classrooms
Prieto, L. P., Sharma, K., & Dillenbourg, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24258-3_20 · Cited by 39 · see citing works
Chen, N.-C., Suh, J., Verwey, J., Ramos, G., Drucker, S. M., & Simard, P. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3172950 · Cited by 38 · see citing works
Regulative Loops, Step Loops and Task Loops
VanLehn, K. A. (2015) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0056-x · Cited by 36 · see citing works
Holstein, K., McLaren, B. M., & Aleven, V. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027450 · Cited by 34 · see citing works
Self-citationTowards Hybrid Human-System Regulation
Molenaar, I., Horvers, A., & Baker, R. S. (2019) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3303772.3303780 · Cited by 31 · see citing works
Students’ Understanding of Their Student Model
Long, Y., & Aleven, V. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21869-9_25 · Cited by 30 · see citing works
Self-citationVanLehn, K. A., Burkhardt, H., Cheema, S., Kang, S., Pead, D., Schoenfeld, A. H., & Wetzel, J. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1616567 · Cited by 30 · see citing works
The Apprentice Learner architecture: Closing the loop between learning theory and educational data.
MacLellan, C. J., Harpstead, E., Patel, R., & Koedinger, K. R. (2016) · Educational Data Mining · Cited by 24 · see citing works
Kessler, A. M., Boston, M. D., & Stein, M. K. (2019) · Information and Learning Sciences · doi:10.1108/ils-07-2019-0075 · Cited by 23 · see citing works
Predicting Student Performance in a Collaborative Learning Environment.
Olsen, J. K., Aleven, V., & Rummel, N. (2015) · Grantee Submission · Cited by 20 · see citing works
Self-citationBarriers to ITS Adoption: A Systematic Mapping Study
Nye, B. D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-07221-0_74 · Cited by 20 · see citing works
Opening Up an Intelligent Tutoring System Development Environment for Extensible Student Modeling
Holstein, K., Yu, Z., Sewall, J., Popescu, O., McLaren, B. M., & Aleven, V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93843-1_13 · Cited by 19 · see citing works
Self-citationCognitive Tutor Use in Chile: Understanding Classroom and Lab Culture
Ogan, A., Yarzebinski, E., Fernández, P., & Casas, I. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_32 · Cited by 16 · see citing works
Towards a Framework for Smart Classrooms that Teach Instructors to Teach
Gerritsen, D., Zimmerman, J., & Ogan, A. (2018) · International Conference of Learning Sciences · Cited by 13 · see citing works
Some less obvious features of classroom orchestration systems
VanLehn, K. A., Cheema, S. A., Wetzel, J., & Pead, D. (2016) · Cited by 12 · see citing works
Intelligent Instructional Hand Offs.
Fancsali, S. E., Yudelson, M. V., Berman, S., & RITTER, S. (2018) · Educational Data Mining · Cited by 9 · see citing works
Design Perspectives of Learning at Scale
Kulkarni, C. E. (2019) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3330430.3333620 · Cited by 9 · see citing works
Orchestrating Combined Collaborative and Individual Learning in the Classroom
Olsen, J. K. (2017) · KiltHub Repository · doi:10.1184/r1/6720983 · Cited by 9 · see citing works
Self-Regulation of Learning with Multiple Representations in Hypermedia
Cromley, J. G., Azevedo, R., & Olson, E. (2005) · Cited by 8 · see citing works
Learning the Features Used To Decide How to Teach
Lee, M. H., Runde, J., Jibril, W., Wang, Z., & Brunskill, E. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2728707 · Cited by 4 · see citing works
Olsen, J. K., Rummel, N., & Aleven, V. (2018) · Cited by 4 · see citing works
Self-citationNick Chater, A., & Oaksford, M. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17000073 · Cited by 4 · see citing works
Flagged first, then by citations
2 of the 73 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- [8]Bransford JD Brown AL Cocking RR How People Learn 2000 Washington, DC National Academy Press
- [10]Chen, N.C., Suh, J., Verwey, J., Ramos, G., Drucker, S., Simard, P.: AnchorViz: facilitating classifier error discovery through interactive semantic data exploration. In: 23rd International Conference on Intelligent User Interfaces, pp. 269–280 (2018)
- [14]De-Arteaga, M., Fogliato, R., Chouldechova, A.: A case for humans-in-the-loop: decisions in the presence of erroneous algorithmic scores (2020). arXiv preprint arXiv:2002.08035 · arXiv
- [23]Holstein, K.: Designing real-time teacher augmentation to combine strengths of human and AI instruction. Unpublished doctoral dissertation, Carnegie Mellon University (2019)
- [25]Holstein, K., McLaren, B.M., Aleven, V.: SPACLE: investigating learning across virtual and physical spaces using spatial replays. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 358–367 (2017)
- [33]Lake BM Ullman TD Tenenbaum JB Gershman SJ Building machines that learn and think like people Behav. Brain Sci. 2017 40 258 27881212
- [60]Simard, P.Y., et al.: Machine teaching: a new paradigm for building machine learning systems (2017). arXiv preprint arXiv:1707.06742 · arXiv
- [72]Williams, J.J., et al.: Axis: generating explanations at scale with learner sourcing and machine learning. In: Proceedings of the Third (2016) ACM Conference on Learning@ Scale, pp. 379–388 (2016)
- [74]Zhu, X., Singla, A., Zilles, S., Rafferty, A.N.: An overview of machine teaching (2018). arXiv preprint arXiv:1801.05927 · arXiv
Cited by
Sorted by citations
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805 · see citing works
The impact of artificial intelligence on learner–instructor interaction in online learning
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00292-9 · Cited by 788 · see citing works
Jeon, J., & Lee, S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11834-1 · Cited by 696 · see citing works
The promise and challenges of generative AI in education
Giannakos, M., Azevedo, R., Brusilovsky, P., Cukurova, M., Dimitriadis, Y., Hernandez-Leo, D., Järvelä, S., Mavrikis, M., & Rienties, B. (2025) · Behaviour & Information Technology · doi:10.1080/0144929x.2024.2394886 · Cited by 543 · see citing works
Bernacki, M. L., Greene, M. J., & Lobczowski, N. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09615-8 · Cited by 545 · see citing works
Bozkurt, A., Karadeniz, A., Bañeres, D., Guerrero‐Roldán, A., & Rodríguez, M. E. (2021) · Sustainability · doi:10.3390/su13020800 · Cited by 464 · see citing works
Ji, H., Han, I., & Ko, Y. (2023) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2142873 · Cited by 394 · see citing works
Markauskaite, L., Marrone, R., Poquet, O., Knight, S., Martinez-Maldonado, R., Howard, S., Tondeur, J., De Laat, M., Buckingham Shum, S., Gašević, D., et al. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100056 · Cited by 353 · see citing works
Towards hybrid <scp>human‐AI</scp> learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348 · see citing works
Human and artificial intelligence collaboration for socially shared regulation in learning
Järvelä, S., Nguyen, A., & Hadwin, A. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13325 · Cited by 342 · see citing works
Human-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281 · see citing works
Herrmann, T., & Pfeiffer, S. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01391-5 · Cited by 173 · see citing works
“Others focus on how to support learning and identify various dimensions where humans and AI can augment each other (Holstein et al. 2020).”
BackgroundDesigning for human–AI complementarity in K‐12 education
Holstein, K., & Aleven, V. (2022) · AI Magazine · doi:10.1002/aaai.12058 · Cited by 156 · see citing works
Self-citationKawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143 · see citing works
Self-citationGmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580999 · Cited by 130 · see citing works
Self-citationAssessing student perceptions and use of instructor versus <scp>AI</scp> ‐generated feedback
Er, E., Akçapınar, G., Bayazıt, A., Noroozi, O., & Banihashem, S. K. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13558 · Cited by 114 · see citing works
Strauß, S., & Rummel, N. (2020) · Information and Learning Sciences · doi:10.1108/ils-04-2020-0090 · Cited by 111 · see citing works
Self-citationPotential Risks of Artificial Intelligence Integration into School Education: A Systematic Review
Karan, B., & Angadi, G. R. (2023) · Bulletin of Science Technology & Society · doi:10.1177/02704676231224705 · Cited by 108 · see citing works
Järvelä, S., & Hadwin, A. F. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102526 · Cited by 101 · see citing works
Types of teacher-AI collaboration in K-12 classroom instruction: Chinese teachers’ perspective
Kim, J. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12523-3 · Cited by 90 · see citing works
Closing the loop – The human role in artificial intelligence for education
Ninaus, M., & Sailer, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.956798 · Cited by 76 · see citing works
Adaptive support for self‐regulated learning in digital learning environments
Khalil, M., Wong, J., Wasson, B., & PAAS, F. G. W. C. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13479 · Cited by 70 · see citing works
Pereira, F. D., Fonseca, S. C., Oliveira, E. H. T., Cristea, A. I., Bellhauser, H., Rodrigues, L., Oliveira, D. B. F., Isotani, S., & Carvalho, L. S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3105956 · Cited by 63 · see citing works
Role design considerations of conversational agents to facilitate discussion and systems thinking
Nguyen, H. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104661 · Cited by 62 · see citing works
Bjelobaba, G., Savić, A., Tošić, T., Stefanović, I., & Kocić, B. (2023) · Sustainability · doi:10.3390/su15064780 · Cited by 59 · see citing works
An Artificial Intelligence Competency Framework for Teachers and Students: Co-created with Teachers
Filo, Y., Rabin, E., & Mor, Y. (2024) · European Journal of Open Distance and E-Learning · doi:10.2478/eurodl-2024-0012 · Cited by 55 · see citing works
Artificial intelligence: Driving force in the evolution of human knowledge
Colther, C. M., & Doussoulin, J. P. (2024) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2024.100625 · Cited by 54 · see citing works
Schoonderwoerd, T., van Zoelen, E. M., den Bosch, K. V., & Neerincx, M. A. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102831 · Cited by 51 · see citing works
Chernikova, O., Sommerhoff, D., Stadler, M. J., Holzberger, D., Nickl, M., Seidel, T., Kasneci, E., Küchemann, S., Kühn, J., Fischer, F., et al. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100662 · Cited by 49 · see citing works
Yang, K. B., Echeverria, V., Lu, Z., Mao, H., Holstein, K., Rummel, N., & Aleven, V. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581398 · Cited by 47 · see citing works
Self-citationToward Asset-based Instruction and Assessment in Artificial Intelligence in Education
Ocumpaugh, J. L., Roscoe, R. D., Baker, R. S., Hutt, S. J., & Aguilar, S. J. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00382-x · Cited by 45 · see citing works
Weber, F., Wambsganss, T., & Söllner, M. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13529 · Cited by 42 · see citing works
Kawakami, A., Sivaraman, V., Stapleton, L., Cheng, H.-F., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533556 · Cited by 42 · see citing works
Self-citationLu, X., Fan, S., Houghton, J., Wang, L., & Wang, X. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580957 · Cited by 42 · see citing works
Ley, T., Tammets, K., Pishtari, G., Chejara, P., Kasepalu, R., Khalil, M., Saar, M., Tuvi, I., Väljataga, T., & Wasson, B. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12844 · Cited by 43 · see citing works
Chakraborty, I., Chiong, K. X., Dover, H. F., & Sudhir, K. (2024) · Marketing Science · doi:10.1287/mksc.2023.0149 · Cited by 42 · see citing works
Capability-based training framework for generative AI in higher education
Burneo, P. S., de Lira, Y. R., Murzi, H., Balula, A., & Costa, A. P. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1594199 · Cited by 41 · see citing works
Holstein, K., De‐Arteaga, M., Tumati, L., & Cheng, Y. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579628 · Cited by 39 · see citing works
Self-citationOlsen, J. K., Rummel, N., & Aleven, V. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00228-w · Cited by 34 · see citing works
Self-citationDesigning for “challenge” in a large‐scale adaptive literacy game for primary school children
Benton, L., Mavrikis, M., Vasalou, A., Joye, N., Sumner, E., Herbert, E., Révész, A., Symvonis, A., & Raftopoulou, C. N. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13146 · Cited by 39 · see citing works
MetaWriter: Exploring the Potential and Perils of AI Writing Support in Scientific Peer Review
Sun, L., Tao, S., Hu, J., & Dow, S. P. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637371 · Cited by 37 · see citing works
Echeverría, V., Yang, K. B., Lawrence, L., Rummel, N., & Aleven, V. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3248155 · Cited by 36 · see citing works
Self-citationWho is Helping Whom? Student Concerns about AI-Teacher Collaboration in Higher Education Classrooms
Han, B., Coghlan, S., Buchanan, G., & McKay, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711104 · Cited by 31 · see citing works
van Zoelen, E. M., van den Bosch, K., & Neerincx, M. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.692811 · Cited by 31 · see citing works
Lu, J., Yan, Y., Huang, K., Yin, M., & Zhang, F. (2024) · Group Decision and Negotiation · doi:10.1007/s10726-024-09912-x · Cited by 30 · see citing works
Designing for Hybrid Intelligence: A Taxonomy and Survey of Crowd-Machine Interaction
Correia, A., Grover, A., Schneider, D., Pimentel, A. P., Chaves, R., de Almeida, M. A., & Fonseca, B. (2023) · Applied Sciences · doi:10.3390/app13042198 · Cited by 29 · see citing works
A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity
Rastogi, C., Leqi, L., Holstein, K., & Heidari, H. (2023) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v11i1.27554 · Cited by 29 · see citing works
Self-citationSchoors, R. V., Elen, J., Raes, A., Vanbecelaere, S., & Depaepe, F. (2022) · TechTrends · doi:10.1007/s11528-022-00802-0 · Cited by 28 · see citing works
Hybrid teaching intelligence: Lessons learned from an embodied mathematics learning experience
Cosentino, G., Anton, J., Sharma, K., Gelsomini, M., Giannakos, M. N., & Abrahamson, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13525 · Cited by 27 · see citing works
Requirements and challenges for hybrid intelligence: A case-study in education
Bert Bredeweg, A., & Kragten, M. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.891630 · Cited by 27 · see citing works
Shen, Y., Tang, L., Le, H., Tan, S., Zhao, Y., Shen, K., Li, X., Juelich, T., Wang, Q., Gašević, D., et al. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13562 · Cited by 26 · see citing works
Blockchain Technologies and Digitalization in Function of Student Work Evaluation
Bjelobaba, G., Paunović, M., Savić, A., Stefanovic, H. Z., Doganjić, J., & Bogavac, Ž. M. (2022) · Sustainability · doi:10.3390/su14095333 · Cited by 25 · see citing works
Pereira, F. D., Rodrigues, L., Henklain, M. H. O., Freitas, H., Oliveira, D. F., Cristea, A. I., Carvalho, L., Isotani, S., Benedict, A., Dorodchi, M., et al. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3224121 · Cited by 22 · see citing works
Gauthier, A., Rizvi, S., Cukurova, M., & Mavrikis, M. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.994967 · Cited by 23 · see citing works
Yang, W., Lee, H., Wu, R., Zhang, R., & Pan, Y. (2023) · Electronics · doi:10.3390/electronics12234813 · Cited by 22 · see citing works
Polydoros, G., Galitskaya, V., Pergantis, P., Drigas, A. S., Antoniou, A., & Beazidou, E. (2025) · Psychology International · doi:10.3390/psycholint7020046 · Cited by 21 · see citing works
Adejumo, A. A., Oyelere, S. S., Sanusi, I. T., & Suhonen, J. T. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100570 · Cited by 22 · see citing works
Adopting A New Hybrid Force Model: A Survey During Covid-19 In Indian Higher Education
Ranjan, R., López, J. L., Lal, K., Saxena, S., & Ranjan, S. (2021) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v16i16.23371 · Cited by 21 · see citing works
Huang, H., Hwang, G., & Chen, P. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13177 · Cited by 20 · see citing works
Yang, K. B., Lawrence, L., Echeverria, V., Guo, B., Rummel, N., & Aleven, V. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-86436-1_20 · Cited by 19 · see citing works
Self-citationGenerative Artificial Intelligence Use in Dental Post‐Graduate Students: A Mixed Methodology Study
Bhatara, S., Singh, S., Bhatara, M., Goswami, M., & Singh, S. (2026) · European Journal Of Dental Education · doi:10.1111/eje.70227 · Cited by 19 · see citing works
van Leeuwen, A., Strauß, S., & Rummel, N. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1039739 · Cited by 18 · see citing works
Self-citationAI in Teaching and Learning and Intelligent Tutoring Systems
Khine, M. S. (2024) · Springer eBooks · doi:10.1007/978-981-97-9350-1_4 · Cited by 17 · see citing works
Evaluating the Impact and Usability of an AI-Driven Feedback System for Learning Design
Pishtari, G., Sarmiento‐Márquez, E. M., Rodríguez‐Triana, M. J., Wagner, M., & Ley, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42682-7_22 · Cited by 17 · see citing works
Xue, M. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2023.102310 · Cited by 17 · see citing works
Asamoah, P., Zokpe, D., Boateng, R., Marfo, J. S., Boateng, S. L., Asamoah, D., Muntaka, A. S., & Manso, J. F. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2439651 · Cited by 16 · see citing works
Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge
Kawakami, A., Guerdan, L., Cheng, Y., Glazko, K. S., Lee, M. L., Carter, S., Aréchiga, N., Zhu, H., & Holstein, K. (2023) · ACM Collective Intelligence Conference (CI) · doi:10.1145/3582269.3615595 · Cited by 16 · see citing works
Self-citationRakya, Z. H. (2023) · International Journal of Emerging Multidisciplinaries Computer Science & Artificial Intelligence · doi:10.54938/ijemdcsai.2023.02.1.236 · Cited by 16 · see citing works
Pishtari, G., Sarmiento‐Márquez, E. M., Rodríguez‐Triana, M. J., Wagner, M., & Ley, T. (2024) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3636555.3636862 · Cited by 15 · see citing works
Multidimensional Student Agency in Learning with AI: A Conceptual Framework and Design Implications
Vincoli, M., Scholz, N., & Nagashima, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98459-4_16 · Cited by 14 · see citing works
SLADE: A Method for Designing Human-Centred Learning Analytics Systems
Alfredo, R., Echeverría, V., Jin, Y., Swiecki, Z., Gašević, D., & Martínez‐Maldonado, R. (2024) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3636555.3636847 · Cited by 14 · see citing works
An Evidence-based Workflow for Studying and Designing Learning Supports for Human-AI Co-creation
Gmeiner, F., Conlin, J. L., Tang, E. H., Martelaro, N., & Holstein, K. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650763 · Cited by 14 · see citing works
Self-citationBreckner, K., Neumayr, T., Mara, M., Streit, M., & Augstein, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2482742 · Cited by 12 · see citing works
van Leeuwen, A., & Rummel, N. (2022) · Unterrichtswissenschaft · doi:10.1007/s42010-022-00156-9 · Cited by 12 · see citing works
Self-citationArtificial Intelligence in Education
Kujundziski, A. P., & Bojadjiev, J. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-4310-4.ch001 · Cited by 11 · see citing works
Xiao, J. (2024) · Open Praxis · doi:10.55982/openpraxis.16.1.618 · Cited by 10 · see citing works
Nixdorf, S., Zhang, M., Grosse, E. H., & Ansari, F. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2568177 · Cited by 10 · see citing works
Almogren, A. S. (2025) · IEEE Access · doi:10.1109/access.2025.3553631 · Cited by 8 · see citing works
Gopalan, R., Onniyil, D., Viswanathan, G., & Samdani, G. (2025) · World Journal of Advanced Engineering Technology and Sciences · doi:10.30574/wjaets.2025.15.2.0635 · Cited by 8 · see citing works
Examining technology-supported teacher responding and students’ written mathematical explanations
Bywater, J. P., Lilly, S., & Chiu, J. L. (2022) · Journal of Mathematics Teacher Education · doi:10.1007/s10857-022-09546-3 · Cited by 8 · see citing works
Zhang, X., Zhu, S., Zhao, Y. C., Jia, M., & Zhu, Q. (2024) · Information Research · doi:10.47989/ir292856 · Cited by 8 · see citing works
Evaluating Trust in AI, Human, and Co-produced Feedback Among Undergraduate Students
Zhang, A., Gao, Y., Suraworachet, W., Nazaretsky, T., & Cukurova, M. (2025) · arXiv · doi:10.48550/arxiv.2504.10961 · Cited by 7 · see citing works
Adaptive Intelligence Revolutionizing Learning and Sustainability in Higher Education
Chigbu, B. I., Umejesi, I., & Makapela, S. L. (2024) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-3559-8.ch006 · Cited by 7 · see citing works
Toward Supporting CS1 Instructors and Learners With Fine-Grained Topic Detection in Online Judges
Pereira, F. D., Fonseca, S. C., Wiktor, S., de Oliveira, D. B. F., Cristea, A. I., Benedict, A., Fallahian, M., Dorodchi, M., de Carvalho, L. S. G., Mello, R. F., et al. (2023) · IEEE Access · doi:10.1109/access.2023.3247189 · Cited by 7 · see citing works
Zwischen Präzision und Sensitivität
Köstler, V. (2023) · MedienPädagogik Zeitschrift für Theorie und Praxis der Medienbildung · doi:10.21240/mpaed/54/2023.08.10.x · Cited by 6 · see citing works
Zwischen Mensch und Maschine: Künstliche Intelligenz zur Förderung von Lernprozessen
Ninaus, M., & Sailer, M. (2022) · Lernen und Lernstörungen · doi:10.1024/2235-0977/a000386 · Cited by 6 · see citing works
Anton, J., Cosentino, G., Sharma, K., Gelsomini, M., Mok, M., Giannakos, M. N., & Abrahamson, D. (2025) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3713043.3728863 · Cited by 5 · see citing works
Karumbaiah, S., Yin, Y., & Bharadwaj, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98414-3_5 · Cited by 5 · see citing works
Pishtari, G., Ley, T., Khalil, M., Kasepalu, R., & Tuvi, I. (2023) · Education Sciences · doi:10.3390/educsci13050498 · Cited by 5 · see citing works
Converging Human Intelligence with AI Systems to Advance Flood Evacuation Decision MakingPreprint
Karanjit, R., Samadi, V. S., Hughes, A., Murray‐Tuite, P. M., & Stephens, K. K. (2024) · Natural Hazards and Earth System Sciences Discussions · doi:10.5194/nhess-2024-25 · Cited by 5 · see citing works
Yang, L., Wang, Q., Zheng, B., Li, X., Ma, X., & Wang, T. (2024) · Scalable Computing Practice and Experience · doi:10.12694/scpe.v25i1.2424 · Cited by 4 · see citing works
Yang, K. B., Borchers, C., Falhs, A.-C., Echeverría, V., Karumbaiah, S., Rummel, N., & Aleven, V. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72315-5_34 · Cited by 4 · see citing works
Self-citationAI-Driven Curriculum Design and Course Management
Asrifan, A., Susanto, A. K., Elpisah, E., Syamsuardi, S., & Herlina, H. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3373-1017-6.ch007 · Cited by 4 · see citing works
Koralage, M., Malagala, G., Wijemunige, N., Silva, S. D., Banda, W., & Lokeshwara, A. A. (2024) · International Conference on Advancements in Computing (ICAC) · doi:10.1109/icac64487.2024.10851039 · Cited by 4 · see citing works
Proceedings of The ACM Collective Intelligence Conference
(2023) · doi:10.1145/3582269 · Cited by 4 · see citing works
Ko, E. G., & Hughes, J. E. (2026) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2026.100560 · Cited by 3 · see citing works
Han, B., Ma, Y., Coghlan, S., McKay, D., Buchanan, G., & Smith, W. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790360 · Cited by 3 · see citing works
Involving Parents in Tutoring Systems to Increase Content Confidence: A Design Probe Study
Borchers, C., Nguyen, H. T., Carvalho, P. F., Koedinger, K. R., & Aleven, V. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98465-5_14 · Cited by 3 · see citing works
Self-citationArtificial Intelligence as a Mediator of Scaffolding: A Scoping Review
Tenisheva, K., & Litvinova, A. (2025) · Ойкумена. Регионоведческие исследования · doi:10.63973/1998-6785/2025-3/31-39 · Cited by 3 · see citing works
Malaysia, U. K., Sabran, M. S. M., Salleh, M. A. M., Malaysia, U. K., Ahmad, Z., & Universiti Teknologi MARA Perak, M. (2025) · Jurnal Komunikasi Malaysian Journal of Communication · doi:10.17576/jkmjc-2025-4103-20 · Cited by 3 · see citing works
- Authors
- Holstein, K., Aleven, V., & Rummel, N.
- Affiliations
- Carnegie Mellon University (US)
- Ruhr University Bochum (DE)
- Corresponding author
- Holstein, Kenneth
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2020
- Pages
- 240-254
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- PMC
- PMC7334162
- OpenAlex
- W3038925583
- Cited by
- 168
- References
- 73
- Citations by year
- 2026: 39 · 2025: 35 · 2024: 36 · 2023: 25 · 2022: 21 · 2021: 10 · 2020: 2
- FWCI
- 5.54
- Type
- conference paper
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Lecture notes in computer science (publishedVersion)
- PubMed Central (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- artificial intelligence in education, adaptive learning systems, human-AI collaboration, conceptual framework, human-AI augmentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review