Improving Student Problem Solving in Narrative-Centered Learning Environments: a Modular Reinforcement Learning Framework

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works

Serious Use of a Serious Game for Language Learning

Lewis, W., & Johnson (2007) · International Journal of Artificial Intelligence in Education · doi:10.3233/jai-2010-0006 · Cited by 240 · see citing works

Narrative games for learning: Testing the discovery and narrative hypotheses.

Adams, D. M., Mayer, R. E., MacNamara, A., Koenig, A., & Wainess, R. (2012) · Journal of Educational Psychology · doi:10.1037/a0025595 · Cited by 207 · see citing works

Problem Solving and Game-Based Learning: Effects of Middle Grade Students' Hypothesis Testing Strategies on Learning Outcomes

Spires, H. A., Rowe, J., Mott, B., & Lester, J. C. (2011) · Journal of Educational Computing Research · doi:10.2190/ec.44.4.e · Cited by 163 · see citing works

Empirically evaluating the application of reinforcement learning to the induction of effective and adaptive pedagogical strategies

Chi, M., VanLehn, K. A., Litman, D. J., & Jordan, P. (2011) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9093-1 · Cited by 135 · see citing works

“FearNot!”: a computer-based anti-bullying-programme designed to foster peer intervention

Vannini, N., Enz, S., Σαπουνά, Μ., Dieter Wolke, C., Watson, S., Woods, S., Dautenhahn, K., Hall, L. E., Paiva, A., André, E., et al. (2010) · European Journal of Psychology of Education · doi:10.1007/s10212-010-0035-4 · Cited by 121 · see citing works

Serious Games Get Smart: Intelligent Game‐Based Learning Environments

Lester, J. C., Ha, E. Y., Lee, S., Mott, B., Rowe, J., & Sabourin, J. L. (2013) · AI Magazine · doi:10.1609/aimag.v34i4.2488 · Cited by 76 · see citing works

Learning to Solve Multiple Goals

Karlsson, J. (1997) · Cited by 50 · see citing works

Visual signaling in virtual world-based assessments: The SAVE Science project

Nelson, B. C., Kim, Y., Foshee, C. M., & Slack, K. (2013) · Information Sciences · doi:10.1016/j.ins.2013.09.011 · Cited by 24 · see citing works

Optimizing Player Experience in Interactive Narrative Planning: A Modular Reinforcement Learning Approach

Rowe, J., Mott, B., & Lester, J. C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12733 · Cited by 24 · see citing works

On the difficulty of modular reinforcement learning for real-world partial programming

Bhat, S., Isbell, C. L., & Mateas, M. (2006) · Cited by 22 · see citing works

Exploring Inquiry-Based Problem-Solving Strategies in Game-Based Learning Environments

Sabourin, J. L., Rowe, J., Mott, B., & Lester, J. C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30950-2_60 · Cited by 17 · see citing works

Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance

Álvarez, N., Sánchez‐Ruiz, A. A., Cavazza, M., Shigematsu, M., & Prendinger, H. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0022-z · Cited by 10 · see citing works

Narrative-centered tutorial planning with concurrent markov decision processes

Lester, J. C., & Rowe, J. (2013) · Cited by 7 · see citing works

Artificial Intelligence in Education (AIEd): a high-level academic and industry note 2021

Chaudhry, M. A., & Kazim, E. (2022) · AI and Ethics · doi:10.1007/s43681-021-00074-z · Cited by 425 · see citing works

Data-Driven Artificial Intelligence in Education: A Comprehensive Review

Ahmad, K., Iqbal, W., Elhassan, A., Qadir, J., Benhaddou, D., Ayyash, M., & Al‐Fuqaha, A. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3314610 · Cited by 426 · see citing works

Engaging Students in the Learning Process with Game-Based Learning: The Fundamental Concepts

Adipat, S., Laksana, K., Busayanon, K., Ausawasowan, A., & Adipat, B. (2021) · International Journal of Technology in Education · doi:10.46328/ijte.169 · Cited by 221 · see citing works

The agency effect: The impact of student agency on learning, emotions, and problem-solving behaviors in a game-based learning environment

Taub, M., Sawyer, R., Smith, A., Rowe, J., Azevedo, R., & Lester, J. C. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103781 · Cited by 219 · see citing works

Developing Emotion-Aware, Advanced Learning Technologies: A Taxonomy of Approaches and Features

Harley, J. M., Lajoie, S. P., Frasson, C., & Hall, N. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0126-8 · Cited by 84 · see citing works

Artificial Intelligence for Personalized Preventive Adolescent Healthcare

Rowe, J., & Lester, J. C. (2020) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.02.021 · Cited by 86 · see citing works

Where’s the Reward?

Doroudi, S., Aleven, V., & Brunskill, E. (2019) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00187-x · Cited by 77 · see citing works

Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island

Taub, M., Mudrick, N. V., Azevedo, R., Millar, G. C., Rowe, J., & Lester, J. C. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.038 · Cited by 72 · see citing works

A Theoretical and Evidence-Based Conceptual Design of MetaDash: An Intelligent Teacher Dashboard to Support Teachers' Decision Making and Students’ Self-Regulated Learning

Wiedbusch, M. D., Kite, V., Yang, X., Park, S., Chi, M., Taub, M., & Azevedo, R. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.570229 · Cited by 54 · see citing works

Analysis of learning behavior in a flipped programing classroom adopting problem-solving strategies

Chiang, T. H. C. (2017) · Interactive Learning Environments · doi:10.1080/10494820.2016.1276084 · Cited by 50 · see citing works

A (Visual) Novel Route to Learning: A Taxonomy of Teaching Strategies in Visual Novels

Camingue, J., Melcer, E. F., & Carstensdottir, E. (2020) · International Conference on the Foundations of Digital Games · doi:10.1145/3402942.3403004 · Cited by 46 · see citing works

Self-explanation and digital games: Adaptively increasing abstraction

Clark, D. B., Virk, S., Barnes, J., & Adams, D. M. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.09.010 · Cited by 37 · see citing works

Reinforcement Learning in Education: A Systematic Literature Review

Riedmann, A., Schäper, P., & Lugrin, B. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00494-6 · Cited by 42 · see citing works

A Systematic Literature Review of Analytics for Adaptivity Within Educational Video Games

Ninaus, M., & Nebel, S. (2021) · Frontiers in Education · doi:10.3389/feduc.2020.611072 · Cited by 35 · see citing works

Reinforcement learning tutor better supported lower performers in a math task

Ruan, S., Nie, A., Steenbergen, W., He, J., Zhang, J., Guo, M., Liu, Y., Nguyen, K. D., Wang, C. Y., Ying, R., et al. (2024) · Machine Learning · doi:10.1007/s10994-023-06423-9 · Cited by 38 · see citing works

Filtered Time Series Analyses of Student Problem-Solving Behaviors in Game-Based Learning.

Sawyer, R. G., Rowe, J., Azevedo, R., & Lester, J. C. (2018) · Educational Data Mining · Cited by 22 · see citing works

Balancing Learning and Engagement in Game-Based Learning Environments with Multi-objective Reinforcement Learning

Sawyer, R., Rowe, J., & Lester, J. C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61425-0_27 · Cited by 21 · see citing works

Interactive Ant Colony Optimization to Support Adaptation in Serious Games

Kickmeier-Rust, M., & Holzinger, A. (2019) · International Journal of Serious Games · doi:10.17083/ijsg.v6i3.308 · Cited by 19 · see citing works

Exploring the Impact of Simple Explanations and Agency on Batch Deep Reinforcement Learning Induced Pedagogical Policies

Ausin, M. S., Maniktala, M., Barnes, T. M., & Chi, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-52237-7_38 · Cited by 19 · see citing works

Decomposing Drama Management in Educational Interactive Narrative: A Modular Reinforcement Learning Approach

Wang, P., Rowe, J., Mott, B., & Lester, J. C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48279-8_24 · Cited by 17 · see citing works

Robust Evaluation Matrix

Doroudi, S., Aleven, V., & Brunskill, E. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3051463 · Cited by 16 · see citing works

Improving Student-System Interaction Through Data-driven Explanations of Hierarchical Reinforcement Learning Induced Pedagogical Policies

Zhou, G., Yang, X., Azizsoltani, H., Barnes, T. M., & Chi, M. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3394848 · Cited by 16 · see citing works

Personas-based Student Grouping using reinforcement learning and linear programming

Ma, S., Luo, Y., & Yang, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111071 · Cited by 16 · see citing works

Crossing Disciplinary Boundaries to Improve Technology-Rich Learning Environments

Lajoie, S. P., & Poitras, E. (2017) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146811711900301 · Cited by 15 · see citing works

Improving Learning & Reducing Time

Shen, S., Ausin, M. S., Mostafavi, B., & Chi, M. (2018) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3209219.3209232 · Cited by 15 · see citing works

Raising Student Completion Rates with Adaptive Curriculum and Contextual Bandits

Belfer, R., Kochmar, E., & Serban, I. V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-11644-5_74 · Cited by 14 · see citing works

Understanding optimal problem-solving in a digital game: The interplay of learner attributes and learning behavior

Xu, Z., Zdravković, A., Moreno, M. V., & Woodruff, E. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100117 · Cited by 14 · see citing works

Identifying the effects of scaffolding on learners’ temporal deployment of self-regulated learning operations during game-based learning using multimodal data

Dever, D. A., Wiedbusch, M. D., Romero, S. M., Smith, K., Patel, M., Sonnenfeld, N. A., Lester, J. C., & Azevedo, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1280566 · Cited by 12 · see citing works

Leveraging Granularity: Hierarchical Reinforcement Learning for Pedagogical Policy Induction

Zhou, G., Azizsoltani, H., Ausin, M. S., Barnes, T. M., & Chi, M. (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00269-9 · Cited by 10 · see citing works

Pick the Moment: Identifying Critical Pedagogical Decisions Using Long-Short Term Rewards.

Ju, S. H., Zhou, G., Barnes, T. M., & Chi, M. (2020) · Educational Data Mining · Cited by 9 · see citing works

Development and Evaluation of a Computer Detective Game for Microbial Food Safety Education

Hsiao, H., Tsai, F.-H., & Hsu, I.-Y. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120924924 · Cited by 8 · see citing works

Empirically Evaluating the Effectiveness of POMDP vs. MDP Towards the Pedagogical Strategies Induction

Shen, S., Mostafavi, B., Lynch, C. F., Barnes, T. M., & Chi, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_61 · Cited by 8 · see citing works

Student Subtyping via EM-Inverse Reinforcement Learning.

Yang, X., Zhou, G., Taub, M., Azevedo, R., & Chi, M. (2020) · Educational Data Mining · Cited by 8 · see citing works

Evaluating Critical Reinforcement Learning Framework in the Field

Ju, S., Zhou, G., Abdelshiheed, M., Barnes, T. M., & Chi, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78292-4_18 · Cited by 8 · see citing works

The Impact of Batch Deep Reinforcement Learning on Student Performance: A Simple Act of Explanation Can Go A Long Way

Ausin, M. S., Maniktala, M., Barnes, T. M., & Chi, M. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00312-3 · Cited by 6 · see citing works

Understanding the Impacts of Storytelling and Player Perspective on Learning Outcomes: The Mediating Roles of Engagements

Shang, S., & Ni, N. (2023) · International journal of human computer interactions · doi:10.1080/10447318.2023.2288732 · Cited by 6 · see citing works

The evaluation of an educational game to promote pre-service teachers’ self-regulated learning

Barz, N., Benick, M., Dörrenbächer‐Ulrich, L., & Perels, F. (2024) · Entertainment Computing · doi:10.1016/j.entcom.2024.100836 · Cited by 5 · see citing works

Engaging Students in The Learning Process with Game-Based Learning

Nguyen, T. N., Tuan, P. T., & Phuong, N. T. H. (2024) · International Journal of English Language Studies · doi:10.32996/ijels.2024.6.1.5 · Cited by 5 · see citing works

Student-Tutor Mixed-Initiative Decision-Making Supported by Deep Reinforcement Learning

Ju, S., Yang, X., Barnes, T. M., & Chi, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-11644-5_36 · Cited by 4 · see citing works

A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategies

Islam, M. M., Yang, X., Debnath, R., Saha, A. S., & Chi, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98420-4_28 · Cited by 3 · see citing works

Oak Story: Improving Learner Outcomes with LLM-Mediated Interactive Narratives

Cheng, A. Y., Zou, C., Xie, A., Hsu, M., Yan, F., Huang, F., Zhang, D. K., Sharma, A., Poole, R., Rosli, D. W., et al. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747698 · Cited by 2 · see citing works

From Stories to Skills: Mapping Global Trends in Narrative Game-Based Learning for Language Growth

Yob, F. S. C., Mee, R. W. M., Rahman, E. A., Pek, L. S., Anindita, W. K., & Anwar, C. (2026) · European Journal of Educational Research · doi:10.12973/eu-jer.15.2.617 · Cited by 3 · see citing works

Importance Sampling to Identify Empirically Valid Policies and their Critical Decisions.

Ju, S. H., Shen, S., Azizsoltani, H., Barnes, T. M., & Chi, M. (2019) · Cited by 1 · see citing works

Deep Reinforcement Learning for Interactive Narrative Planning.

Wang, P. (2018) · NCSU Libraries Repository (North Carolina State University Libraries)

An Introduction to Game-Based Competence Assessment Based on Cognitive Diagnostic Models

Kickmeier-Rust, M., Niggli, C., & Richter, K. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49065-1_24

Learners’ Motivation and Modular-Distance Learning Amid the COVID-19 Pandemic: Policy Implications from Narratives and Sentiments Towards Effective Learning Delivery

Sacramento, R. E., & Sacramento, N. J. J. E. (2024) · ASR Chiang Mai University Journal of Social Sciences and Humanities · doi:10.12982/cmujasr.2024.003

The Evaluation of an Educational Game to Promote Pre-Service Teachers’ Self-Regulated LearningPreprint

Barz, N., Benick, M., Dörrenbächer‐Ulrich, L., & Perels, F. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4813527

Hierarchical Apprenticeship Learning from Imperfect Demonstrations with Evolving Rewards

Islam, M. M., Debnath, R., Saha, A. S., & Chi, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_14

Narrative-centered tutorial planning with concurrent markov decision processes

Lester, J. C., & Rowe, J. (2013) · Cited by 7 · see citing works

Real-Time Narrative-Centered Tutorial Planning for Story-Based Learning

Lee, S., Mott, B., & Lester, J. C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30950-2_61 · Cited by 11 · see citing works

Modeling Narrative-Centered Tutorial Decision Making in Guided Discovery Learning

Lee, S., Mott, B., & Lester, J. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21869-9_23 · Cited by 10 · see citing works

Narrative-Centered Learning Environments

(2012) · SpringerReference · doi:10.1007/springerreference_301818

Optimizing Player Experience in Interactive Narrative Planning: A Modular Reinforcement Learning Approach

Rowe, J., Mott, B., & Lester, J. C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12733 · Cited by 24 · see citing works