Cited by 50Intelligent Tutoring Systems and Adaptive LearningArtificial Intelligence in EducationMathematics Education and Teaching Techniques

Development of a generative AI ‐powered teachable agent for middle school mathematics learning: A design‐based research study

Open access
Xing, Wanli, Song, Yukyeong, Li, Chenglu, Liu, Zifeng, Zhu, Wangda, Oh, Hyunju·2025·British Journal of Educational Technology

Abstract

This paper reports on a design‐based research (DBR) study that aims to devise an artificial intelligence (AI)‐powered teachable agent that supports secondary school students' learning‐by‐teaching practices of mathematics learning content. A long‐standing pedagogical practice of learning‐by‐teaching is powered by a recent advancement of generative AI technologies, yielding our teachable agent called ALTER‐Math . This study chronicles one usability testing and three cycles of iterative design and implementation process of ALTER‐Math . The three empirical studies involved a total of 320 middle school students and six teachers in authentic classroom settings. The first study was exploratory, focusing on the qualitative feedback from the students and teachers through open‐ended surveys, interviews and classroom observations. The second study yielded a medium‐high ( M = 3.26) quantitative survey result on students' perceived engagement and usability on top of the qualitative findings. Finally, the final study included pre‐ and post‐knowledge tests in a quasi‐experimental study design as well as student and teacher interviews. The final study revealed a bigger significant knowledge improvement in students who used ALTER‐Math compared to the control group, suggesting a positive impact of AI‐powered teachable agents on students' learning. The design implications learned from multiple iterations are discussed to inform the future design of AI‐powered learning technologies. Practitioner notes: What is already known about this topic Learning‐by‐teaching is a long‐standing effective pedagogical strategy to enhance students' domain knowledge and feelings of responsibility in learning. Various teachable agents have been developed and have demonstrated benefits in students' learning. Generative AI offers the potential to provide naturalistic, contextualised and adaptive conversations. What this paper adds Develops a novel generative AI‐powered teachable agent for middle school mathematics learning, called ALTER‐Math . Reports the iterative design process involving empirical classroom implementations of ALTER‐Math . Reveals a bigger significant improvement in the student's mathematical knowledge after using ALTER‐Math , compared to the control group. Implications for practice and/or policy Researchers can be inspired by this design example of a theoretically grounded generative AI learning technology. Educational technology designers could hear the real voices of students and teachers about the generative AI learning technologies. Researchers and educational technology designers could be directed by the design implications to the future design of AI‐powered learning technologies and teachable agents.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/bjet.13586

Cites

101 of 101 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Enhancing students' critical thinking and real-world problem-solving practices remains a key objective, with GenAI-supported interactive learning and analytical tasks designed to promote critical analysis, logical reasoning, and the generative use of knowledge to authentic challenges in science and mathematics.

    “Additionally, enhancing students' critical thinking and real-world problem-solving practices remains a key objective. GenAI-supported interactive learning and analytical tasks are designed to promote critical analysis, logical reasoning, and the generative use of knowledge to authentic challenges in science and mathematics.”

    From A Systematic Review of Generative AI in K–12: Mapping Goals, Activities, Roles, and Outcomes via the 3P Model (2025) · cites this paper as [102]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • AI often acts as a dialogic coach or teachable agent that organizes a sequence of demonstration, explanation, questioning, and feedback.

    “Beyond answering, AI often acts as a dialogic coach or teachable agent that organizes a sequence of demonstration, explanation, questioning, and feedback, as illustrated by the APLUS mathematics environment and curiosity question training agents [6,102,128].”

    From A Systematic Review of Generative AI in K–12: Mapping Goals, Activities, Roles, and Outcomes via the 3P Model (2025) · cites this paper as [102]

    The paper describes ALTER-Math as an interactive mathematics teachable agent: its prompts ask students for further explanations, and its mentor agent evaluates their instructions and gives feedback (Conclusion and Additional information; page numbers unavailable). It does not establish that AI often follows the stated demonstration–explanation–questioning–feedback sequence; in this design, students explain mathematics to the agent, and the agent is instructed not to teach directly. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • GenAI serves as a cognitive scaffold by collecting student input in real time, adaptively modifying examples and prompts, and integrating support functions such as simplified language, summarization, and length control within the same workspace.

    “First, GenAI serves as a cognitive scaffold. By leveraging conversational interfaces, the system collects student input in real time, adaptively modifies examples and prompts, and integrates support functions such as simplified language, summarization, and length control within the same workspace.”

    From A Systematic Review of Generative AI in K–12: Mapping Goals, Activities, Roles, and Outcomes via the 3P Model (2025) · cites this paper as [102]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 8

  1. Bloom, B., & Krathwohl, D. (1956). Taxonomy of educational objectives: The classification of educational goals. In Handbook: Cognitive domain (Vol. 1, pp. 483-498).
  2. Collins, A., Joseph, D., & Bielaczyc, K. (2016). Design research: Theoretical and methodological issues. In Design-based research (pp. 15-42). Psychology Press.
  3. Goel, A. K., & Polepeddi, L. (2018). Jill watson. Learning engineering for online education: Theoretical contexts and design-based examples. Routledge.
  4. Huang, B., & Hew, K. F. (2015). Do points, badges and leaderboard increase learning and activity: A quasi- experiment on the effects of gamification. In Proceedings of the 23rd International Conference on Computers in Education (pp. 275-280).
  5. Kafai, Y. (1991). In I. Harel & S. Papert (Eds.), Learning through design and teaching: Exploring social and collab- orative aspects of constructionism in constructionism. Ablex.
  6. Leelawong, K., Davis, J., Vye, N., Biswas, G., Schwartz, D., Belynne, K., Katzlberger, T., & Bransford, J. (2002). The effects of feedback in supporting learning by teaching in a teachable agent environment. In The Fifth International Conference of the Learning Sciences (pp. 245-252).
  7. Weisz, J. D., Jain, M., Joshi, N. N., Johnson, J., & Lange, I. (2019). Bigbluebot: Teaching strategies for successful human-agent interactions. In Proceedings of the 24th International Conference on Intelligent User Interfaces (pp. 448-459).
  8. Morgan Kaufmann.

Cited by

Sorted by citations

Authors
Xing, W., Song, Y., Li, C., Liu, Z., Zhu, W., & Oh, H.
Affiliations
  • University of Florida (US)
  • University of Utah (US)
Corresponding author
Xing, Wanli
Venue
British Journal of Educational Technology
Publisher
Wiley
Published
2025-04-17
Volume
56
Issue
5
Pages
2043-2077
ISSN
  • 0007-1013 (ISSN-L)
  • 1467-8535
OpenAlex
W4409524257
Cited by
50
References
99
Citations by year
2026: 36 · 2025: 14
FWCI
19.98
Type
journal article
Language
en
Open access
Locations
British Journal of Educational Technology (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Education › Mathematics Education and Teaching Techniques
Keywords
generative AI, teachable agents, learning by teaching, junior high school mathematics, high school students, student engagement, usability, iterative design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review