Reasoning Mind Genie 2: An Intelligent Tutoring System as a Vehicle for International Transfer of Instructional Methods in Mathematics
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Effective mathematics teachers have a large body of professional knowledge, which is largely undocumented and shared by teachers working in a given country’s education system. The volume and cultural nature of this knowledge make it particularly challenging to share curricula and instructional methods between countries. Thus, approaches based on knowledge engineering—designing a software system by interviewing human experts to extract their knowledge and heuristics—are particularly promising for cross-cultural curriculum implementations. Reasoning Mind’s Genie 2 system demonstrates the viability of such an approach, bringing elements of Russian mathematics education (known for its effectiveness) to the United States. Genie 2 has been adopted on a large scale, with around 67,000 United States students participating in the 2012–2013 school year. Previously published work (some of it in peer reviewed articles and some in non-peer-reviewed independent evaluations) has associated Genie 2 with high student and teacher acceptance, increases in test scores relative to “business as usual” conditions, high time on task, and a positive affective profile. Here, we describe for the first time the design, function, and use of the Genie 2 system. Based on this work, we suggest general principles—which collectively represent a proposed methodology—for the design of intelligent tutoring systems intended for cross-cultural transfer of curriculum and instructional methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776
Brown, A. L. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0202_2 · Cited by 4,000
Effects of Teachers’ Mathematical Knowledge for Teaching on Student Achievement
Hill, H. C., Rowan, B., & Ball, D. L. (2005) · American Educational Research Journal · doi:10.3102/00028312042002371 · Cited by 2,812 · cited 1×
“The main vehicle for automaticity is spaced practice.”
BackgroundShould There Be a Three-Strikes Rule Against Pure Discovery Learning?
Mayer, R. E. (2004) · American Psychologist · doi:10.1037/0003-066x.59.1.14 · Cited by 2,527
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 3×
“…tests (Ritter et al., 2007; Campuzano et al., 2009; Pane et al., 2013) and 0.7–1.0 standard deviations on more proximal instruments (VanLehn, 2011; Anderson et al., 1995; Koedinger et al., 1997), and there are encouraging results for systems such as Wayang’s Outpost (Arroyo et al., 2004) and…”
ResultInfluentialToward a Design Science of Education
Collins, A. (1992) · New Directions in Educational Technology · doi:10.1007/978-3-642-77750-9_2 · Cited by 1,139
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317 · cited 1×
“…in algebra have shown at-scale effects of between 0 and 0.3 standard deviations on standardized tests (Ritter et al., 2007; Campuzano et al., 2009; Pane et al., 2013) and 0.7–1.0 standard deviations on more proximal instruments (VanLehn, 2011; Anderson et al., 1995; Koedinger et al., 1997), and…”
BackgroundInfluentialAccounting for Beneficial Effects of Worked Examples in Tutored Problem Solving
Salden, R. J. C. M., Koedinger, K. R., Renkl, A., Aleven, V., & McLaren, B. M. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9143-6 · Cited by 96 · cited 1×
“Rittle-Johnson & Koedinger (2009) found that alternating between lessons on concepts and procedures led to better learning of certain arithmetic operations than an approach where concepts were studied first, and procedures afterwards.”
BackgroundWeb-Based Intelligent Multimedia Tutoring for High Stakes Achievement Tests
Arroyo, I., Beal, C., Murray, T., Walles, R., & Woolf, B. P. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30139-4_44 · Cited by 74 · cited 2×
“The same is true of other intelligent tutoring systems; for example, Cognitive Tutors in algebra have shown at-scale effects of between 0 and 0.3 standard deviations on standardized tests (Ritter et al., 2007; Campuzano et al., 2009; Pane et al., 2013) and 0.7–1.0 standard deviations on more proximal instruments (VanL…”
Influential
Cited by
Evolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229
Mousavinasab, E., Zarifsanaiey, N., R. Niakan Kalhori, S., Rakhshan, M., Keikha, L., & Ghazi Saeedi, M. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2018.1558257 · Cited by 605
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425
“, 1995), systems that can talk with students in natural language (Nye, Graesser, & Hu, 2014; earlier on, see Stevens & Collins, 1977); systems that model complex teacher and tutor pedagogical strategies (Heffernan & Koedinger, 2002; Khachatryan et al., 2014); systems that recognize and respond to differences in studen…”
BackgroundCo-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity
Holstein, K., McLaren, B. M., & Aleven, V. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.3 · Cited by 390
Human-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281
“…et al., 2023)), recommender systems that promote the development of metacognitive skills (e.g., Khosravi et al., 2019; Darvishi et al., 2024), and sophisticated modelling/predictive features in analytics reports or dashboards that provide guidance and support (e.g., Khachatryan et al., 2014).”
Background
Metadata
- Authors
- Khachatryan, G. A., Romashov, A. V., Khachatryan, A. R., Gaudino, S. J., Khachatryan, J. M., Guarian, K. R., & Yufa, N. V.
- Venue
- International Journal of Artificial Intelligence in Education
- Published
- 2014-06-10
- Volume
- 24
- Issue
- 3
- Pages
- 333-382
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W2088449624
- Cited by
- 43
- References
- 11
- FWCI
- 3.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.