Effectiveness of Cognitive Tutor Algebra I at Scale
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
This article examines the effectiveness of a technology-based algebra curriculum in a wide variety of middle schools and high schools in seven states. Participating schools were matched into similar pairs and randomly assigned to either continue with the current algebra curriculum for 2 years or to adopt Cognitive Tutor Algebra I (CTAI), which uses a personalized, mastery-learning, blended-learning approach. Schools assigned to implement CTAI did so under conditions similar to schools that independently adopt it. Analysis of posttest outcomes on an algebra proficiency exam finds no effects in the first year of implementation, but finds evidence in support of positive effects in the second year. The estimated effect is statistically significant for high schools but not for middle schools; in both cases, the magnitude is sufficient to improve the median student’s performance by approximately eight percentile points.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI tools can enhance learning outcomes by providing personalised instruction and immediate feedback, thus supporting skill acquisition and knowledge retention [2,3].”
From AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking (2025) · cites this paper as [2]
In the citing paper
“The literature suggests that AI can enhance learning outcomes when used appropriately [2,3].”
From AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking (2025) · cites this paper as [2]
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
National Council of Teachers of Mathematics
(1979) · The Mathematics Teacher · doi:10.5951/mt.72.8.0637 · Cited by 8,499
(2009) · US Department of Education · Cited by 3,654
Gill, J. (2005) · Encyclopedia of Social Measurement · doi:10.1016/b0-12-369398-5/00166-3 · Cited by 3,114
TIMSS 2011 International Results in Mathematics.
Mullis, I. V. S., Martín, M. O., Foy, P., & Arora, A. (2012) · Cited by 2,760
Measurement Error in Nonlinear Models
Carroll, R. J., Ruppert, D., Stefanski, L. A., & Crainiceanu, C. M. (2006) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420010138 · Cited by 2,116
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 3×
“In addition, an experiment testing the efficacy of the related Cognitive Tutor Geometry curriculum in Grades 9 to 12 found a significant negative effect on student achievement (Pane, McCaffrey, Slaughter, Steele, & Ikemoto, 2010).”
MethodMeasurement error in nonlinear models: a modern perspective
Carroll, R. J. (2006) · Cited by 1,374
Research works printed but not linked: 10
- American College Testing, 2012, The reality of college readiness: National
- Fennema E., 1976, JSAS Catalog of Selected Documents of Psychology, 6, 31
- Greene W. H., 2003, Econometric analysis
- Karam R., 2013, Evaluating Cognitive Tutor Algebra 1 Curricula at Scale: Focus on implementation
- Koedinger K. R., 2000, Carnegie Learning’s Cognitive Tutor: Summary research results
- Lockwood J. R., Value-added modeling and growth modeling with particular application to teacher and school effectiveness
- Ritter S., 2007, Supporting Learning Flow Through Integrative Technologies, 162, 13
- U.S. Department of Education, 2011, What Works Clearinghouse: Procedures and standards handbook
- What Works Clearinghouse, 2004, WWC Intervention Report: Cognitive Tutor®
- What Works Clearinghouse, 2013, WWC Intervention Report: Carnegie Learning Curricula and Cognitive Tutor®
Cited by
Items 101–200 of 319
Karamuk, E. (2025) · Advances in Computational Intelligence and Robotics · doi:10.4018/979-8-3373-0122-8.ch007 · Cited by 22
Using embedded formative assessment to predict state summative test scores
Fancsali, S. E., Zheng, G., Tan, Y., RITTER, S., Berman, S. R., & Galyardt, A. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170392 · Cited by 24
An Efficacy Study of a Digital Core Curriculum for Grade 5 Mathematics
Shechtman, N., Roschelle, J., Feng, M., & Singleton, C. (2019) · AERA Open · doi:10.1177/2332858419850482 · Cited by 25
“Some prior research has examined impacts of adaptive and blended learning in mathematics (e.g., Pane, Griffin, McCaffrey, & Karam, 2014; What Works Clearinghouse, 2016).”
BackgroundReza, M., Anastasopoulos, I., Bhandari, S., & Pardos, Z. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714051 · Cited by 43
“Tutoring systems based on ITS principles have proven effective for learning [37], as has OATutor in the subjects of Algebra and Statistics [40].”
Sales, A., & Pane, J. F. (2019) · The Annals of Applied Statistics · doi:10.1214/18-aoas1196 · Cited by 28
Self-citationPoirier, M., Law, J., & Veispak, A. (2019) · International Journal of Mobile and Blended Learning · doi:10.4018/ijmbl.2019100101 · Cited by 38
“In one exceptional study the sample consisted of 25,500 students from over 147 schools (74 middles schools (n=6800), 73 high schools (n = 18700)) (Pane et al., 2014).”
BackgroundThe acceptance of artificial intelligence in education among postgraduate students in Malaysia
Razak, F. Z. A., Abdullah, M. A., Ahmad, B. E., Bakar, W. H. R. B. W. A., & Misaridin, N. A. F. B. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12916-4 · Cited by 32
“Pane et al. (2014) also give an example that an AI-powered platform called Carnegie Learning has been used in schools to provide personalized math instruction, and studies have shown that it can improve student achievement (Pane et al., 2014).”
Artificial Intelligence in Education and Ethics
du Boulay, B. (2022) · Handbook of Open, Distance and Digital Education · doi:10.1007/978-981-19-0351-9_6-1 · Cited by 37
Developing a Teacher Dashboard For Use with Intelligent Tutoring Systems.
Aleven, V. A. W. M. M., Xhakaj, F., Holstein, K., & McLaren, B. M. (2016) · Cited by 19
Beyond "Fairness:" Structural (In)justice Lenses on AI for EducationPreprint
Madaio, M., Blodgett, S. L., Mayfield, E., & Dixon‐Román, E. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08847 · Cited by 49
“toring systems that provide feedback and instructions to learners on the basis of students’ data [Pane et al., 2014], with more recent versions of such systems drawing on advances in machine learning [Piech et al.”
BackgroundAI-Powered Learning Revolutionizing Smart Education With Personalized Learning Styles
Murthy, Y. S., Chodisetty, R. S. C. M., Chakravorty, C. S., & Sai, K. P. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-8151-9.ch007 · Cited by 33
Azman, Ö., & Tümkaya, S. (2025) · F1000Research · doi:10.12688/f1000research.160011.1 · Cited by 47
Sequential detection of learning in cognitive diagnosis
Ye, S., Fellouris, G., Culpepper, S. A., & Douglas, J. (2016) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12065 · Cited by 18
“Although the market for ITSs has experienced a recent surge, e-learning is a classic research area in education, with Pressey’s (1926) punch card machine that provided students partial feedback (i.”
BackgroundUpgrading the ICT questionnaire items in PISA 2021
Lorenceau, A., Marec, C., & Mostafa, T. (2019) · OECD education working papers · doi:10.1787/d0f94dc7-en · Cited by 35
Nitkin, D., Ready, D. D., & Bowers, A. J. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.646471 · Cited by 25
Simulation-Extrapolation for Estimating Means and Causal Effects with Mismeasured Covariates
Lockwood, J. R., & McCaffrey, D. F. (2015) · Observational Studies · doi:10.1353/obs.2015.0007 · Cited by 21
“For example, in a study of a computer-based algebra tutor (Pane et al., 2014), students were administered a study pre-test designed to assess algebra knowledge, but student selection into the intervention condition was based in part on decisions by school personnel that were made prior to the…”
BackgroundSelf-citationDigitalizing Public Services: Opportunities for Latin America and the Caribbean
Cristia, J., & Vlaicu, R. (2022) · doi:10.18235/0004543 · Cited by 31
Examining Student Effort on Help through Response Time Decomposition
Gurung, A., Botelho, A. F., & Heffernan, N. T. (2021) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3448139.3448167 · Cited by 19
“We are particularly interested in exploring the relationship between our measure of student effort and previously-developed measures of gaming behavior [25] while working on problems.”
BackgroundAutomatic Interpretable Personalized Learning
Prihar, E., Haim, A., Sales, A., & Heffernan, N. T. (2022) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3491140.3528267 · Cited by 24
Designing Playful Intelligent Tutoring Software to Support Engaging and Effective Algebra Learning
Nagashima, T., Britti, J., Wang, X., Zheng, B., Turri, V., Tseng, S., & Aleven, V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16290-9_19 · Cited by 16
Copur‐Gencturk, Y., & Orrill, C. H. (2023) · Journal of Mathematics Teacher Education · doi:10.1007/s10857-023-09615-1 · Cited by 29
“Intelligent tutoring systems, although not widely used in PD settings, have been used in K-20 mathematics learning for decades (e.g., Anderson et al., 1995; Ma et al., 2014; Pane et al., 2014; Steenbergen-Hu & Cooper, 2013).”
Pedagogy of Effective Blended Learning
Andreyeva, N. V. (2020) · Journal of Modern Foreign Psychology · doi:10.17759/jmfp.2020090301 · Cited by 19
Li, C., & Lyu, B. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13612 · Cited by 26
EDUCATIONAL SOFTWARE AND ARTIFICIAL INTELLIGENCE: STUDENTS' EXPERIENCES AND INNOVATIVE SOLUTIONS
Annuš, N. (2024) · Information Technologies and Learning Tools · doi:10.33407/itlt.v101i3.5479 · Cited by 34
“…randomized experiments with educational software, as evidenced by significant improvements in learning among large groups of high school students from various regions of the United States in the second year of its introduction compared to a control group using traditional textbooks [30], [31].”
BackgroundLi, C., Xing, W., Song, Y., & Lyu, B. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100338 · Cited by 30
Computer-Supported Human Mentoring for Personalized and Equitable Math Learning
Schaldenbrand, P., Lobczowski, N. G., Richey, J. E., Gupta, S., McLaughlin, E. A., Adeniran, A., & Koedinger, K. R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78270-2_55 · Cited by 19
Algebra Error Classification with Large Language Models
McNichols, H., Zhang, M., & Lan, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-36272-9_30 · Cited by 18
Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates
Sales, A., Hansen, B. B., & Rowan, B. (2017) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998617731518 · Cited by 21
Implementation of an Intelligent Tutoring System for Online Homework Support in an Efficacy Trial
Feng, M., Roschelle, J., Heffernan, N. T., Fairman, J. C., & Murphy, R. F. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07221-0_71 · Cited by 17
“…Algebra I (CTAI) curriculum, one of the most well developed ITSs, in a wide variety of middle schools and high schools in seven states for 2 years, Pane et al. (2013) reported there were no effects in the first year of implementation but strong evidence in support of a positive effect in the…”
BackgroundPerceptions of Preservice Teachers about Adaptive Learning Programs in K-8 Mathematics Education
Smith, K. (2018) · Contemporary Educational Technology · doi:10.30935/cet.414780 · Cited by 20
Embellishing Problem-Solving Examples with Deep Structure Information Facilitates Transfer
Lee, H. S., Betts, S., & Anderson, J. R. (2016) · The Journal of Experimental Education · doi:10.1080/00220973.2016.1180277 · Cited by 16
“…widely used in classrooms; for example, Cognitive Tutor Algebra curriculum is being used in over 3,000 schools nationwide, and it has been successful in raising students ’ test scores (e.g., Koedinger, Anderson, Hadley, & Mark, 1997; Morgan & Ritter, 2002; Pane, Grif fi n, McCaffrey, & Karam, 2013).”
MethodAdopting AI in Education: Technical Challenges and Ethical Constraints
Kaddouri, M., Mhamdi, K., Chniete, I., Marhraoui, M., Khaldi, M., & Jmad, S. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-7255-5.ch002 · Cited by 22
Designing engaging intelligent tutoring systems in an age of cognitive computing
Sundararajan, S. C. M., & Nitta, S. (2015) · IBM Journal of Research and Development · doi:10.1147/jrd.2015.2464085 · Cited by 16
Pogrow, S. (2017) · Education Policy Analysis Archives · doi:10.14507/epaa.25.2517 · Cited by 26
When LLMs Hallucinate: Examining the Effects of Erroneous Feedback in Math Tutoring Systems
Steinbach, M., Bhandari, S., Meyer, J., & Pardos, Z. A. (2025) · Proceedings of the Twelfth ACM Conference on Learning @ Scale · doi:10.1145/3698205.3729555 · Cited by 12
“This is in line with a large body of prior research supporting the positive effect that systems using elaborate feedback in ITS-based tutoring have on learning outcomes [3, 9, 28, 46, 63], that appear to remain stable for contexts where the feedback is LLM-generated [48].”
Xu, Q. (2024) · Discover Education · doi:10.1007/s44217-024-00330-4 · Cited by 25
“Pane et al. (2016) suggest that the use of AI to develop personalized learning has a high potential to improve student learning outcomes [13].”
Ahn, J., Beck, A., Rice, J. W., & Foster, M. (2016) · AERA Open · doi:10.1177/2332858416667726 · Cited by 16
Adaptive Learning Goes to China
Feng, M., Cui, W., & Wang, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_17 · Cited by 14
Treceño-Fernández, D., Calabia-del-Campo, J., Bote-Lorenzo, M. L., Gómez-Sánchez, E., Luis-García, R. D., & Alberola-López, C. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105634 · Cited by 12
Use of Artificial Intelligence to Solve Problems in the Classroom
Rajput, R. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0437-3.ch005 · Cited by 16
Elementary and secondary mathematics and science education
Studley, R. E., Rotermund, S., Ottem, R., Muhlberger, P., & Chen, X. (2014) · Cited by 12
Proceedings of the Eleventh ACM Conference on Learning @ Scale
(2024) · doi:10.1145/3657604 · Cited by 11
“Several randomized controlled trials have demonstrated their effectiveness at improving student learning gains [7, 19].”
BackgroundThe Design Implementation Framework: Iterative Design From the Lab to the Classroom
Stone, M. L., Kent, K. M., Roscoe, R. D., Corley, K. M., Allen, L. K., & McNamara, D. S. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2639-1.ch004 · Cited by 12
A Framework for Research on Education With Technology
Wright, D. B. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00021 · Cited by 13
“A good example is Pane et al. (2014) study of Carnegie Learning (Ritter et al., 2016).”
MethodAssessing Mathematics Misunderstandings via Bayesian Inverse Planning
Rafferty, A. N., Jansen, R. A., & Griffiths, T. L. (2020) · Cognitive Science · doi:10.1111/cogs.12900 · Cited by 12
Vettriselvan, R., Velmurugan, P. R., Deepan, A., Jaiswani, G., & Durgarani, M. (2024) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-6915-9.ch024 · Cited by 44
Deciphering the Role of Artificial Intelligence in Health Care, Learning and Development
Varghese, R., Deshpande, A., Digholkar, G., & Kumar, D. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80455-662-720230010 · Cited by 16
PISA 2022 Financial Literacy Framework
OECD (2023) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/b5659b4f-en · Cited by 13
Towards Practical Detection of Unproductive Struggle
Fancsali, S. E., Holstein, K., Sandbothe, M., RITTER, S., McLaren, B. M., & Aleven, V. A. W. M. M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-52240-7_17 · Cited by 13
HTN-Based Tutors: A New Intelligent Tutoring Framework Based on Hierarchical Task Networks
Siddiqui, M. N., Gupta, A., Reddig, J. M., & MacLellan, C. J. (2024) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3657604.3664702 · Cited by 10
The Impact of AI Application in Education on Students
Wang, Y. (2024) · Journal of Education Humanities and Social Sciences · doi:10.54097/gg1d3q19 · Cited by 13
Orynbassarova, D., & Porta, S. D. L. (2024) · International Conference on Emerging eLearning Technologies and Applications (ICETA) · doi:10.1109/iceta63795.2024.10850795 · Cited by 17
Structured Reporting Guidelines for Classroom Intervention Research
Hill, H. C., Lynch, K. S., & Polanin, J. R. (2025) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2025.2470322 · Cited by 12
“…programs in all disciplinary areas (e.g., mathematics, English Language Arts, social studies) as well as programs meant to change other features of classrooms, including student behavior, student social-emotional learning, and the inclusion of learning technologies (e.g., Pane et al., 2014).”
Learning spaces: built, natural and digital considerations for learning and learners
Kraftl, P., McKenzie, M., Gulson, K. Ν., Accioly, I., Burke, C., Clarke, D. A. G., Bailón, R. O. F., Goodyear, P., Hartong, S., Howard, S. K., et al. (2022) · UNESCO MGIEP eBooks · doi:10.56383/kwaw2002 · Cited by 14
Riapina, N. E. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-1022-9.ch002 · Cited by 8
du Boulay, B. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00198-z · Cited by 10
“A large, complex and carefully organised, multi-state experiment was conducted in the USA over two years (Pane et al. 2014).”
BackgroundDoes Multiple Choice Have a Future in the Age of Generative AI? A Posttest-only RCT
Thomas, D. R., Borchers, C., Kakarla, S., Lin, J., Bhushan, S., Guo, B., Gatz, E., & Koedinger, K. R. (2025) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3706468.3706530 · Cited by 17
“…the following research questions: RQ1 : What differences exist in tutor learning, as evidenced by posttest performance, across the learning-by-doing activities, i.e. Tutoring is widely recognized as one of the most effective interventions for improving student learning outcomes [17, 30, 32].”
InfluentialInnovations in higher education: new approaches and teaching technologies
Ткаченко, А. М. (2024) · Economic Analysis · doi:10.35774/econa2024.03.110 · Cited by 18
Learning Skill Equivalencies Across Platform Taxonomies
Li, Z., Ren, C., Li, X., & Pardos, Z. A. (2021) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3448139.3448173 · Cited by 12
Barzel, B., Ball, L., & Klinger, M. (2019) · Mathematics education in the digital era · doi:10.1007/978-3-030-19741-4_4 · Cited by 11
Robots and Agents to Support Collaborative Learning
Okita, S. Y., & Clarke, S. N. (2021) · Springer eBooks · doi:10.1007/978-3-030-65291-3_22 · Cited by 10
Yokuş, G. (2025) · Sustainability · doi:10.3390/su17219815 · Cited by 11
Koedinger, K. R., McLaughlin, E. A., & Stamper, J. C. (2014) · Ubiquity · doi:10.1145/2591682 · Cited by 26
“org 5 ©2014 Association for Computing Machinery field trials involved 147 schools and showed students using the “Cognitive Tutor Algebra” course learned twice as much as students in traditional algebra courses [9].”
YAPAY ZEKÂ BAĞLAMINDA OKUL LİDERLERİNİ BEKLEYEN ZORLUKLAR
Sincar, M. (2023) · Mustafa Kemal Üniversitesi Eğitim Fakültesi Dergisi · doi:10.56677/mkuefder.1407065 · Cited by 10
Bälter, O., Glassey, R. J., Jemstedt, A., & Bosk, D. (2024) · Education Sciences · doi:10.3390/educsci14080882 · Cited by 8
Long‐term effects of an online math tool on U.S. adolescents' achievement
Feng, M., Brezack, N., Huang, C., & Collins, K. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13579 · Cited by 7
Authoring Tutors with Complex Solutions: A Comparative Analysis of Example Tracing and SimStudent.
MacLellan, C. J., Harpstead, E., Wiese, E. S., Zou, M., Matsuda, N., Aleven, V. A. W. M. M., & Koedinger, K. R. (2015) · AIED Workshops · Cited by 10
Student Log-Data from a Randomized Evaluation of Educational Technology: A Causal Case Study
Sales, A., & Pane, J. F. (2020) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2020.1823538 · Cited by 14
“The study [Pane et al., 2014] found no effects in its first year, but in the second year of implementation students in high schools randomized to the CTA1 condition outperformed the control group on the posttest by a fifth of a standard deviation.”
BackgroundSelf-citationOCDE (2022) · Digital education outlook · doi:10.1787/d5fe6bd0-fr · Cited by 18
Introducing an Open-source Adaptive Tutoring System to Accelerate Learning Sciences Experimentation
Anastasopoulos, I., Sheel, S. K., Pardos, Z. A., & Bhandari, S. (2023) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3573051.3593399 · Cited by 8
Ethical Principles for the Development and Application of Artificial Intelligence in K-12 Education
Webb, C., Luckin, R., & Ecoff, E. (2023) · Springer eBooks · doi:10.1007/978-981-19-6887-7_120 · Cited by 14
Argyriadis, A., Drakopoulou, O., Argyriadi, A., Mantsos, E., Katsarou, D. V., & Πατσιαούρας, Α. (2024) · Advances in psychology, mental health, and behavioral studies (APMHBS) book series · doi:10.4018/979-8-3693-4022-6.ch001 · Cited by 7
Bringing Non-programmer Authoring of Intelligent Tutors to MOOCs
Aleven, V., Baker, R. S., Wang, Y., Sewall, J., & Popescu, O. (2016) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2876034.2893442 · Cited by 6
Kang, H., Sales, A., & Whittaker, T. A. (2023) · Behavior Research Methods · doi:10.3758/s13428-022-02041-w · Cited by 5
“The example evaluation data were collected in 2007-08 as a part of an effectiveness study (Pane et al., 2014).”
Gamification and Deadending: Unpacking Performance Impacts in Algebraic Learning
Pradhan, S. P., Gurung, A., & Ottmar, E. (2024) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3636555.3636929 · Cited by 11
“Though both approaches effectively facilitate the acquisition of mathematical knowledge [21, 23, 28], little is known regarding the various procedural pathways learners might potentially employ in formulating a solution.”
BackgroundFairman, J. C., Feng, M., & Roschelle, J. (2025) · Digital Experiences in Mathematics Education · doi:10.1007/s40751-025-00170-3 · Cited by 11
Fancsali, S. E., RITTER, S., Yudelson, M. V., Sandbothe, M., & Berman, S. (2016) · The Florida AI Research Society · Cited by 5
Joshi, A., Fancsali, S. E., RITTER, S., Nixon, T. M., & Berman, S. (2014) · Educational Data Mining · Cited by 5
Computer-assisted learning in the real world: How Khan Academy influences student math learning
Eames, T., Brunskill, E., Yamkovenko, B., Weatherholtz, K., & Oreopoulos, P. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2507708123 · Cited by 13
Automated Cognitive Analyses for Intelligent Tutoring Systems
Banno, S. I., Murad, H., & Sallal, M. (2020) · IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) · doi:10.1109/bdcat50828.2020.00007 · Cited by 4
The Evolution of E-Learning towards the Emergence of Artificial Intelligence (A Narrative Review)
Mehrfar, A., Zolfaghari, Z., Bordbar, A., & Karimimoghadam, Z. (2024) · International and National Conference on E-Learning and E-Teaching (ICeLeT) · doi:10.1109/icelet62507.2024.10493104 · Cited by 12
“Clear explanations and interpretability around how the AI is reasoning, its boundaries, and limitations build learner confidence[45].”
BackgroundTEKNOLOJİ EĞİTİMİNDE YAPAY ZEKA UYGULAMALARI
KOÇ, O. (2024) · European journal of managerial research. · doi:10.62666/eujmr.1544278 · Cited by 4
The MindfulMath Tutor: A Mindfulness-Infused Learning Environment to Battle Math Anxiety
Hladký, M., Silber, M., & Nagashima, T. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719922 · Cited by 8
“A number of interactive learning systems have been shown effective in supporting students’ math learning and performance [12, 25, 43, 66] both in controlled experiments and real-world implementation [50].”
Diana, N., Stamper, J. C., & Koedinger, K. R. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376469 · Cited by 7
Design-Based Covariate Adjustments in Paired Experiments
Wu, E., & Gagnon-Bartsch, J. A. (2020) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998620941469 · Cited by 4
“For example, Pane et al. (2014) discuss a randomized trial involving schools in Texas testing the effectiveness of a computer program, the Cognitive Tutor Algebra 1 curriculum.”
BackgroundRichey, J. E., Lobczowski, N. G., Carvalho, P. F., & Koedinger, K. R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-52237-7_37 · Cited by 6
Sales, A., & Pane, J. F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09308 · Cited by 4
Self-citationIsrani, A., Sales, A., & Pane, J. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08616 · Cited by 5
“To account for this, we used regression calibration based on the 20 “multiple imputations” used in the original CTAI study, Pane et al. (2014). of a hypothetical unmeasured confounder that predicts reassignment and posttests to the same extent as one of the observed covariates.”
BackgroundMethodInfluentialSelf-citationImplementing Personalized Adaptive Online Assessments through Deep Learning
Naseer, F., Sattar, N., Rasool, A., Jebreen, K., & Khalid, U. (2025) · Wiley eBooks · doi:10.1002/9781394302666.ch13 · Cited by 4
Zhang, K., & Zhou, J. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1329570 · Cited by 6
“Tailoring instruction to match students’ cognitive styles can enhance their understanding and retention of mathematical concepts (Pane et al., 2014).”
BackgroundRen, H., Wu, M., Croisdale, G. T., Guo, A., & Wang, X. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735788 · Cited by 9
“Decades of research has shown that cognitive tutors [33, 34, 42] lead to better learning in comparison with traditional methods.”
Using Learning Analytics in Personalized Learning
Baker, R. S. (2016) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-68123-589-920251015 · Cited by 43
Day, M. J. (2026) · Artificial Intelligence in Education · doi:10.1108/aiie-08-2025-0216 · Cited by 5
Artificial Intelligence and Robotics
Ramesh, S. (2025) · Springer eBooks · doi:10.1007/978-3-031-84181-1_6 · Cited by 3
Examining Challenges and Approaches to Building Intelligent Tutoring Systems for Teams
Sottilare, R. A., & Salas, E. (2018) · Research on managing groups and teams · doi:10.1108/s1534-085620180000019001 · Cited by 4
Knowledge Inference Models Used in Adaptive Learning
Pedro, M. O. Z. S., & Baker, R. S. (2021) · Methodology of educational measurement and assessment · doi:10.1007/978-3-030-74394-9_5 · Cited by 4
Management of Artificial Intelligence as an Assistive Tool for Enhanced Educational Outcomes
Thompson, C. C., & Okonkwo, S. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3678-7.ch009 · Cited by 3
Morgenthaler, L., & Barrett, M. D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77857-6_26 · Cited by 3
Understanding the Effects of Middle School Algebra: A Regression Discontinuity ApproachPreprint
McEachin, A. J., Domina, T., & Penner, A. M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3055923 · Cited by 4
Metadata
- Authors
- Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R.
- Affiliations
- RAND Corporation (US)
- Educational Testing Service (US)
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2014-06
- Volume
- 36
- Issue
- 2
- Pages
- 127-144
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2113386642
- Cited by
- 317
- References
- 32
- Citations by year
- 2026: 34 · 2025: 50 · 2024: 44 · 2023: 34 · 2022: 22 · 2021: 20 · 2020: 29 · 2019: 16 · 2018: 16 · 2017: 11 · 2016: 18 · 2015: 11 · 2014: 10
- FWCI
- 15.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Educational Evaluation and Policy Analysis (publishedVersion)
- Funders
- Educational Testing Service
- Institute of Education Sciences
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Education › Mathematics Education and Teaching Techniques
- Keywords
- algebra instruction, technology-based curriculum, personalized learning, learning mastery, blended learning, curriculum adoption, junior high school, high schools, academic performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.