Predicting Robust Learning With the Visual Form of the Moment-by-Moment Learning Curve
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
We present a new method for analyzing a student's learning over time for a specific skill: analysis of the graph of the student's moment-by-moment learning over time. Moment-by-moment learning is calculated using a data-mined model that assesses the probability that a student learned a skill or concept at a specific time during learning (Baker, Goldstein, & Heffernan, 2010 Baker, R. S. J. d., Goldstein, A. B. and Heffernan, N. T. 2010. “Detecting the moment of learning”. In Proceedings of the 10th Annual Conference on Intelligent Tutoring Systems 25–34. In V. Aleven, J. Kay, & J. Mostow (Eds.),pp.Heidelberg, Germany: Springer.[Crossref] , [Google Scholar], 2011). Two coders labeled data from students who used an intelligent tutoring system for college genetics. They coded in terms of 7 forms that the moment-by-moment learning curve can take. These labels are correlated to test data on the robustness of students’ learning. We find that different visual forms are correlated with very different learning outcomes. This work suggests that analysis of moment-by-moment learning curves may be able to shed light on the implications of students’ different patterns of learning over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324 · cited 18×
“We can assess the probability that the student learned the KC at step N given information about the actions at steps N + 1 and N + 2 (which we term A + 1 + 2 ), as follows: We can find P( J )’s value with a function using Bayes’s rule: The base probability P( ∼ Ln ˆ T ) can be computed fairly simply using the student’s…”
BackgroundMethodInfluentialSchmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 1×
“…2012), knowledge that transfers to related problem situations (Fong & Nisbett, 1991; Singley & Anderson, 1989), knowledge that students retain over time (Schmidt & Bjork, 1992), and knowledge that prepares students for more efficient or more effective future learning (Bransford & Schwartz, 1999).”
BackgroundChapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881 · cited 1×
“…2012), knowledge that transfers to related problem situations (Fong & Nisbett, 1991; Singley & Anderson, 1989), knowledge that students retain over time (Schmidt & Bjork, 1992), and knowledge that prepares students for more efficient or more effective future learning (Bransford & Schwartz, 1999).”
BackgroundKoedinger, K. R., Corbett, A. T., & Perfetti, C. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2012.01245.x · Cited by 772 · cited 2×
“This model is developed using the following approach: First, training labels of the probability that a student learned a KC, a skill or concept (cf. Koedinger et al., 2012), at a specific problem step are generated.”
BackgroundMethodNew approaches to demystifying insight
BOWDEN, E., JUNGBEEMAN, M., FLECK, J., & KOUNIOS, J. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.05.012 · Cited by 657 · cited 1×
“However, it has been argued – and we agree – that insight cannot be fully understood in these contexts (Bowden et al., 2005).”
Background“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572
Artifactual power curves in forgetting
Anderson, R. B., & Tweney, R. D. (1997) · Memory & Cognition · doi:10.3758/bf03211315 · Cited by 129
Research works printed but not linked: 47
- Baker , R. S. J. d. 2007 . “ Modeling and understanding students’ off-task behavior in intelligent tutoring systems ” . In Proceedings of ACM CHI: Computer-Human Interaction 1059 – 1068 . In M. B. Rosson & D. Gillmore (Eds.),pp.New York, NY: ACM.
- Baker , R. S. J. d. , Corbett , A. T. and Aleven , V. “ More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian knowledge tracing ” . In Proceedings of the 9th International Conference on Intelligent Tutoring Systems Vol. (2008) , 406 – 415 . In B. Woolf, E. Aimeur, R. Nkambou, & S. Lajoie (Eds.),pp.Heidelberg, Germany: Springer.
- Baker , R. S. J. d. , Corbett , A. T. , Gowda , S. M. , Wagner , A. Z. , MacLaren , B. M. , Kauffman , L. R. and Giguere , S. 2010 . “ Contextual slip and prediction of student performance after use of an intelligent tutor ” . In Proceedings of the 18th Annual Conference on User Modeling , 52 – 63 . Adaptation, and Personalization . …In P. De Bra, A. Kobsa, & D. Chin (Eds.),ppHeidelberg, Germany: Springer.
- Baker , R. S. J. d. , Corbett , A. T. and Wagner , A. Z. 2006 . “ Human classification of low-fidelity replays of student actions ” . In Proceedings of the Educational Data Mining Workshop at the 8th International Conference on Intelligent Tutoring Systems 29 – 36 . In M. Ikeda, K. Ashlay, & T.-W. Chan (Eds.),pp. Heidelberg, Germany: Springer.
- Baker , R. S. J. d. , Goldstein , A. B. and Heffernan , N. T. 2010 . “ Detecting the moment of learning ” . In Proceedings of the 10th Annual Conference on Intelligent Tutoring Systems 25 – 34 . In V. Aleven, J. Kay, & J. Mostow (Eds.),pp.Heidelberg, Germany: Springer. · DOI
- Baker , R. S. J. d. , Goldstein , A. B. and Heffernan , N. T. 2011 . Detecting learning moment-by-moment . International Journal of Artificial Intelligence in Education , 21 ( 1–2 ) : 5 – 25 .
- Baker , R. S. J. d. , Gowda , S. M. and Corbett , A. T. 2011 . “ Automatically detecting a student's preparation for future learning: Help use is key ” . In Proceedings of the 4th International Conference on Educational Data Mining 179 – 188 . In M. Pechenizkiy, T. Calders, C. Conati, S. Ventura, C. Romero, & J. Stamper (Eds.),pp.Worcester, MA: International Educational Data Mining Society.
- Baker , R. S. J. d. , Pardos , Z. , Gowda , S. , Nooraei , B. and Heffernan , N. 2011 . “ Ensembling predictions of student knowledge within intelligent tutoring systems ” . In Proceedings of 19th International Conference on User Modeling , 13 – 24 . Adaptation, and Personalization . In J. Konstan, R. Conejo, J. L. Marzo, & N. Oliver (Eds.),pp Heidelberg, Germany: Springer.
- Baker , R. S. J. d. and Yacef , K. 2009 . The state of educational data mining in 2009: A review and future visions . Journal of Educational Data Mining , 1 ( 1 ) : 3 – 17 .
- Beck , J. E. 2006 . “ Using learning decomposition to analyze student fluency development ” . In Proceedings of the Workshop on Educational Data Mining at the 8th International Conference on Intelligent Tutoring Systems 21 – 28 . In M. Ikeda, K. Ashlay, & T.-W. Chan (Eds.),pp.Heidelberg, Germany: Springer.
- Beck , J. E. and Mostow , J. 2008 . “ How who should practice: Using learning decomposition to evaluate the efficacy of different types of practice for different types of students ” . In Proceedings of the 7th International Conference on Intelligent Tutoring Systems 353 – 362 . In J. C. Lester, R. M. Vicari, & F. Paraguacu (Eds.),pp.Heidelberg, Germany: Springer. · DOI
- 10.1007/BF02289796 · DOI · Paper page
- 10.1037/h0044972 · DOI
- Cen , H. , Koedinger , K. R. and Junker , B. 2007 . “ Is over practice necessary? Improving learning efficiency with the cognitive tutor using educational data mining ” . In Proceedings of the 13th International Conference on Artificial Intelligence in Education Edited by: Lucken , R. , Koedinger , K. R. and Greer , J. 511 – 518 . InEds.pp.Los Angeles, CA: IOS Press.
- 10.1207/s15327833mtl0101_1 · DOI · Paper page
- 10.1177/001316446002000104 · DOI · Paper page
- 10.2190/EC.42.2.e · DOI
- Corbett , A. , MacLaren , B. , Wagner , A. , Kauffman , L. , Mitchell , A. , Baker , R. S. J. d. and Gowda , S. M. 2011 . “ Preparing students for effective explaining of worked examples in the Genetics Tutor ” . In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society 1476 – 1481 . In L. Carlson, C. Hölscher, & T. Shipley (Eds.),pp.Austin, TX: Cognitive Science Society.
- 10.1080/02699931.2011.613668 · DOI · Paper page
- 10.1037/h0058559 · DOI · Paper page
- 10.1037/0096-3445.120.1.34 · doi:10.1037/0096-3445.120.1.34
- Gertner , A. S. and VanLehn , K. 2000 . “ Andes: A coached problem solving environment for physics ” . In Proceedings of the 5th International Conference on Intelligent Tutoring Systems 133 – 142 . In G. Gauthier, C. Frasson, & K. VanLehn (Eds.),pp.Heidelberg, Germany: Springer. · DOI · Paper page
- Hall , M. A. 2000 . “ Correlation-based feature selection for discrete and numeric class machine learning ” . In Proceedings of the 17th International Conference on Machine Learning 359 – 366 . In P. Langley (Ed.),pp.San Francisco, CA: Morgan Kauffman.
- 10.3758/BF03212979 · DOI · Paper page
- Henderson , K. 1999 . On line and on paper: Visual representations, visual culture, and computer graphics in design engineering , Cambridge , MA : MIT Press .
- Hershkovitz , A. and Nachmias , R. 2009 . Learning about online learning processes and students’ motivation through Web usage mining . Interdisciplinary Journal of E-Learning and Learning Objects , 5 : 197 – 214 .
- Koedinger , K. R. and Corbett , A. T. 2006 . “ Cognitive tutors: Technology bringing learning science to the classroom ” . In The Cambridge handbook of the learning sciences , Edited by: Sawyer , K. 61 – 78 . Cambridge , England : Cambridge University Press . InEd.pp.
- Kuhn , D. , Goh , W. , Iordanou , K. and Shaenfield , D. 2008 . Arguing on the computer: A microgenetic study of developing argument skills in a computer-supported environment . Child Development , 79 : 1310 – 1328 . · DOI
- 10.1207/s1532690xci0904_1 · DOI · Paper page
- 10.2307/2529310 · DOI · Paper page
- Lehrer , R. , Schauble , L. , Strom , D. and Pligge , M. 2001 . “ Similarity of form and substance: Modeling material kind ” . In Cognition and instruction: 25 years of progress , Edited by: Klahr , D. and Carver , S. 39 – 74 . Mahwah , NJ : Erlbaum . InEds.pp.
- Lindstrom , P. and Gulz , A. 2008 . “ Catching eureka on the fly ” . In Proceedings of the AAAI 2008 In I. Horswill, E. Hudlicka, C. Lisetta, & J. D. Velasquez (Eds.),Spring SymposiumMenlo Park, CA: AAAI Press.
- 10.1007/s11257-010-9084-2 · DOI
- 10.1207/s15326985ep4004_7 · DOI · Paper page
- 10.1037/0033-2909.85.6.1256 · doi:10.1037/0033-2909.85.6.1256 · Paper page
- Mierswa , I. , Wurst , M. , Klinkenberg , R. , Scholz , M. and Euler , T. 2006 . “ YALE: Rapid prototyping for complex data mining tasks ” . In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 935 – 940 . In L. Ungar, M. Craven, D. Gunopulos, & T. Eliassi-Rad (Eds.),pp.New York, NY: ACM. · DOI · Paper page
- Mostow , J. and Aist , G. 2001 . “ Evaluating tutors that listen: An overview of Project LISTEN ” . In Smart machines in education: The coming revolution in educational technology , Edited by: Forbus , K. D. and Feltovich , P. J. 169 – 234 . Cambridge , MA : MIT Press . InEds.pp.
- Newell , A. and Rosenbloom , P. S. 1981 . “ Mechanisms of skill acquisition and the law of practice ” . In Cognitive skills and their acquisition , Edited by: Anderson , J. R. 1 – 55 . Hillsdale , NJ : Erlbaum . InEd.pp.
- 10.1207/s15516709cog0000_14 · DOI · Paper page
- 10.1136/bmj.316.7139.1236 · DOI · Paper page
- 10.1016/j.eswa.2006.04.005 · DOI · Paper page
- Sao Pedro , M. A. , Baker , R. S. J. d. , Gobert , J. , Montalvo , O. and Nakama , A. 2013 . “ Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill ” . In User Modeling and User-Adapted Interaction , 23, 1--39
- Sao Pedro , M. A. , Baker , R. S. J. d. , Montalvo , O. , Nakama , A. and Gobert , J. D. 2010 . “ Using text replay tagging to produce detectors of systematic experimentation behavior patterns ” . In Proceedings of the 3rd International Conference on Educational Data Mining 181 – 190 . In R. S. J. d. Baker, A. Merceron, & P. I. Pavlik (Eds.),pp.Worcester, MA: International Education Data Mining Society.
- 10.1037/0003-066X.46.6.606 · DOI · Paper page
- Siegler , R. S. and Jenkins , E. 1989 . How children discover new strategies , Hillsdale , NJ : Erlbaum .
- Singley , M. K. and Anderson , J. R. 1989 . The transfer of cognitive skill , Cambridge , MA : Harvard University Press .
- 10.1111/j.1467-9868.2004.00439.x · DOI · Paper page
Cited by
Assessment in the age of artificial intelligence
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100075 · Cited by 409
Towards hybrid human‐AI learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348
Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217
Molenaar, I. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100070 · Cited by 217
Capturing motivation and emotion regulation during a learning process
Järvenoja, H., Järvelä, S., Törmänen, T., Näykki, P., Malmberg, J., Kurki, K., Mykkänen, A., & Isohätälä, J. (2018) · frontline Learning Research · doi:10.14786/flr.v6i3.369 · Cited by 77
Metadata
- Authors
- Baker, R. S., Hershkovitz, A., Rossi, L. M., Goldstein, A. B., & Gowda, S. M.
- Venue
- Journal of the Learning Sciences
- Publisher
- Informa UK Limited
- Published
- 2013-10
- Volume
- 22
- Issue
- 4
- Pages
- 639-666
- ISSN
- 1050-8406 (ISSN-L)
- 1532-7809
- OpenAlex
- W2091947665
- Cited by
- 45
- References
- 8
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting Robust Learning With the Visual Form of the Moment-by-Moment Learning Curve. https://app.cochat.ai/papers/10.1080/10508406.2013.836653
- The paper
- Baker, R. S., Hershkovitz, A., Rossi, L. M., Goldstein, A. B., & Gowda, S. M. (2013). Predicting Robust Learning With the Visual Form of the Moment-by-Moment Learning Curve. Journal of the Learning Sciences. https://doi.org/10.1080/10508406.2013.836653
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.