CoChat

Predicting Robust Learning With the Visual Form of the Moment-by-Moment Learning Curve

Baker, Ryan S., Hershkovitz, Arnon, Rossi, Lisa M., Goldstein, Adam B., Gowda, Sujith M. · 2013 · Journal of the Learning Sciences
Cited by 45

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

We present a new method for analyzing a student's learning over time for a specific skill: analysis of the graph of the student's moment-by-moment learning over time. Moment-by-moment learning is calculated using a data-mined model that assesses the probability that a student learned a skill or concept at a specific time during learning (Baker, Goldstein, & Heffernan, 2010 Baker, R. S. J. d., Goldstein, A. B. and Heffernan, N. T. 2010. “Detecting the moment of learning”. In Proceedings of the 10th Annual Conference on Intelligent Tutoring Systems 25–34. In V. Aleven, J. Kay, & J. Mostow (Eds.),pp.Heidelberg, Germany: Springer.[Crossref] , [Google Scholar], 2011). Two coders labeled data from students who used an intelligent tutoring system for college genetics. They coded in terms of 7 forms that the moment-by-moment learning curve can take. These labels are correlated to test data on the robustness of students’ learning. We find that different visual forms are correlated with very different learning outcomes. This work suggests that analysis of moment-by-moment learning curves may be able to shed light on the implications of students’ different patterns of learning over time.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/10508406.2013.836653

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 47

  1. Baker , R. S. J. d. 2007 . “ Modeling and understanding students’ off-task behavior in intelligent tutoring systems ” . In Proceedings of ACM CHI: Computer-Human Interaction 1059 – 1068 . In M. B. Rosson & D. Gillmore (Eds.),pp.New York, NY: ACM.
  2. Baker , R. S. J. d. , Corbett , A. T. and Aleven , V. “ More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian knowledge tracing ” . In Proceedings of the 9th International Conference on Intelligent Tutoring Systems Vol. (2008) , 406 – 415 . In B. Woolf, E. Aimeur, R. Nkambou, & S. Lajoie (Eds.),pp.Heidelberg, Germany: Springer.
  3. Baker , R. S. J. d. , Corbett , A. T. , Gowda , S. M. , Wagner , A. Z. , MacLaren , B. M. , Kauffman , L. R. and Giguere , S. 2010 . “ Contextual slip and prediction of student performance after use of an intelligent tutor ” . In Proceedings of the 18th Annual Conference on User Modeling , 52 – 63 . Adaptation, and Personalization . …In P. De Bra, A. Kobsa, & D. Chin (Eds.),ppHeidelberg, Germany: Springer.
  4. Baker , R. S. J. d. , Corbett , A. T. and Wagner , A. Z. 2006 . “ Human classification of low-fidelity replays of student actions ” . In Proceedings of the Educational Data Mining Workshop at the 8th International Conference on Intelligent Tutoring Systems 29 – 36 . In M. Ikeda, K. Ashlay, & T.-W. Chan (Eds.),pp. Heidelberg, Germany: Springer.
  5. Baker , R. S. J. d. , Goldstein , A. B. and Heffernan , N. T. 2010 . “ Detecting the moment of learning ” . In Proceedings of the 10th Annual Conference on Intelligent Tutoring Systems 25 – 34 . In V. Aleven, J. Kay, & J. Mostow (Eds.),pp.Heidelberg, Germany: Springer. · DOI
  6. Baker , R. S. J. d. , Goldstein , A. B. and Heffernan , N. T. 2011 . Detecting learning moment-by-moment . International Journal of Artificial Intelligence in Education , 21 ( 1–2 ) : 5 – 25 .
  7. Baker , R. S. J. d. , Gowda , S. M. and Corbett , A. T. 2011 . “ Automatically detecting a student's preparation for future learning: Help use is key ” . In Proceedings of the 4th International Conference on Educational Data Mining 179 – 188 . In M. Pechenizkiy, T. Calders, C. Conati, S. Ventura, C. Romero, & J. Stamper (Eds.),pp.Worcester, MA: International Educational Data Mining Society.
  8. Baker , R. S. J. d. , Pardos , Z. , Gowda , S. , Nooraei , B. and Heffernan , N. 2011 . “ Ensembling predictions of student knowledge within intelligent tutoring systems ” . In Proceedings of 19th International Conference on User Modeling , 13 – 24 . Adaptation, and Personalization . In J. Konstan, R. Conejo, J. L. Marzo, & N. Oliver (Eds.),pp Heidelberg, Germany: Springer.
  9. Baker , R. S. J. d. and Yacef , K. 2009 . The state of educational data mining in 2009: A review and future visions . Journal of Educational Data Mining , 1 ( 1 ) : 3 – 17 .
  10. Beck , J. E. 2006 . “ Using learning decomposition to analyze student fluency development ” . In Proceedings of the Workshop on Educational Data Mining at the 8th International Conference on Intelligent Tutoring Systems 21 – 28 . In M. Ikeda, K. Ashlay, & T.-W. Chan (Eds.),pp.Heidelberg, Germany: Springer.
  11. Beck , J. E. and Mostow , J. 2008 . “ How who should practice: Using learning decomposition to evaluate the efficacy of different types of practice for different types of students ” . In Proceedings of the 7th International Conference on Intelligent Tutoring Systems 353 – 362 . In J. C. Lester, R. M. Vicari, & F. Paraguacu (Eds.),pp.Heidelberg, Germany: Springer. · DOI
  12. 10.1007/BF02289796 · DOI · Paper page
  13. 10.1037/h0044972 · DOI
  14. Cen , H. , Koedinger , K. R. and Junker , B. 2007 . “ Is over practice necessary? Improving learning efficiency with the cognitive tutor using educational data mining ” . In Proceedings of the 13th International Conference on Artificial Intelligence in Education Edited by: Lucken , R. , Koedinger , K. R. and Greer , J. 511 – 518 . InEds.pp.Los Angeles, CA: IOS Press.
  15. 10.1207/s15327833mtl0101_1 · DOI · Paper page
  16. 10.1177/001316446002000104 · DOI · Paper page
  17. 10.2190/EC.42.2.e · DOI
  18. Corbett , A. , MacLaren , B. , Wagner , A. , Kauffman , L. , Mitchell , A. , Baker , R. S. J. d. and Gowda , S. M. 2011 . “ Preparing students for effective explaining of worked examples in the Genetics Tutor ” . In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society 1476 – 1481 . In L. Carlson, C. Hölscher, & T. Shipley (Eds.),pp.Austin, TX: Cognitive Science Society.
  19. 10.1080/02699931.2011.613668 · DOI · Paper page
  20. 10.1037/h0058559 · DOI · Paper page
  21. 10.1037/0096-3445.120.1.34 · doi:10.1037/0096-3445.120.1.34
  22. Gertner , A. S. and VanLehn , K. 2000 . “ Andes: A coached problem solving environment for physics ” . In Proceedings of the 5th International Conference on Intelligent Tutoring Systems 133 – 142 . In G. Gauthier, C. Frasson, & K. VanLehn (Eds.),pp.Heidelberg, Germany: Springer. · DOI · Paper page
  23. Hall , M. A. 2000 . “ Correlation-based feature selection for discrete and numeric class machine learning ” . In Proceedings of the 17th International Conference on Machine Learning 359 – 366 . In P. Langley (Ed.),pp.San Francisco, CA: Morgan Kauffman.
  24. 10.3758/BF03212979 · DOI · Paper page
  25. Henderson , K. 1999 . On line and on paper: Visual representations, visual culture, and computer graphics in design engineering , Cambridge , MA : MIT Press .
  26. Hershkovitz , A. and Nachmias , R. 2009 . Learning about online learning processes and students’ motivation through Web usage mining . Interdisciplinary Journal of E-Learning and Learning Objects , 5 : 197 – 214 .
  27. Koedinger , K. R. and Corbett , A. T. 2006 . “ Cognitive tutors: Technology bringing learning science to the classroom ” . In The Cambridge handbook of the learning sciences , Edited by: Sawyer , K. 61 – 78 . Cambridge , England : Cambridge University Press . InEd.pp.
  28. Kuhn , D. , Goh , W. , Iordanou , K. and Shaenfield , D. 2008 . Arguing on the computer: A microgenetic study of developing argument skills in a computer-supported environment . Child Development , 79 : 1310 – 1328 . · DOI
  29. 10.1207/s1532690xci0904_1 · DOI · Paper page
  30. 10.2307/2529310 · DOI · Paper page
  31. Lehrer , R. , Schauble , L. , Strom , D. and Pligge , M. 2001 . “ Similarity of form and substance: Modeling material kind ” . In Cognition and instruction: 25 years of progress , Edited by: Klahr , D. and Carver , S. 39 – 74 . Mahwah , NJ : Erlbaum . InEds.pp.
  32. Lindstrom , P. and Gulz , A. 2008 . “ Catching eureka on the fly ” . In Proceedings of the AAAI 2008 In I. Horswill, E. Hudlicka, C. Lisetta, & J. D. Velasquez (Eds.),Spring SymposiumMenlo Park, CA: AAAI Press.
  33. 10.1007/s11257-010-9084-2 · DOI
  34. 10.1207/s15326985ep4004_7 · DOI · Paper page
  35. 10.1037/0033-2909.85.6.1256 · doi:10.1037/0033-2909.85.6.1256 · Paper page
  36. Mierswa , I. , Wurst , M. , Klinkenberg , R. , Scholz , M. and Euler , T. 2006 . “ YALE: Rapid prototyping for complex data mining tasks ” . In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 935 – 940 . In L. Ungar, M. Craven, D. Gunopulos, & T. Eliassi-Rad (Eds.),pp.New York, NY: ACM. · DOI · Paper page
  37. Mostow , J. and Aist , G. 2001 . “ Evaluating tutors that listen: An overview of Project LISTEN ” . In Smart machines in education: The coming revolution in educational technology , Edited by: Forbus , K. D. and Feltovich , P. J. 169 – 234 . Cambridge , MA : MIT Press . InEds.pp.
  38. Newell , A. and Rosenbloom , P. S. 1981 . “ Mechanisms of skill acquisition and the law of practice ” . In Cognitive skills and their acquisition , Edited by: Anderson , J. R. 1 – 55 . Hillsdale , NJ : Erlbaum . InEd.pp.
  39. 10.1207/s15516709cog0000_14 · DOI · Paper page
  40. 10.1136/bmj.316.7139.1236 · DOI · Paper page
  41. 10.1016/j.eswa.2006.04.005 · DOI · Paper page
  42. Sao Pedro , M. A. , Baker , R. S. J. d. , Gobert , J. , Montalvo , O. and Nakama , A. 2013 . “ Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill ” . In User Modeling and User-Adapted Interaction , 23, 1--39
  43. Sao Pedro , M. A. , Baker , R. S. J. d. , Montalvo , O. , Nakama , A. and Gobert , J. D. 2010 . “ Using text replay tagging to produce detectors of systematic experimentation behavior patterns ” . In Proceedings of the 3rd International Conference on Educational Data Mining 181 – 190 . In R. S. J. d. Baker, A. Merceron, & P. I. Pavlik (Eds.),pp.Worcester, MA: International Education Data Mining Society.
  44. 10.1037/0003-066X.46.6.606 · DOI · Paper page
  45. Siegler , R. S. and Jenkins , E. 1989 . How children discover new strategies , Hillsdale , NJ : Erlbaum .
  46. Singley , M. K. and Anderson , J. R. 1989 . The transfer of cognitive skill , Cambridge , MA : Harvard University Press .
  47. 10.1111/j.1467-9868.2004.00439.x · DOI · Paper page

Cited by

Metadata

Authors
Baker, R. S., Hershkovitz, A., Rossi, L. M., Goldstein, A. B., & Gowda, S. M.
Venue
Journal of the Learning Sciences
Published
2013-10
Volume
22
Issue
4
Pages
639-666
ISSN
  • 1050-8406 (ISSN-L)
  • 1532-7809
OpenAlex
W2091947665
Cited by
45
References
8
FWCI
4.79
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.