The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Off-task behavior in the cognitive tutor classroom: when students "game the system"
Abstract
We investigate the prevalence and learning impact of different types of off-task behavior in classrooms where students are using intelligent tutoring software. We find that within the classrooms studied, no other type of off-task behavior is associated nearly so strongly with reduced learning as "gaming the system": behavior aimed at obtaining correct answers and advancing within the tutoring curriculum by systematically taking advantage of regularities in the software's feedback and help. A student's frequency of gaming the system correlates as strongly to post-test score as the student's prior domain knowledge and general academic achievement. Controlling for prior domain knowledge, students who frequently game the system score substantially lower on a post-test than students who never game the system. Analysis of students who choose to game the system suggests that learned helplessness or performance orientation might be better accounts for why students choose this behavior than lack of interest in the material. This analysis will inform the future re-design of tutors to respond appropriately when students game the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A social-cognitive approach to motivation and personality.
Dweck, C. S., & Leggett, E. L. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.256 · Cited by 9,745 · cited 1×
“This approach would suggest that gaming the system has commonalities with the strategic behavior shown by students who have learned helplessness, attributing their early failures (which generally result from low prior knowledge, a characteristic of the high-gaming students in our study) to a global lack of aptitude, a…”
Background(1993) · Medical Entomology and Zoology · Cited by 1,882
Human Characteristics and School Learning
Bennett, N., & Bloom, B. S. (1979) · British Journal of Educational Studies · doi:10.2307/3119887 · Cited by 1,728
Carroll, J. B. (1963) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146816306400801 · Cited by 1,408
Intelligent Tutoring Goes To School in the Big City
Koedinger, K. R., Anderson, J. R., Hadley, W. H., & Mark, M. A. (2018) · doi:10.1184/r1/6470153 · Cited by 1,105
Self-citationChapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881
Cabezas, R. (1977) · Dance Research Journal · doi:10.2307/1478496 · Cited by 466
Computers and classroom culture
(1996) · Choice Reviews Online · doi:10.5860/choice.33-6430 · Cited by 348
Help seeking, learning and contingent tutoring
Wood, H., & Wood, D. (1999) · Computers & Education · doi:10.1016/s0360-1315(99)00030-5 · Cited by 275
Computers and Classroom Culture
Schofield, J. W. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511571268 · Cited by 263
Cited by
Educational Data Mining and Learning Analytics
Baker, R. S., & Inventado, P. S. (2014) · Learning Analytics · doi:10.1007/978-1-4614-3305-7_4 · Cited by 1,029
Self-citationBaker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Self-citationRomero, C., & Ventura, S. (2013) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1075 · Cited by 869
Exploring the Assistance Dilemma in Experiments with Cognitive Tutors
Koedinger, K. R., & Aleven, V. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9049-0 · Cited by 632
Self-citationHabgood, M. P. J., & Ainsworth, S. E. (2011) · Journal of the Learning Sciences · doi:10.1080/10508406.2010.508029 · Cited by 613
A Systematic Review on Educational Data Mining
Dutt, A., Ismail, M. A., & Herawan, T. (2017) · IEEE Access · doi:10.1109/access.2017.2654247 · Cited by 528
A review of recent advances in learner and skill modeling in intelligent learning environments
Desmarais, M. C., & Baker, R. S. J. D. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9106-8 · Cited by 449
Self-citationDetecting Student Misuse of Intelligent Tutoring Systems
Baker, R. S., Corbett, A. T., & Koedinger, K. R. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30139-4_50 · Cited by 353
Self-citationIntegrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments
Rowe, J. P., Shores, L. R., Mott, B. W., & Lester, J. C. (2011) · International Journal of Artificial Intelligence in Education · doi:10.3233/jai-2011-019 · Cited by 340
Student modeling approaches: A literature review for the last decade
Chrysafiadi, K., & Virvou, M. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.02.007 · Cited by 329
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328
“Although this relationship seems backward, the results agree with the findings of Baker et al. (2004) that students with lower pre-test scores are more likely to want to succeed via trial and error than think about domain knowledge, whereas students with higher pre-test scores are more likely to…”
ResultWalkington, C. A. (2013) · Journal of Educational Psychology · doi:10.1037/a0031882 · Cited by 322
D'Mello, S. (2013) · Journal of Educational Psychology · doi:10.1037/a0032674 · Cited by 300
Using learning analytics to assess students' behavior in open-ended programming tasks
Blikstein, P. (2011) · Proceedings of the 1st International Conference on Learning Analytics and Knowledge · doi:10.1145/2090116.2090132 · Cited by 292
Goldberg, P., Sümer, Ö., Stürmer, K., Wagner, W., Göllner, R., Gerjets, P., Kasneci, E., & Trautwein, U. (2021) · Educational Psychology Review · doi:10.1007/s10648-019-09514-z · Cited by 280
Blikstein, P. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460316 · Cited by 274
Arroyo, I., Woolf, B. P., Burelson, W., Muldner, K., Rai, D., & Tai, M. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0023-y · Cited by 263
On the Benefits of Seeking (and Avoiding) Help in Online Problem-Solving Environments
Roll, I., Baker, R. S. J. D., Aleven, V., & Koedinger, K. R. (2014) · Journal of the Learning Sciences · doi:10.1080/10508406.2014.883977 · Cited by 109
Self-citationAccounting for Beneficial Effects of Worked Examples in Tutored Problem Solving
Salden, R. J. C. M., Koedinger, K. R., Renkl, A., Aleven, V., & McLaren, B. M. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9143-6 · Cited by 96
Self-citationThe Emerging Role of Artificial Intelligence in STEM Higher Education: A Critical Review
Nagaraj, B. K., A, K., R, S. B., S, A., Sachdev, H. K., & N, S. K. (2023) · International Research Journal of Multidisciplinary Technovation · doi:10.54392/irjmt2351 · Cited by 86
Rodrigo, M. M. T., Baker, R. S. J. D., Agapito, J., Nabos, J., Repalam, M. C., Reyes, S. S., & San Pedro, M. O. C. Z. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.41 · Cited by 70
Self-citationBeserra, V., Nussbaum, M., & Oteo, M. (2019) · Journal of Educational Computing Research · doi:10.1177/0735633117744346 · Cited by 58
Mavrikis, M., Gutierrez-Santos, S., Geraniou, E., & Noss, R. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-012-0524-3 · Cited by 38
Detecting Off-Task Behavior from Student Dialogue in Game-Based Collaborative Learning
Carpenter, D., Emerson, A., Mott, B. W., Saleh, A., Glazewski, K. D., Hmelo-Silver, C. E., & Lester, J. C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-52237-7_5 · Cited by 37
Schrader, C., & Kalyuga, S. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.102374 · Cited by 31
Reframing classroom sensing: promise and peril
Ogan, A. (2019) · Interactions · doi:10.1145/3358902 · Cited by 28
(2015) · DeLFI Workshops · Cited by 18
Metadata
- Authors
- Baker, R. S., Corbett, A. T., Koedinger, K. R., & Wagner, A. Z.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2004-04-25
- Pages
- 383-390
- OpenAlex
- W2109901510
- Cited by
- 453
- References
- 22
- FWCI
- 8.24
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.