SPACLE: investigating learning across virtual and physical spaces using spatial replays
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Classroom experiments that evaluate the effectiveness of educational technologies do not typically examine the effects of classroom contextual variables (e.g., out-of-software help-giving and external distractions). Yet these variables may influence students' instructional outcomes. In this paper, we introduce the Spatial Classroom Log Explorer (SPACLE): a prototype tool that facilitates the rapid discovery of relationships between within-software and out-of-software events. Unlike previous tools for retrospective analysis, SPACLE replays moment-by-moment analytics about student and teacher behaviors in their original spatial context. We present a data analysis workflow using SPACLE and demonstrate how this workflow can support causal discovery. We share the results of our initial replay analyses using SPACLE, which highlight the importance of considering spatial factors in the classroom when analyzing ITS log data. We also present the results of an investigation into the effects of student-teacher interactions on student learning in K-12 blended classrooms, using our workflow, which combines replay analysis with SPACLE and causal modeling. Our findings suggest that students' awareness of being monitored by their teachers may promote learning, and that "gaming the system" behaviors may extend outside of educational software use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 1×
“…at their own pace: providing step-by-step guidance during complex problem-solving practice and continuously adapting instruction to students’ current state (a set of measured variables, which may include estimates of student knowledge, affective states, metacognitive skills, and more) [10, 25].”
BackgroundFrom sage on the stage to guide on the side
King, A. (1993) · College Teaching · doi:10.1080/87567555.1993.9926781 · Cited by 1,462
Evolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229 · cited 1×
“Although ITSs are often designed for use in K-12 schools, the ITS literature has rarely studied the effects of elements of classroom context on students’ learning with ITSs [1, 24].”
BackgroundLet’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049 · cited 1×
“If monitoring, awareness, and reflection tools for classrooms are to be effective, the design of these tools will likely benefit from a theoretically and empirically informed understanding of the causal mechanisms by which they could positively impact student learning [30, 33].”
BackgroundEffectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
Aleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Self-citationIntelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840 · cited 1×
“Several meta-reviews have indicated that ITSs can enhance student learning in classroom settings, compared with traditional classroom instruction and other forms of educational technology [17, 19, 20].”
BackgroundEffectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317 · cited 1×
“For example, a large-scale, two-year evaluation study of Carnegie Learning’s Algebra I tutor suggested that variability in the out-of-software support teachers provided to students may have been at least partly responsible for inconsistent results across evaluation years [29].”
Result
Cited by
Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity
Holstein, K., McLaren, B. M., & Aleven, V. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.3 · Cited by 390
Self-citationStudent Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235
“However, our prior design work with teachers indicated that less-experienced teachers may often struggle to generate effective on-the-spot help, in response to real-time analytics from an ITS [19, 22].”
BackgroundSelf-citationJiang, R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1049401 · Cited by 181
“…in the EFL context tend to vary from being positive, which is in accord with Sumakul et al. (2022)’s findings, toward being conservative, as noted by Holstein et al. (2017) and Lin et al. (2017) that less-experienced instructors usually struggle to execute effective responses to analytics,…”
ResultHolstein, K., McLaren, B. M., & Aleven, V. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027451 · Cited by 173
“Although recent work suggests that, contrary to this teacher’s assertion, educators’ intuitions about which students need the most help (and when to help) may be limited [41], this teacher’s comment reflects a key tension in the design of teacher support tools.”
ResultSelf-citationA Conceptual Framework for Human–AI Hybrid Adaptivity in Education
Holstein, K., Aleven, V., & Rummel, N. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-52237-7_20 · Cited by 168
Self-citation
Metadata
- Authors
- Holstein, K., McLaren, B. M., & Aleven, V.
- Venue
- Proceedings of the Seventh International Learning Analytics & Knowledge Conference
- Publisher
- ACM
- Published
- 2017-03-13
- Pages
- 358-367
- OpenAlex
- W2592947110
- Cited by
- 34
- References
- 10
- FWCI
- 3.04
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.