CoChat

Automated Scoring in Intelligent Tutoring Systems

Mislevy, Robert J., Yan, Duanli, Gobert, Janice, Pedro, Michael Sao · 2020 · Handbook of Automated Scoring

The DOI matches its Crossref record.

Abstract

Simulation-based assessments open the door to a radically new paradigm of learning, characterized by interaction and personalized adaptation. We discuss automated scoring (AS) in intelligent tutoring systems (ITSs) that support students’ learning through their fairly unconstrained interactions in simulation environments. We highlight the necessary interplay among theories of cognition and learning in the domain and of the domain itself, simulation and interface design, and psychometric modeling, which must all be coordinated with AS from the start and not as an afterthought. We draw on concepts from evidence-centered design to explicate the relationships and illustrate the ideas with two examples: the Hydrive ITS to help US Airforce Force trainees learn to troubleshoot aircraft hydraulics systems and the Inq-ITS system to foster middle school students’ skills in science inquiry.

Overview

Integrity signals

Registry

Crossref · 10.1201/9781351264808-22

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Still being checked.

Cited by

See all 27

Metadata

Authors
Mislevy, R. J., Yan, D., Gobert, J., & Pedro, M. S.
Venue
Handbook of Automated Scoring
Published
2020-02-26
Pages
403-422
OpenAlex
W3007223692
Cited by
26
References
0
Citations by year
2026: 4 · 2025: 6 · 2024: 5 · 2023: 5 · 2022: 4 · 2020: 2
FWCI
4.49
Type
book chapter
Language
en
Open access
closed
Locations
Chapman & Hall/CRC eBooks (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
automated grading, intelligent tutoring systems, simulation-based assessment, evidence-centered design, psychometric modeling, simulation environment, interface design, science inquiry skills, junior high school students, personalized learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Automated Scoring in Intelligent Tutoring Systems. https://app.cochat.ai/papers/10.1201/9781351264808-22
The paper
Mislevy, R. J., Yan, D., Gobert, J., & Pedro, M. S. (2020). Automated Scoring in Intelligent Tutoring Systems. Handbook of Automated Scoring. https://doi.org/10.1201/9781351264808-22

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.