Automated Scoring in Intelligent Tutoring Systems
The DOI matches its Crossref record.
Abstract
Simulation-based assessments open the door to a radically new paradigm of learning, characterized by interaction and personalized adaptation. We discuss automated scoring (AS) in intelligent tutoring systems (ITSs) that support students’ learning through their fairly unconstrained interactions in simulation environments. We highlight the necessary interplay among theories of cognition and learning in the domain and of the domain itself, simulation and interface design, and psychometric modeling, which must all be coordinated with AS from the start and not as an afterthought. We draw on concepts from evidence-centered design to explicate the relationships and illustrate the ideas with two examples: the Hydrive ITS to help US Airforce Force trainees learn to troubleshoot aircraft hydraulics systems and the Inq-ITS system to foster middle school students’ skills in science inquiry.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“teacher dashboards, such as Inq-Blotter, driven by big data techniques are being used to inform teachers’ instruction in real time while students simultaneously work in Inq-ITS”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as Mislevy et al., 2020
In the citing paper
“Data analytics can reveal students’ learning patterns and identify their specific needs”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as Mislevy et al., 2020
Citations
Cites
Still being checked.
Cited by
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
Challenges and Future Directions of Big Data and Artificial Intelligence in Education
Luan, H., Geczy, P., Lai, H., Gobert, J., Yang, S. J. H., Ogata, H., Baltes, J., Guerra, R., Li, P., & Tsai, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.580820 · Cited by 667
“Data analytics can reveal students’ learning patterns and identify their specific needs (Gobert and Sao Pedro, 2017; Mislevy et al., 2020).”
BackgroundMethodResultSelf-citationAcademic and Administrative Role of Artificial Intelligence in Education
Ahmad, S. F., Alam, M. M., Rahmat, M. K., Mubarik, M. S., & Hyder, S. I. (2022) · Sustainability · doi:10.3390/su14031101 · Cited by 309
“This major gap is filled by the AI applications by providing customized tutoring, etc. Adaptive learning and Personalized Education are also the features of AI applications that enable each learner to learn according to his/her mental level and abilities [7].”
BackgroundArtificial intelligence in higher education: a bibliometric analysis and topic modeling approach
Maphosa, V., & Maphosa, M. (2023) · Applied Artificial Intelligence · doi:10.1080/08839514.2023.2261730 · Cited by 100
Learning assessment in the age of big data: Learning analytics in higher education
Caspari-Sadeghi, S. (2023) · Cogent Education · doi:10.1080/2331186x.2022.2162697 · Cited by 74
Metadata
- Authors
- Mislevy, R. J., Yan, D., Gobert, J., & Pedro, M. S.
- Venue
- Handbook of Automated Scoring
- Publisher
- Chapman and Hall/CRC
- Published
- 2020-02-26
- Pages
- 403-422
- OpenAlex
- W3007223692
- Cited by
- 26
- References
- 0
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 5 · 2023: 5 · 2022: 4 · 2020: 2
- FWCI
- 4.49
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- automated grading, intelligent tutoring systems, simulation-based assessment, evidence-centered design, psychometric modeling, simulation environment, interface design, science inquiry skills, junior high school students, personalized learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated Scoring in Intelligent Tutoring Systems. https://app.cochat.ai/papers/10.1201/9781351264808-22
- The paper
- Mislevy, R. J., Yan, D., Gobert, J., & Pedro, M. S. (2020). Automated Scoring in Intelligent Tutoring Systems. Handbook of Automated Scoring. https://doi.org/10.1201/9781351264808-22
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.