CoChat

The DOI matches its Crossref record; 70 of the 74 references it cites were found in a registry or an index.

Different Approaches to Assessing the Quality of Explanations Following a Multiple-Document Inquiry Activity in Science

Open access
Wiley, Jennifer, Hastings, Peter, Blaum, Dylan, Jaeger, Allison J., Hughes, Simon, Wallace, Patricia, Griffin, Thomas D., Britt, M. Anne · 2017 · International Journal of Artificial Intelligence in Education

Abstract

This article describes several approaches to assessing student understanding using written explanations that students generate as part of a multiple-document inquiry activity on a scientific topic (global warming). The current work attempts to capture the causal structure of student explanations as a way to detect the quality of the students’ mental models and understanding of the topic by combining approaches from Cognitive Science and Artificial Intelligence, and applying them to Education. First, several attributes of the explanations are explored by hand coding and leveraging existing technologies (LSA and Coh-Metrix). Then, we describe an approach for inferring the quality of the explanations using a novel, two-phase machine-learning approach for detecting causal relations and the causal chains that are present within student essays. The results demonstrate the benefits of using a machine-learning approach for detecting content, but also highlight the promise of hybrid methods that combine ML, LSA and Coh-Metrix approaches for detecting student understanding. Opportunities to use automated approaches as part of Intelligent Tutoring Systems that provide feedback toward improving student explanations and understanding are discussed.

Overview

Integrity signals

Registry

Crossref · 10.1007/s40593-017-0138-z

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 70 references

Research works printed but not linked: 3

  1. Shermis, M. D., & Hamner, B. (2012). Contrasting state-of-the-art automated scoring of essays: Analysis. In Annual national council on measurement in education meeting (pp. 14–16).
  2. Wiley, 1996, The effects of “playing” historian on learning in history, Applied Cognitive Psychology, 10, 63, 10.1002/(SICI)1099-0720(199611)10:7<63::AID-ACP438>3.0.CO;2-5 · doi:10.1002/(sici)1099-0720(199611)10:7<63::aid-acp438>3.0.co;2-5
  3. Wiley, 2011, Clarifying readers’ goals for learning from expository science texts, 353

Cited by

See all 49

Metadata

Authors
Wiley, J., Hastings, P., Blaum, D., Jaeger, A. J., Hughes, S., Wallace, P., Griffin, T. D., & Britt, M. A.
Affiliations
  • University of Illinois Chicago (US)
  • DePaul University (US)
  • Northern Illinois University (US)
Corresponding author
Wiley, Jennifer
Venue
International Journal of Artificial Intelligence in Education
Publisher
Elsevier BV
Published
2017-12
Volume
27
Issue
4
Pages
758-790
ISSN
1560-4292 (ISSN-L)
OpenAlex
W2586120904
Cited by
49
References
74
Citations by year
2026: 1 · 2025: 3 · 2024: 8 · 2023: 9 · 2022: 5 · 2021: 5 · 2020: 8 · 2019: 4 · 2018: 6
FWCI
2.94
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of Artificial Intelligence in Education (publishedVersion, cc-by-nc-nd)
  • Figshare (submittedVersion, cc-by)
Funders
  • Institute of Education Sciences (Grant R305F100007, R305B070460)
  • National Science Foundation (1535299)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Science Education and Pedagogy
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
Keywords
student explanations, global warming, causal chains, student mental models, latent semantic analysis, Coh-Metrix, automated essay scoring, intelligent tutoring systems, science education, student understanding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Different Approaches to Assessing the Quality of Explanations Following a Multiple-Document Inquiry Activity in Science. https://app.cochat.ai/papers/10.1007/s40593-017-0138-z
The paper
Wiley, J., Hastings, P., Blaum, D., Jaeger, A. J., Hughes, S., Wallace, P., Griffin, T. D., & Britt, M. A. (2017). Different Approaches to Assessing the Quality of Explanations Following a Multiple-Document Inquiry Activity in Science. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-017-0138-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.