CoChat

Computer-based performance feedback: Effects of error message complexity on cognitive, metacognitive, and motivational outcomes

Open access
Kuklick, Livia, Greiff, Samuel, Lindner, Marlit Annalena · 2023 · Computers & Education
Cited by 49

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

In computer-based assessments, immediate performance feedback on incorrect responses may have major cognitive and metacognitive benefits but it may also be demotivating for students by mirroring task-related failure. This experiment investigated the impact of three different error clarification types. We systematically varied the presence and complexity of immediate error messages (1 × 4 between-subjects design) and analyzed the effects of feedback with different levels of error clarification complexity on students' cognition, metacognition, and motivational state. Our sample included 439 university students who worked on 12 computer-based constructed-response geometry tasks. The students received either no feedback or feedback with different error message complexities after incorrect responses (i.e., Knowledge of Results [KR], Knowledge of Correct Response [KCR], or Elaborated Feedback [EF]) paired with confirmatory KCR feedback after correct responses. All feedback types, namely KR, KCR, and EF, significantly enhanced error correction and equally fostered students' metacognitive calibration accuracy. Moreover, error correction increased with the time students' spent on the error-related feedback (even for simple KR messages), which suggests that students actively used the additional time to reflect on their mistakes. Nevertheless, KCR and EF increased error correction more effectively than KR. Students' motivational state after correct responses did not significantly differ after receiving feedback compared to no feedback. After incorrect responses, we found a negative effect on students’ motivational state for KR feedback. This detrimental effect was in contrast to EF, which mitigated the negative effect compared to KR feedback and showed a similar motivational state level as the KCR and no feedback group.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.compedu.2023.104785

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 49

Metadata

Authors
Kuklick, L., Greiff, S., & Lindner, M. A.
Venue
Computers & Education
Publisher
Elsevier BV
Published
2023-07
Volume
200
Pages
104785
ISSN
0360-1315 (ISSN-L)
OpenAlex
W4328103191
Cited by
49
References
28
FWCI
36.32
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.