Divide and correct: using clusters to grade short answers at scale
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
In comparison to multiple choice or other recognition-oriented forms of assessment, short answer questions have been shown to offer greater value for both students and teachers; for students they can improve retention of knowledge, while for teachers they provide more insight into student understanding. Unfortunately, the same open-ended nature which makes them so valuable also makes them more difficult to grade at scale. To address this, we propose a cluster-based interface that allows teachers to read, grade, and provide feedback on large groups of answers at once. We evaluated this interface against an unclustered baseline in a within-subjects study with 25 teachers, and found that the clustered interface allows teachers to grade substantially faster, to give more feedback to students, and to develop a high-level view of students' understanding and misconceptions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734 · cited 3×
“use of formative assessment, where teachers use assessment to learn about and improve their teaching methods [3,19].”
BackgroundThe Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“Open-ended questions are more valuable for measuring understanding, application, and reasoning [11], and play a critical role in consolidating learning [9].”
BackgroundEffectiveness of feedback: the students’ perspective
Poulos, A., & Mahony, M. J. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930601127869 · Cited by 544
The Impact of Self- and Peer-Grading on Student Learning
Sadler, P., & Good, E. (2006) · Educational Assessment · doi:10.1207/s15326977ea1101_1 · Cited by 535 · cited 2×
“However, Sadler and Good found no evidence that peergrading improves peer performance on subsequent tests on the same material [18].”
BackgroundThe debate on automated essay grading
Hearst, M. A. (2000) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.889104 · Cited by 176
Cited by
PeerStudio: Rapid Peer Feedback Emphasizes Revision and Improves Performance
Kulkarni, C. E., Bernstein, M. S., & Klemmer, S. R. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724670 · Cited by 192
Lan, A. S., Vats, D., Waters, A. E., & Baraniuk, R. G. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724664 · Cited by 60
“This model treats a text document as a collection of words and uses the frequencies of the words as numerical features to perform tasks like topic classification and document clustering [4, 5].”
MethodUncovering Trajectories of Informal Learning in Large Online Communities of Creators
Yang, S., Domeniconi, C., Revelle, M., Sweeney, M., Gelman, B. U., Beckley, C., & Johri, A. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724674 · Cited by 60
“Consequently, MOOCs incorporate automatic and formal assessments to measure learner progress in order to provide feedback [4, 30].”
Background
Metadata
- Authors
- Brooks, M., Basu, S., Jacobs, C., & Vanderwende, L.
- Venue
- Proceedings of the first ACM conference on Learning @ scale conference
- Publisher
- ACM
- Published
- 2014-03-04
- Pages
- 89-98
- OpenAlex
- W2126344546
- Cited by
- 65
- References
- 5
- FWCI
- 8.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Divide and correct: using clusters to grade short answers at scale. https://app.cochat.ai/papers/10.1145/2556325.2566243
- The paper
- Brooks, M., Basu, S., Jacobs, C., & Vanderwende, L. (2014). Divide and correct: using clusters to grade short answers at scale. Proceedings of the first ACM conference on Learning @ scale conference. https://doi.org/10.1145/2556325.2566243
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.