The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Reliability and validity of rubrics for assessment through writing
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Church, J. A. (2001) · Journal of Government Information · doi:10.1016/s1352-0237(01)00307-0 · Cited by 9,153
A Brief History of Neoliberalism
(2020) · The Anti-Capitalist Chronicles · doi:10.2307/j.ctv17ppcd0.8 · Cited by 9,074
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · cited 5×
“The intra-rater reliability (consistency of grading a given writing by the same rater twice) is reported to be higher (Cronbach’s alpha about .70) than the inter-rater reliability when a rubric is used (Jonsson & Svingby, 2007).”
InfluentialSachs, J. D. (2005) · Cited by 614
Capra, F. (2002) · Cited by 378
Assessing Second Language Writing in Academic Contexts
Kunnan, A. J., & Hamp-Lyons, L. (1993) · The Modern Language Journal · doi:10.2307/328948 · Cited by 363
Rater characteristics and rater bias: implications for training
Lumley, T., & McNamara, T. F. (1995) · Language Testing · doi:10.1177/026553229501200104 · Cited by 343
Assessment criteria in a large-scale writing test: what do they really mean to the raters?
Lumley, T. (2002) · Language Testing · doi:10.1191/0265532202lt230oa · Cited by 321
Globalization and belonging: the politics of identity in a changing world
(2004) · Choice Reviews Online · doi:10.5860/choice.41-6801 · Cited by 290
Andrade, H. L., Du, Y., & Wang, X. (2008) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2008.00118.x · Cited by 256
Research works printed but not linked: 11
- Chase, 1968, The Impact of some obvious variables on essay test scores, Journal of Educational Measurement, 5, 315, 10.1111/j.1745-3984.1968.tb00644.x · doi:10.1111/j.1745-3984.1968.tb00644.x
- Coffman, 1971, On the reliability of ratings of essay examinations in English, Research in the Teaching of English, 5, 24, 10.58680/rte197120156 · doi:10.58680/rte197120156
- Feldt, 1999, Variability in reliability coefficients and the standard error of measurement from school district to district, Applied Measurement in Education, 12, 367, 10.1207/S15324818AME1204_3 · doi:10.1207/s15324818ame1204_3
- Finson, 1998, Rubrics and their use in inclusive science, Intervention in School and Clinic, 34, 79, 10.1177/105345129803400203 · doi:10.1177/105345129803400203
- Follman, 1993, Critical thinking and verbal ability, ACEHI Journal, 19, 71
- Ross-Fisher, 2005, Developing effective success rubrics, Kappa Delta Pi, 41, 131, 10.1080/00228958.2005.10518823 · doi:10.1080/00228958.2005.10518823
- Sheppard, 1929, The effects of quality of penmanship on grades, Journal of Educational Research, 19, 102, 10.1080/00220671.1929.10879922 · doi:10.1080/00220671.1929.10879922
- Silvestri, 2006, Using rubrics to increase the reliability of assessment in health classes, International Electronic Journal of Health Education, 9, 25
- Spandel, 2006, In defense of rubrics, English Journal, 96, 19, 10.2307/30046656 · doi:10.2307/30046656
- Tomkins, 2003, Trouble comes in threes, Times Educational Supplement, 4547, 23
- Wiggins, 1994, The constant danger of sacrificing validity to reliability: Making writing assessment serve writers, Assessing Writing, 1, 129, 10.1016/1075-2935(94)90008-6 · doi:10.1016/1075-2935(94)90008-6
Cited by
Appropriate criteria: key to effective rubrics
Brookhart, S. M. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00022 · Cited by 243
A critical review of the arguments against the use of rubrics
Panadero, E., & Jonsson, A. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100329 · Cited by 191
Wang, Y.-J., Shang, H.-F., & Briody, P. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.655300 · Cited by 185
The impact of the feedback source on developing oral presentation competence
van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2017) · Studies in Higher Education · doi:10.1080/03075079.2015.1117064 · Cited by 94
Weiss, Z., Riemenschneider, A., Schröter, P., & Meurers, D. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4404 · Cited by 13
Metadata
- Authors
- Rezaei, A. R., & Lovorn, M.
- Venue
- Assessing Writing
- Publisher
- Elsevier BV
- Published
- 2010-01
- Volume
- 15
- Issue
- 1
- Pages
- 18-39
- ISSN
- 1075-2935 (ISSN-L)
- OpenAlex
- W1976511561
- Cited by
- 299
- References
- 45
- FWCI
- 31.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reliability and validity of rubrics for assessment through writing. https://app.cochat.ai/papers/10.1016/j.asw.2010.01.003
- The paper
- Rezaei, A. R., & Lovorn, M. (2010). Reliability and validity of rubrics for assessment through writing. Assessing Writing. https://doi.org/10.1016/j.asw.2010.01.003
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.