The DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet; 1 of the 47 sources its claims cite were checked for support.
Using rubrics for formative purposes: identifying factors that may affect the success of rubric implementations
Open accessAbstract
The formative use of rubrics seems to have the potential of promoting student learning, supposedly by making expectations and criteria explicit. However, there is a variation in effects on how well students perform on academic tasks when supported by rubrics. The aim of this study was to identify factors in rubric interventions that may potentially explain this variation in effects. This was investigated by analysing 15 ‘high-quality studies’ reporting on rubric interventions. The ‘success’ of these studies was ranked, based on the effect size on academic performance from rubric interventions. We performed a content analysis, searching for similarities and differences in procedures and instrumentation. Our analysis revealed two key characteristics common to successful interventions: First, teachers explain both the content of the rubric and its application for formative purposes. Second, an effective sequence involves students writing or producing work, followed by feedback or self-assessment, and subsequent revision.
Verified 2026-11-16 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This critical review re-analyses 15 "high-quality" rubric intervention studies drawn from a prior meta-analysis to explain why formative rubric use produces variable effects on student performance. It identifies two features common to successful implementations—teachers explicitly explaining the rubric and its formative use, and embedding the rubric in a produce→feedback/self-assess→revise sequence—while attributing weaker results to rubric–task misalignment and differences in task difficulty.
Key findings
- Successful implementations (effect sizes above the median cut-off of 0.411) shared two characteristics: the teacher (or someone else) explained the rubric's content and how to use it formatively, and the rubric was used in an instructional sequence of writing/producing, receiving feedback or self-assessing, and revising.
- Less successful implementations generally lacked such a production-and-revision sequence, or described procedures too sparsely to judge; some also used rubrics that were misaligned with the task (partial support only, e.g. procedural/structural criteria without subject-content criteria in Bohlin 2000, Brewer 2002, Smit et al. 2017) or not "student friendly" (Montanero et al. 2014; Goodrich Andrade 2001).
- Variation in task difficulty within a single intervention may mask or exaggerate effects (e.g. Goodrich Andrade 2001 found effects on the second essay but not the first or third; Manzanares et al. 2015 reported effect sizes from 0 to 0.735 across six rubrics in one intervention).
- The 15 included studies yielded 40 effect sizes ranging from −0.51 to 1.62 (mean = 0.49), with a 0.31 correlation between study quality and effect size.
Methods
- Design: critical/systematic review with qualitative content analysis, anchored to the quantitative results of Panadero et al.'s (2023) meta-analysis of rubric effects (2000–2022).
- Sample: of 23 studies in the meta-analysis, 21 provided 54 academic-performance effect sizes; applying a quality cut-off of 7 points on a 7-criterion, 3-level (Weak–Medium–Robust) scoring rubric yielded 15 "high-quality" studies with 40 effect sizes. Median effect size (0.411) split studies into "more successful" (7 studies), "mixed" (2), and "less successful" (6).
- Analysis: studies were read against eight guiding questions (timing of rubric provision, explanation of rubric content, explanation/training for formative use, revision opportunity, feedback before revision, rubric design support, self/peer assessment linkage); extracts were compared for similarities and differences and checked against effect sizes.
Limitations
- Stated by the authors: the review rests on a limited sample of high-quality experimental/quasi-experimental studies from one meta-analysis, so other strategies (e.g. co-constructing rubrics, evaluating sample essays) were absent and may also matter; analysis relied on available text only, so missing procedural details mean findings should be treated as hypotheses; possible publication bias; and the study-quality instrument has not been thoroughly validated, so measurement error is expected.
- Evident from the text: the coarse categorisation in Table 2 is acknowledged by the authors as not doing justice to the variation and complexity of the studies, and they state no conclusions can be drawn from the table alone; several cells are "not clearly stated," limiting inference.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 2 Not valid · 43 Not checked · 42 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Yet, we currently have limited insights into what these factors might be, and how they influence the outcome of rubric interventions (Brookhart, 2018; Panadero et al., 2023).”
What the sources say
- Supportedcites Brookhart, 2018 source
Brookhart's review states that across the studies of rubric effects on learning/motivation 'no discernable pattern was found regarding type of rubric' (Relation of Rubric Type to Reliability, Validity, and Learning), attributing this at least partly to publication bias and a small sample of 13 studies, and repeating in the summary (Plds, Performance Level Descriptions.) that reliability, validity and learning effects were not related to rubric type. The same section closes by saying the review 'did not establish this fact' about performance level descriptions and that 'More research is needed that establishes how performance level descriptions function during learning and, more generally, how students use rubrics for learning, not just that they do.' Together these directly support the paraphrased point that we currently have limited insight into which rubric characteristics influence intervention outcomes and how; the only narrowing is that Brookhart's evidence base is higher-education studies and her candidate factors are rubric type/quality. (LLM, conf=0.85)
- Not matchedcites Panadero et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A prevalent feature of studies reporting on successful interventions is that the teacher (or someone else) clearly explains the meaning of the content in the rubric.”
- Also stated in: § Results · plain
“First, the teacher (or sometimes someone else) explains the meaning of the content in the rubric, as well as how to use the rubric for formative purposes.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In fact, several effect sizes in this category were negative.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, the level of detail on the intervention characteristics was minimal in several studies.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There are a number of studies in the sample where the students used different rubrics for slightly different tasks or prompts, resulting in (sometimes quite large) variations in student performance.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
37 more claims
Create a free account to see all 88 claims and to verify the 32 references still open.
- Probably not a substantial claim. 24
- It may state two separate claims as one. 31
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Materials and methods
“with 40 accompanying effect sizes ranging from −0.51 to 1.62”
§ Materials and methods > 0.123 0.042
“Montanero et al. (2014) Elementary-middle school 8 −0.250 0.031 −0.164 0.031”
Citations
Cites
(1996) · Institutional Research Information System University of Turin (University of Turin) · doi:10.1111/j · Cited by 5,486
Hattie, J. (2012) · doi:10.4324/9780203181522 · Cited by 2,155
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · cited 3×
“Rubrics have the potential of promoting student learning, supposedly by making expectations and criteria explicit (Jonsson & Svingby, 2007; Panadero & Jönsson, 2013).”
Educative assessment: designing assessments to inform and improve student performance
(1999) · Choice Reviews Online · doi:10.5860/choice.36-2887 · Cited by 931
A review of rubric use in higher education
Reddy, Y. M., & Andrade, H. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930902862859 · Cited by 917
The use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839
Self-citationEffects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses
Panadero, E., Jonsson, A., & Botella, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.08.004 · Cited by 712
Self-citationIndeterminacy in the use of preset criteria for assessment and grading
Sadler, D. R. (2009) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930801956059 · Cited by 489
Torrance, H. (2007) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/09695940701591867 · Cited by 420
Assessment rubrics: towards clearer and more replicable design, research and practice
Dawson, P. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1111294 · Cited by 368
Research works printed but not linked: 2
- *Bohlin S. L. (2000). Effectiveness of instruction in rubric use in improving fourth-grade students’ science open-response outcomes (Publication No. 304607287) [Doctoral dissertation]. University of Massachusetts Lowell ProQuest Digital Dissertations database.
- *Brewer D. (2002). Teaching writing in science through the use of a writing rubric (Publication No. 1760593502) [Doctoral dissertation]. University of Michigan-Flint ProQuest Digital Dissertations database.
Cited by
Sukenti, D., Idris, N. S., Bonk, C. J., Hani’ah, H., Tupas, J. B., Febria, R., & Syafitri, W. (2025) · Journal of Instruction and Islamic Religious Education · doi:10.63826/jiire.v1i2.172 · Cited by 23
Pulido, B. H. B., Pulido, P. E. B., Saldarriaga, J. A. P., & Alcívar, C. L. C. (2025) · Revista Científica de Innovación Educativa y Sociedad Actual "ALCON" · doi:10.62305/alcon.v5i5.807 · Cited by 7
Pinedo, L., Panadero, E., Ruiz, J. F., & García-Pérez, D. (2025) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2025.2565384 · Cited by 7
Self-citationPanadero, E., Pinedo, L., Fernández-Ortube, A., Zamorano, D., Barrenetxea-Mínguez, L., & Sánchez‐Iglesias, I. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09468-y · Cited by 4
Self-citationPlacing students at the centre: new directions for student agency in assessment
DeLuca, C. (2025) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2025.2523162 · Cited by 4
Metadata
- Authors
- Jonsson, A., Panadero, E., Pinedo, L., & Fernández-Castilla, B.
- Affiliations
- Kristianstad University
- Dublin City University (IE)
- Universidad de Deusto (ES)
- Universidad Nacional de Educación a Distancia
- Venue
- Assessment in Education: Principles, Policy & Practice
- Publisher
- Informa UK Limited
- Published
- 2025-03-04
- Volume
- 32
- Issue
- 2
- Pages
- 192-211
- ISSN
- 0969-594X (ISSN-L)
- 1465-329X
- OpenAlex
- W4409068601
- Cited by
- 33
- References
- 41
- Citations by year
- 2026: 22 · 2025: 10
- FWCI
- 25.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Assessment in Education Principles Policy and Practice (publishedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- rubrics, formative assessment, academic performance, teacher explanations, feedback, self-assessment, revision, effect size, student learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using rubrics for formative purposes: identifying factors that may affect the success of rubric implementations. https://app.cochat.ai/papers/10.1080/0969594x.2025.2486947
- The paper
- Jonsson, A., Panadero, E., Pinedo, L., & Fernández-Castilla, B. (2025). Using rubrics for formative purposes: identifying factors that may affect the success of rubric implementations. Assessment in Education: Principles, Policy & Practice. https://doi.org/10.1080/0969594x.2025.2486947
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.