The DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index; 13 of the 71 sources its claims cite were checked for support.
Data-based decision-making for school improvement: Research insights and gaps
Open accessAbstract
Background: Data-based decision-making in education often focuses on the use of summative assessment data in order to bring about improvements in student achievement. However, many other sources of evidence are available across a wide range of indicators. There is potential for school leaders, teachers and students to use these diverse sources more fully to support their work on a range of school improvement goals.Purpose and sources of evidence: To explore data-based decision-making for school improvement, this theoretical paper discusses recent research and literature from different areas of data use in education. These areas include the use of formative assessment data, educational research study findings and ‘big data’. In particular, the discussion focuses on how school leaders and teachers can use different sources of data to improve the quality of education.Main argument: Based on the literature reviewed, an iterative model of data use for school improvement is described, consisting of defining goals for data use, collecting different types of data or evidence (e.g. formal data, informal data, research evidence and ‘big data’), sense-making, taking improvement actions and evaluation. Drawing on the literature, research insights are discussed for each of these components, as well as identification of the research gaps that still exist. It is noted that the process of data use does not happen in isolation: data use is influenced by system, organisation and team/individual level factors.Conclusions: When it comes to using data to improve the quality of teaching and learning, it is evident that some of the most important enablers and barriers include data literacy and leadership. However, what is less well understood is how we can promote the enablers and remove the barriers to unlock, more fully, the potential of data use. Only then can data use lead to sustainable school improvement.
Overview
CoChat Summary
TL;DR
This theoretical paper synthesizes literature on data-based decision-making for school improvement and presents an iterative model comprising goal setting, data collection, sense-making, action, and evaluation. It argues that data use is shaped by system, organisation, and team/individual factors, with data literacy and leadership as key enablers and barriers, while identifying gaps in how to promote enablers and remove barriers.
Key findings
- The paper proposes an iterative data-use model for school improvement: defining goals, collecting different types of data or evidence (formal data, informal data, research evidence, and “big data”), sense-making, taking improvement actions, and evaluation.
- Data use can serve accountability, school development, and instructional goals, but there is tension between improvement and accountability; an overemphasis on accountability can lead to unintended consequences such as “gaming the system,” “teaching to the test,” excluding weaker students, and encouraging low-performing students to drop out.
- Important enablers and barriers include data literacy and leadership; school leaders need data literacy skills to monitor, model, scaffold, guide, and encourage data use, and a compliance orientation will not lead to authentic or sustained data use.
- Research gaps include how to promote enablers and remove barriers to unlock data use, less attention to data use by policy-makers and students, how to translate data into improved classroom practice, sustainability of interventions, measuring twenty-first-century goals, and social, technical, and ethical implications of big data. The paper also notes that Schildkamp and Poortman (2019) identified and analysed 11 data use interventions, and that the data team intervention has been used in The Netherlands, Sweden, Belgium, England, and the USA, with results indicating increased data literacy and several schools improving student achievement.
Methods
- Design: theoretical discussion paper, not an empirical study; it draws on recent research and literature from different areas of data use in education, including formative assessment data, educational research study findings, and “big data.”
- Data or sample: no primary sample or dataset; the discussion is informed by a range of relevant literature, including five recent review studies in the area.
- Main analysis: conceptual synthesis and development of an iterative model of data use for school improvement, with discussion of research insights and identification of research gaps for each component.
Limitations
- The paper states that a systematic literature review in all the research fields described (data use, formative assessment, research use, and big data) was beyond the scope and intention of this theoretical discussion paper, and that many more possibilities and challenges exist than could be discussed in one paper.
- The paper states that further research is necessary to investigate the approaches and processes presented and to provide different stakeholders with practical examples.
- Evident from the text: as a theoretical paper, it does not present original empirical data or a systematic search strategy, so its conclusions rely on selected literature and the author’s synthesis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 Valid · 2 Not valid · 32 Not checked · 23 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Research has suggested that data-based decision-making (data use) can contribute to increased student learning and achievement (e.g. Lai et al. 2014; McNaughton, Lai, and Hsaio 2012; Poortman and Schildkamp 2016; Van Geel et al. 2016).”
What the sources say
- Not matchedcites Lai et al. 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites McNaughton, Lai, and Hsaio 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Poortman and Schildkamp 2016 source
The Introduction states that teachers can use data to identify students’ learning needs and adapt instruction, which can lead to increased student learning and achievement. This directly supports the citing sentence’s qualified claim that data use can contribute to those outcomes. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Encouragingly, research results indicated that participation in the intervention led to increased data literacy (Ebbeler et al. 2017; Kippers et al. 2018).”
What the sources say
- Supportedcites Ebbeler et al. 2017 source
Section 3.3 reports that data team members scored significantly higher on the data literacy knowledge test after the intervention than before it. It also reports significantly greater gains in data literacy skills and attitude among teachers in data team schools than in comparison schools. (LLM, conf=0.94)
- Supportedcites Kippers et al. 2018 source
The Conclusions and discussion section reports that educators’ data literacy increased significantly after the data use intervention, with a medium-to-large effect on the data literacy test. The paper used a single-group pre-post design, so the finding supports the claim as a report of increased literacy among participants, not as a controlled causal test. (LLM, conf=0.91)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“in order for this to happen, we argue that there is a need for them to connect the data to their own functioning (Schildkamp, Poortman, and Handelzalts 2016).”
What the sources say
- Supportedcites Schildkamp, Poortman, and Handelzalts 2016 source
In “Depth of inquiry and attribution” (page not available), the paper says teachers need to look at internal causes of educational problems. “Attribution in the teams” reports that the teams that investigated hypotheses about their own functioning consequently took action at that level. This supports the citing sentence’s connection between examining one’s own functioning and taking data-informed action. (LLM, conf=0.90)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Studies (e.g. Gelderblom et al. 2016; Wayman, Jimerson, and Cho 2012) have shown that the availability of data does not ensure the actual use of data to make changes in the instructional practices that happen in the classroom.”
What the sources say
- Supportedcites Gelderblom et al. 2016 source
The Major findings section (6.1) says that collecting and analysing data does not necessarily result in instructional improvement. The findings in section 5.2 likewise report that data use sometimes increased teachers’ awareness without leading to concrete changes in classroom instruction. This supports the claim that having data available does not ensure its use to change instructional practice. (LLM, conf=0.94)
- Not checked — no full text of the sourcecites Wayman, Jimerson, and Cho 2012 source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In a data team study, Poortman and Schildkamp (2016) discovered that using data to improve the quality of education in most cases includes the use of data for three important pillars of school improvement”
What the sources say
- Partly supportedcites Poortman and Schildkamp 2016 sourceExperimental — accuracy not yet measured
Section 6.3 (Implications for practice; page unavailable) identifies curriculum, assessment, and instruction as three school-improvement pillars. It says that subject-focused teams that solved their problems took measures in these areas and suggests that attending to all three improves their chances of success. It does not establish that data use includes all three in most cases. (LLM, conf=0.87)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
20 more claims · 2 with their cited sources checked
Create a free account to see all 65 claims and to verify the 5 references still open.
- Probably not a substantial claim. 35
- It may state two separate claims as one. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Thirdly, teachers’ data literacy extends to understanding of the school culture surrounding data utilization (e.g., Andersen, 2020; Schildkamp, 2019; Wachen et al., 2018).”
From Dimensions of teachers’ data literacy: A systematic review of literature from 1990 to 2021 (2024) · cites this paper as Schildkamp, 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unfortunately, although teachers collect a great deal of data, they rarely use it explicitly in decision making for individual students' progress [7].”
From Using Evidence-Based Practice and Data-Based Decision Making in Inclusive Education (2021) · cites this paper as [7]
Experimental — accuracy not yet measured
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Gioia, D. A., Mehra, A., & Weick, K. E. (1996) · The Academy of Management Review · doi:10.2307/259169 · Cited by 15,614
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“Black and Wiliam (1998) referred in this context to profound changes in the way in which teachers view their own role and considerable changes in their daily practices in the classroom.”
BackgroundYeh, M.-L. (2014) · Journal of Nursing Research · doi:10.1097/jnr.0000000000000065 · Cited by 3,829
Developing the theory of formative assessment
Black, P., & Wiliam, D. (2009) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-008-9068-5 · Cited by 3,301 · cited 1×
“Equally, students’ development of self-regulated learning skills – i.e. the process of students taking responsibility for their own learning (Black and Wiliam 2009) – is another such area where data may not have been collected.”
BackgroundThe Cambridge handbook of thinking and reasoning
Holyoak, K. J., & Morrison, B. (2005) · Virtual Defense Library (Ministerio de Defensa) · Cited by 2,246
Below the Bubble: “Educational Triage” and the Texas Accountability System
Booher-Jennings, J. (2005) · American Educational Research Journal · doi:10.3102/00028312042002231 · Cited by 762 · cited 1×
“Finally, data can also be misused or abused – for example, when so-called ‘teaching to the test’ occurs or when attention is placed solely on the students on the verge of achieving some kind of threshold or benchmark (Booher-Jennings 2005).”
Background(2021) · The Professional Educator · doi:10.47038/tpe · Cited by 601
A Systemic View of Implementing Data Literacy in Educator Preparation
Mandinach, E. B., & Gummer, E. S. (2013) · Educational Researcher · doi:10.3102/0013189x12459803 · Cited by 492
Coburn, C. E. (2006) · American Educational Research Journal · doi:10.3102/00028312043003343 · Cited by 463
Research works printed but not linked: 11
- Clarke S., 2016, Educational Accountability: International Perspectives on Challenges and Possibilities for School Leadership, 6
- Earl L., 2015, Leading the Use of Research and Evidence in Schools, 146
- 10.1002/rrq.2014.49.issue-3 · doi:10.1002/rrq.2014.49.issue-3
- Laney D., 2001, META Group Inc., 949, 1
- Murray J., 2014, Professional Educator, 38, n1
- Schenke W., 2018, Datagebruik in Het Onderwijs. Problematiek Uiteengezet [Data Use in Education: An Overview of the Problems]
- Stoll L., 2015, Leading and Managing, 21, 75
- Tulowitzki P., 2016, Educational Accountability: International Perspectives on Challenges and Possibilities for School Leadership, 233
- Van Merrienboer J. J. G., 1997, Training Complex Cognitive Skills
- Van Petegem P., 2004, Pedagogische Studiën, 81, 338
- Veldkamp B. P., 2017, [Report: Exploration of Big Data in Education in the Netherlands]
Cited by
Misconceptions about data-based decision making in education: An exploration of the literature
Mandinach, E. B., & Schildkamp, K. (2021) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2020.100842 · Cited by 209
Self-citationSchool accountability and teacher stress: international evidence from the OECD TALIS study
Jerrim, J., & Sims, S. (2021) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-021-09360-0 · Cited by 161
What is the evidence on the best way to get evidence into use in education?
Gorard, S. A. C., See, B. H., & Siddiqui, N. (2020) · Review of Education · doi:10.1002/rev3.3200 · Cited by 138
Kanopka, K., Claro, S., Loeb, S., West, M. R., & Fricke, H. (2024) · AERA Open · doi:10.1177/23328584241233277 · Cited by 77
Lin, R., Yang, J., Jiang, F., & Li, J. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11274-3 · Cited by 136
Metadata
- Authors
- Schildkamp, K.
- Affiliations
- University of Twente (NL)
- Corresponding author
- Schildkamp, Kim
- ORCID
- Schildkamp, Kim
- Venue
- Educational Research
- Publisher
- Informa UK Limited
- Published
- 2019-06-12
- Volume
- 61
- Issue
- 3
- Pages
- 257-273
- ISSN
- 0013-1881 (ISSN-L)
- 1469-5847
- OpenAlex
- W2951965635
- Cited by
- 347
- References
- 72
- Citations by year
- 2026: 64 · 2025: 62 · 2024: 61 · 2023: 57 · 2022: 39 · 2021: 44 · 2020: 19 · 2019: 1
- FWCI
- 30.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Educational Research (publishedVersion, cc-by-nc-nd)
- University of Twente Research Information (publishedVersion, cc-by-nc-nd)
- University of Twente Research Information (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Education › Educational Assessment and Improvement
- Social Sciences › Education › Teacher Education and Leadership Studies
- Social Sciences › Education › Educational Leadership and Practices
- Keywords
- data-driven decision making, school improvement, big data in education, research utilization, sensemaking, data literacy, educational leadership, teaching and learning quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data-based decision-making for school improvement: Research insights and gaps. https://app.cochat.ai/papers/10.1080/00131881.2019.1625716
- The paper
- Schildkamp, K. (2019). Data-based decision-making for school improvement: Research insights and gaps. Educational Research. https://doi.org/10.1080/00131881.2019.1625716
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.