Factors promoting and hindering data-based decision making in schools
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Although data-based decision making can lead to improved student achievement, data are often not used effectively in schools. This paper therefore focuses on conditions for effective data use. We studied the extent to which school organizational characteristics, data characteristics, user characteristics, and collaboration influenced data use for (1) accountability, (2) school development, and (3) instruction. The results of our hierarchical linear modeling (HLM) analysis from this large-scale quantitative study (N = 1073) show that, on average, teachers appear to score relatively high on data use for accountability and school development. Regarding instruction, however, several data sources are used only on a yearly basis. Among the factors investigated, school organizational characteristics and collaboration have the greatest influence on teachers’ data use in schools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Those Who Understand: Knowledge Growth in Teaching
SHULMAN, L. S. (1986) · Educational Researcher · doi:10.3102/0013189x015002004 · Cited by 18,546
Desimone, L. M. (2009) · Educational Researcher · doi:10.3102/0013189x08331140 · Cited by 4,862 · cited 1×
“We therefore need a more fundamental understanding of the characteristics of data use-related professional development (PD) (Desimone, 2009), and the conditions under which this PD is e ff ective (Coburn & Turner, 2012; Marsh, 2012).”
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Horn, I. S., & Little, J. W. (2010) · American Educational Research Journal · doi:10.3102/0002831209345158 · Cited by 762 · cited 3×
“Teachers should collaborate on how to use data to improve their school and their students ’ learning (Copland, 2003; Datnow et al., 2013; Horn & Little, 2010; Means, Padilla, & Gallagher, 2010; Nelson & Slavit, 2007; Park & Datnow, 2009; Spillane, 2012; Wohlstetter et al., 2008).”
A Systemic View of Implementing Data Literacy in Educator Preparation
Mandinach, E. B., & Gummer, E. S. (2013) · Educational Researcher · doi:10.3102/0013189x12459803 · Cited by 492
Handbook of Human and Social Conditions in Assessment
(2016) · doi:10.4324/9781315749136 · Cited by 447
Data-informed curriculum reform: Which data, what purposes, and promoting and hindering factors
Schildkamp, K., & Kuiper, W. (2010) · Teaching and Teacher Education · doi:10.1016/j.tate.2009.06.007 · Cited by 406 · cited 8×
“…for Improving School and Student Performance, 2011; Geijsel, Sleegers, Stoel, & Krüger, 2009; Kelly, Downey, & Rietdijk, 2010; Schildkamp, 2007; Schildkamp & Kuiper, 2010; Schildkamp & Teddlie, 2008; Vanhoof, Verhaeghe, Verhaeghe, Valcke, & Van Petegem; 2011; Verhaeghe, Vanhoof, Valcke, & Van…”
InfluentialSelf-citationAccountability Policies and Teacher Decision Making: Barriers to the Use of Data to Improve Practice
Ingram, D., Louis, K. S., & Schroeder, R. G. (2004) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1111/j.1467-9620.2004.00379.x · Cited by 373
Kerr, K. A., Marsh, J. A., Ikemoto, G. S., Darilek, H., & Barney, H. (2006) · American Journal of Education · doi:10.1086/505057 · Cited by 341
Interventions Promoting Educators’ Use of Data: Research Insights and Gaps
Marsh, J. A. (2012) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811211401106 · Cited by 328
Data in Practice: Conceptualizing the Data-Based Decision-Making Phenomena
Spillane, J. P. (2012) · American Journal of Education · doi:10.1086/663283 · Cited by 308
Teachers’ Use of Data: Loose Coupling, Agenda Setting, and Team Norms
Young, V. M. (2006) · American Journal of Education · doi:10.1086/505058 · Cited by 281
Carlson, D., Borman, G. D., & Robinson, M. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711412765 · Cited by 249 · cited 4×
“The link between data use and improved student achievement (Campbell & Levin, 2009; Carlson et al., 2011; Lai et al., 2009; McNaughton et al., 2012) usually goes through teachers actually improving their instruction in the classroom based on data.”
InfluentialCreating a system for data-driven decision-making: applying the principal-agent framework
Wohlstetter, P., Datnow, A., & Park, V. (2008) · School Effectiveness and School Improvement · doi:10.1080/09243450802246376 · Cited by 248
Ikemoto, G. S., & Marsh, J. A. (2007) · Yearbook of the National Society for the Study of Education · doi:10.1111/j.1744-7984.2007.00099.x · Cited by 244 · cited 1×
“These data can be used to inform decision making in schools, which is called data-based decision making (Bernhardt, 2013; Boudett, City, & Murnane, 2005; Ikemoto & Marsh, 2007; Schildkamp & Lai, 2013; Wayman, Jimerson, & Cho, 2012).”
Park, V., & Datnow, A. (2009) · School Leadership & Management · doi:10.1080/13632430903162541 · Cited by 227 · cited 4×
“Teachers should collaborate on how to use data to improve their school and their students ’ learning (Copland, 2003; Datnow et al., 2013; Horn & Little, 2010; Means, Padilla, & Gallagher, 2010; Nelson & Slavit, 2007; Park & Datnow, 2009; Spillane, 2012; Wohlstetter et al., 2008).”
InfluentialUnderstanding Data Use Practice among Teachers: The Contribution of Micro-Process Studies
Little, J. W. (2012) · American Journal of Education · doi:10.1086/663271 · Cited by 220
Making Sense of Data-Driven Decision Making in Education: Evidence from Recent RAND Research
(2006) · RAND Corporation eBooks · doi:10.7249/op170 · Cited by 202
Factors Influencing the Functioning of Data Teams
Schildkamp, K., & Poortman, C. (2015) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811511700403 · Cited by 185
Self-citationMarsh, J. A., Sloan McCombs, J., & Martorell, F. (2010) · Educational Policy · doi:10.1177/0895904809341467 · Cited by 181
Exploring data use practices around Europe: Identifying enablers and barriers
Schildkamp, K., Karbautzki, L., & Vanhoof, J. (2014) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.007 · Cited by 168 · cited 4×
“For example, Schildkamp et al. (2014) concluded from a qualitative case study in fi ve di ff erent countries, including the UK, that schools are more focused on data use for accountability than on data use for school development and instruction.”
InfluentialSelf-citationData-based Decision Making: An Overview
Lai, M. K., & Schildkamp, K. (2013) · Data-based Decision Making in Education · doi:10.1007/978-94-007-4816-3_2 · Cited by 167 · cited 1×
“Several data use theories of action exist (see, e.g., Boudett et al., 2005; Earl & Katz, 2006; Lai & Schildkamp, 2013; Mandinach et al., 2008; Marsh, 2012; Schildkamp & Poortman, 2015).”
Self-citationOrganizational considerations in establishing the Data-Informed District
Wayman, J. C., Jimerson, J. B., & Cho, V. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2011.652124 · Cited by 122
Identifying and Monitoring Students' Learning Needs With Technology
Chen, E., Heritage, M., & Lee, J. (2005) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr1003_6 · Cited by 93 · cited 1×
“The data that teachers have available should be up to date and accurate (Breiter & Light, 2006; Chen, Heritage, & Lee, 2005; Datnow et al., 2007; Earl & Fullan, 2003; Halverson, 2010; Kerr et al., 2006; Schildkamp & Kuiper, 2010; Sharkey & Murnane, 2006; Wayman et al., 2007; Wayman & String fi eld,…”
McNaughton, S., Lai, M. K., & Hsiao, S. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2011.652126 · Cited by 77 · cited 2×
“The link between data use and improved student achievement (Campbell & Levin, 2009; Carlson et al., 2011; Lai et al., 2009; McNaughton et al., 2012) usually goes through teachers actually improving their instruction in the classroom based on data.”
School performance feedback systems in the USA and in The Netherlands: a comparison
Schildkamp, K., & Teddlie, C. (2008) · Educational Research and Evaluation · doi:10.1080/13803610802048874 · Cited by 76
Self-citationNelson, T. H., & Slavit, D. (2007) · Journal of In-Service Education · doi:10.1080/13674580601157620 · Cited by 59 · cited 4×
“Teachers should collaborate on how to use data to improve their school and their students ’ learning (Copland, 2003; Datnow et al., 2013; Horn & Little, 2010; Means, Padilla, & Gallagher, 2010; Nelson & Slavit, 2007; Park & Datnow, 2009; Spillane, 2012; Wohlstetter et al., 2008).”
InfluentialStudent group differences in examination results and utilization for policy and school development
Schildkamp, K., Rekers-Mombarg, L. T. M., & Harms, T. J. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2011.652123 · Cited by 35
Self-citation
Research works printed but not linked: 53
- Allensworth E., 2008, From high school to the future: ACT preparation – Too much, too late. Why ACT scores are low in Chicago and what it means for schools
- Bernhardt V. L., 2013, Data analysis for continuous school improvement
- Boudett K. P., 2005, Data wise: A step-by-step guide to using assessment results to improve teaching and learning
- Breiter A., 2006, Educational Technology & Society, 9, 206
- 10.1007/s11092-008-9063-x · DOI
- Chahine S., 2009, Evaluation of the utility of PSAT/NMSQT tools for educators (Final Report for the College Board Fellowship Project Number: 2009-045)
- 10.1086/505056 · DOI · Paper page
- Coburn C. E., 2009, Teachers College Record, 111, 1115, 10.1177/016146810911100403 · DOI · Paper page
- 10.1080/15366367.2011.626729 · DOI · Paper page
- 10.1086/663272 · DOI · Paper page
- Cochran W. G., 1997, Sampling techniques
- Copland M. A., 2003, Leadership lessons from comprehensive school reform, 159
- Daly A. J., 2012, Teachers College Record, 114, 1, 10.1177/016146811211401103 · DOI · Paper page
- 10.1108/09578231311311500 · DOI · Paper page
- Datnow A., 2007, Achieving with data: How high-performing school systems use data to improve instruction for elementary students
- 10.1111/j.1467-9620.2004.00375.x · DOI · Paper page
- 10.1080/0305764032000122023 · DOI · Paper page
- Earl L. M., 2006, Leading schools in a data-rich world. Harnessing data for school improvement
- 10.1080/09243453.2011.652127 · DOI · Paper page
- Field A., 2009, Discovering statistics using SPSS
- 10.1086/593940 · DOI · Paper page
- 10.1080/01619561003685270 · DOI · Paper page
- Hamilton L. S., 2009, Standards-based reform in the United States: History, research, and future directions
- Hargreaves A., 2013, Data–driven improvement and accountability
- Harlen W., 2007, The quality of learning: Assessment alternatives for primary education
- Hattie J., 2009, Visible learning: A synthesis of over 800 meta-analyses relating to achievement
- Kelly A., 2010, Data dictatorship and data democracy: Understanding professional attitudes to the use of pupil performance data in schools
- 10.1111/j.1744-7984.2007.00098.x · DOI
- Knapp M. S., 2006, Data-informed leadership in education
- 10.1007/978-94-007-4816-3_3 · DOI
- 10.1007/s11092-009-9071-5 · DOI · Paper page
- 10.1080/00461520.2012.667064 · DOI · Paper page
- Mandinach E., 2008, Data-driven school improvement: Linking data and learning, 13
- Means B., 2010, Use of education data at the local level: From accountability to instructional improvement
- 10.1177/0013161X08321506 · DOI · Paper page
- van Onderwijs Ministerie, 2000, Wet op het onderwijstoezicht [Education supervision act]
- Neter J., 1974, Applied linear statistical models
- Newman A., 2009, Statistical and methodological myths and urban legends: Doctrine, verity, and fable in the organizational and social sciences, 7
- Poortman C. L., 2015, School improvement effects of a data use intervention for teachers
- Schildkamp, K. (2007).The utilisation of a self-evaluation instrument for primary education(Doctoral dissertation). Enschede, The Netherlands: University of Twente. Retrieved from http://doc.utwente.nl/57803/1/thesis_Schildkamp.pdf
- 10.1007/978-94-007-4816-3_10 · DOI
- 10.1007/978-94-007-4816-3 · DOI · Paper page
- 10.1080/09243450802605506 · DOI · Paper page
- 10.1086/505060 · DOI · Paper page
- Snijders T. A. B., 1999, Multilevel analysis. An introduction to basic and advanced multilevel modeling
- Supovitz J. A., 2003, Mapping a course for improved student learning: How innovative schools systematically use performance data to guide improvement
- 10.1080/02671520902867077 · DOI · Paper page
- 10.1080/03055698.2010.482771 · DOI · Paper page
- 10.1080/09243450903396005 · DOI · Paper page
- Wayman J. C., 2007, The Data-Informed District: A district-wide evaluation of data use in the Natrona County school district
- Wayman J. C., 2010, Improving data use in NISD: Becoming a Data-Informed District
- 10.1007/978-94-007-4816-3_8 · DOI
- 10.1086/505055 · DOI
Cited by
Data-based decision-making for school improvement: Research insights and gaps
Schildkamp, K. (2019) · Educational Research · doi:10.1080/00131881.2019.1625716 · Cited by 347
Self-citationKippers, W. B., Wolterinck, C. H. D., Schildkamp, K., Poortman, C. L., & Visscher, A. J. (2018) · Teaching and Teacher Education · doi:10.1016/j.tate.2018.06.015 · Cited by 119
Self-citationAgasisti, T., & Bowers, A. J. (2017) · Handbook of Contemporary Education Economics · doi:10.4337/9781785369070.00014 · Cited by 83
The effects of a data use intervention on educators’ satisfaction and data literacy
Ebbeler, J., Poortman, C. L., Schildkamp, K., & Pieters, J. M. (2017) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-016-9251-z · Cited by 77
Self-citationWe agree on what we see: Teacher and student perceptions of formative assessment practice
Veugen, M. J., Gulikers, J. T. M., & den Brok, P. (2021) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2021.101027 · Cited by 77
Metadata
- Authors
- Schildkamp, K., Poortman, C., Luyten, H., & Ebbeler, J.
- Venue
- School Effectiveness and School Improvement
- Publisher
- Informa UK Limited
- Published
- 2016-11-16
- Volume
- 28
- Issue
- 2
- Pages
- 242-258
- ISSN
- 0924-3453 (ISSN-L)
- 1744-5124
- OpenAlex
- W140181266
- Cited by
- 192
- References
- 28
- FWCI
- 17.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.