Multiple initiatives, multiple challenges: The promise and pitfalls of implementing data
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In several DBDM studies, teachers indicated they were only using data because they felt forced to do so or felt pressured by the accountability system, and not because they believed data use to be important for improving classroom practice.
“In several DBDM studies, teachers indicated they were only using data because they felt forced to do so or felt pressured by the accountability system (e.g., social pressure), and not because they believed data use to be important for improving classroom practice”
From Formative assessment: A systematic review of critical teacher prerequisites for classroom practice (2020) · cites this paper as Hubbard et al., 2014
Educators were likely to use data only in subjects in which there are regular benchmark assessments for accountability purposes, such as language and mathematics.
“A study by Hubbard et al. (2014) showed that educators were likely to use data only in subjects in which there are regular benchmark assessments for accountability purposes, such as language and mathematics.”
From Formative assessment: A systematic review of critical teacher prerequisites for classroom practice (2020) · cites this paper as Hubbard et al. (2014)
In the DBDM studies, data use was often linked to accountability and high stakes testing, and not to improvement.
“In the DBDM studies, data use was often linked to accountability and high stakes testing, and not to improvement”
From Formative assessment: A systematic review of critical teacher prerequisites for classroom practice (2020) · cites this paper as Hubbard et al., 2014
Cites
(1984) · Cited by 81,983 · see citing works
(2006) · Cited by 18,730 · see citing works
(1998) · Medical Entomology and Zoology · Cited by 18,397 · see citing works
The Art of Case Study Research
Johnson, K. E., & Stake, R. E. (1996) · Modern Language Journal · doi:10.2307/329758 · Cited by 15,830 · see citing works
Constructing Grounded Theory. A Practical Guide Through Qualitative Analysis
Boyle, C., & Barker, A. (2006) · QMiP Bulletin · doi:10.53841/bpsqmip.2006.1.2.36 · Cited by 11,842 · see citing works
Case study research: Design and methods
McCorcle, M. D., & Bell, E. L. (1986) · Evaluation and Program Planning · doi:10.1016/0149-7189(86)90052-2 · Cited by 5,884 · see citing works
Policy Implementation and Cognition: Reframing and Refocusing Implementation Research
Spillane, J. P., Reiser, B. J., & Reimer, T. (2002) · Review of Educational Research · doi:10.3102/00346543072003387 · Cited by 1,923 · see citing works
Coburn, C. E. (2001) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737023002145 · Cited by 1,190 · see citing works
Fullan, M. G. (2005) · Routledge eBooks · doi:10.4324/9780203976708 · Cited by 1,057 · see citing works
Horn, I. S., & Little, J. W. (2010) · American Educational Research Journal · doi:10.3102/0002831209345158 · Cited by 762 · see citing works
Interventions Promoting Educators’ Use of Data: Research Insights and Gaps
Marsh, J. A. (2012) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811211401106 · Cited by 328 · see citing works
Data in Practice: Conceptualizing the Data-Based Decision-Making Phenomena
Spillane, J. P. (2012) · American Journal of Education · doi:10.1086/663283 · Cited by 308 · see citing works
(2009) · ScholarlyCommons (University of Pennsylvania) · Cited by 300 · see citing works
Leading Schools in a Data-Rich World
Earl, L. M., & Katz, S. (2002) · Springer eBooks · doi:10.1007/978-94-010-0375-9_34 · Cited by 284 · see citing works
Teachers’ Use of Data: Loose Coupling, Agenda Setting, and Team Norms
Young, V. M. (2006) · American Journal of Education · doi:10.1086/505058 · Cited by 281 · see citing works
The Practice of Data Use: An Introduction
Coburn, C. E., & Turner, E. O. (2012) · American Journal of Education · doi:10.1086/663272 · Cited by 254 · see citing works
Ikemoto, G. S., & Marsh, J. A. (2007) · Yearbook of the National Society for the Study of Education · doi:10.1111/j.1744-7984.2007.00099.x · Cited by 244 · see citing works
Supovitz, J. A. (2009) · Journal of Educational Change · doi:10.1007/s10833-009-9105-2 · Cited by 206 · see citing works
Data-based Decision Making in Education
Schildkamp, K., Lai, M. K., & Earl, L. M. (2012) · Springer eBooks · doi:10.1007/978-94-007-4816-3 · Cited by 195 · see citing works
(2010) · US Department of Education · Cited by 176 · see citing works
Using Data in Leadership for Learning
Earl, L. M., & Fullan, M. J. (2003) · Cambridge Journal of Education · doi:10.1080/0305764032000122023 · Cited by 170 · see citing works
(2008) · Cited by 167 · see citing works
Levin, J. A., & Datnow, A. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2011.599394 · Cited by 159 · see citing works
Self-citationData, Dyads, and Dynamics: Exploring Data Use and Social Networks in Educational Improvement
Daly, A. J. (2012) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146811211401103 · Cited by 142 · see citing works
School–Central Office Relationships in Evidence Use: Understanding Evidence Use as a Systems Problem
Honig, M. I., & Venkateswaran, N. (2012) · American Journal of Education · doi:10.1086/663282 · Cited by 133 · see citing works
A Theoretical Framework for Data-Driven Decision Making
Mandinach, E. B., Honey, M., & Light, D. (2006) · Cited by 117 · see citing works
Cutting through the “Data-Driven” Mantra: Different Conceptions of Data-Driven Decision Making
Ikemoto, G. S., & Marsh, J. A. (2007) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146810710901310 · Cited by 116 · see citing works
Marsh, J. A., Kerr, K. A., Ikemoto, G. S., Darilek, H., Suttorp, M. J., Zimmer, R., & Barney, H. (2005) · PsycEXTRA Dataset · doi:10.1037/e658482010-001 · Cited by 70 · see citing works
When Improvement Programs Collide
Hatch, T. (2002) · Phi Delta Kappan · doi:10.1177/003172170208300812 · Cited by 58 · see citing works
Dowd, A. C. (2005) · Issue Lab (Candid) · Cited by 53 · see citing works
Uses and misuses of data for educational accountability and improvement
Herman, J. L., & Haertel, E. H. (2005) · Blackwell eBooks · Cited by 47 · see citing works
Exploring the Macro-Micro Dynamic in Data Use Practice
Moss, P. (2012) · American Journal of Education · doi:10.1086/663274 · Cited by 29 · see citing works
Exploring Coherence as an Organizational Resource for Carrying Out Reform Initiatives
Madda, C. L., Halverson, R. R., & Gomez, L. M. (2007) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146810710900803 · Cited by 23 · see citing works
Statistical Misunderstandings of the Properties of School Scores and School Accountability
Rogosa, D. (2005) · Yearbook of the National Society for the Study of Education · doi:10.1111/j.1744-7984.2005.00029.x · Cited by 16 · see citing works
Visions of quality : how evaluators define, understand and represent program quality
Benson, A., Hinn, D. M., & Lloyd, C. A. (2001) · JAI eBooks · Cited by 16 · see citing works
The Impact of Standards-based Reform in Duval County, Florida: 1999-2002
Supovitz, J. A., & Taylor, B. S. (2003) · Cited by 15 · see citing works
Schildkamp, K., & Lai, M. K. (2012) · Springer eBooks · doi:10.1007/978-94-007-4816-3_1 · Cited by 14 · see citing works
Communicating quality and qualities: The role of the evaluator as critical friend
Rallis, S. F., & Rossman, G. (2004) · Advances in program evaluation · doi:10.1016/s1474-7863(01)80068-5 · Cited by 11 · see citing works
McPhee, A., & Patrick, F. (2009) · Scottish Educational Review · doi:10.1163/27730840-04101007 · Cited by 7 · see citing works
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Formative assessment: A systematic review of critical teacher prerequisites for classroom practice
Schildkamp, K., van der Kleij, F. M., Heitink, M. C., Kippers, W. B., & Veldkamp, B. P. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2020.101602 · Cited by 330 · see citing works
Deunk, M., Smale-Jacobse, A. E., de Boer, H., Doolaard, S., & Bosker, R. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.02.002 · Cited by 316 · see citing works
Datnow, A., & Hubbard, L. (2016) · Journal of Educational Change · doi:10.1007/s10833-015-9264-2 · Cited by 287 · see citing works
Self-citationMisconceptions about data-based decision making in education: An exploration of the literature
Mandinach, E. B., & Schildkamp, K. (2021) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2020.100842 · Cited by 209 · see citing works
Datnow, A., & Hubbard, L. (2015) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811511700408 · Cited by 176 · see citing works
Self-citationHoogland, I., Schildkamp, K., van der Kleij, F., Heitink, M., Kippers, W., Veldkamp, B., & Dijkstra, A. M. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.07.012 · Cited by 158 · see citing works
Teachers’ decision-making: Data based or intuition driven?
Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017) · International Journal of Educational Research · doi:10.1016/j.ijer.2017.02.013 · Cited by 123 · see citing works
Kippers, W. B., Wolterinck, C. H. D., Schildkamp, K., Poortman, C. L., & Visscher, A. J. (2018) · Teaching and Teacher Education · doi:10.1016/j.tate.2018.06.015 · Cited by 119 · see citing works
Prenger, R., & Schildkamp, K. (2018) · Educational Psychology · doi:10.1080/01443410.2018.1426834 · Cited by 101 · see citing works
A review of research on teachers’ use of student data: from the perspective of school leadership
Sun, J., Przybylski, R., & Johnson, B. (2016) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-016-9238-9 · Cited by 85 · see citing works
How Do Teachers Make Sense of Data in the Context of High-Stakes Decision Making?
Vanlommel, K., & Schildkamp, K. (2019) · American Educational Research Journal · doi:10.3102/0002831218803891 · Cited by 79 · see citing works
Almazroa, H., & Alotaibi, W. (2023) · Sustainability · doi:10.3390/su15097365 · Cited by 125 · see citing works
Gasse, R. V., Vanlommel, K., Vanhoof, J., & Petegem, P. V. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.07.004 · Cited by 44 · see citing works
The impact of collaboration on teachers’ individual data use
Gasse, R. V., Vanlommel, K., Vanhoof, J., & Petegem, P. V. (2017) · School Effectiveness and School Improvement · doi:10.1080/09243453.2017.1321555 · Cited by 42 · see citing works
Tolo, A., Lillejord, S., Petour, M. T. F., & Hopfenbeck, T. N. (2019) · Journal of Educational Change · doi:10.1007/s10833-019-09359-x · Cited by 32 · see citing works
McDowall, A., Mills, C., Cawte, K., & Miller, J. (2020) · Asia-Pacific Journal of Teacher Education · doi:10.1080/1359866x.2020.1777529 · Cited by 31 · see citing works
Gasse, R. V., Vanlommel, K., Vanhoof, J., & Petegem, P. V. (2019) · Teaching and Teacher Education · doi:10.1016/j.tate.2019.102989 · Cited by 26 · see citing works
Varma, D., & Dutta, P. (2021) · International journal of organizational analysis · doi:10.1108/ijoa-08-2021-2888 · Cited by 26 · see citing works
Assessment, teacher education and the emergence of professional expertise
Ellis, S., & Smith, V. (2017) · Literacy · doi:10.1111/lit.12115 · Cited by 24 · see citing works
What counts? The critical role of qualitative data in teachers’ decision making
Ho, J. E. (2022) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2021.102046 · Cited by 20 · see citing works
Gasse, R. V., Vanlommel, K., Vanhoof, J., & Petegem, P. V. (2017) · Teaching and Teacher Education · doi:10.1016/j.tate.2017.08.002 · Cited by 20 · see citing works
From ‘professional development for data use’ to ‘data use for professional development’
Vanhoof, J., & Schildkamp, K. (2014) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2014.05.001 · Cited by 18 · see citing works
Wolterinck-Broekhuis, C. H. D., Poortman, C. L., Schildkamp, K., & Visscher, A. J. (2024) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-024-09428-7 · Cited by 17 · see citing works
Principals Using Data: An Integrative Review
Drake, T. A. (2022) · Leadership and Policy in Schools · doi:10.1080/15700763.2022.2036349 · Cited by 11 · see citing works
For squad-members only! Why some teachers are more popular to interact with than others in data use
Gasse, R. V., Goffin, E., Vanhoof, J., & Petegem, P. V. (2020) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2020.100881 · Cited by 10 · see citing works
Data informed leadership: the work of primary mathematics lead teachers in New Zealand
Edwards, F., & Ogle, D. (2020) · Teacher Development · doi:10.1080/13664530.2020.1837217 · Cited by 11 · see citing works
Cowie, B., Edwards, F., & Trask, S. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.619319 · Cited by 7 · see citing works
Jennings, A. S., & Jennings, A. B. (2020) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146812012201210 · Cited by 7 · see citing works
The effect of formal team meetings on teachers’ informal data use interactions
Gasse, R. V. (2019) · Frontline Learning Research · doi:10.14786/flr.v7i2.443 · Cited by 6 · see citing works
Teacher professional development for assessment for learning
Wolterinck-Broekhuis, C. H. D. (2022) · doi:10.3990/1.9789036554664 · Cited by 7 · see citing works
Secondary Science Teachers’ Definition and Use of Data in Their Teaching Practice
Boesdorfer, S. B., Carlo, D. I. D., & Wayson, J. (2020) · Research in Science Education · doi:10.1007/s11165-020-09936-8 · Cited by 5 · see citing works
Individual, co‐operative and collaborative data use: A conceptual and empirical exploration
Gasse, R. V., Vanlommel, K., Vanhoof, J., & Petegem, P. V. (2017) · British Educational Research Journal · doi:10.1002/berj.3277 · Cited by 5 · see citing works
Gasse, R. V., Vanhoof, J., & Petegem, P. V. (2017) · Educational Studies · doi:10.1080/03055698.2017.1382328 · Cited by 5 · see citing works
Torres-Santos, M. C., & Castulo, N. J. (2025) · Education 3-13 · doi:10.1080/03004279.2025.2468398 · Cited by 4 · see citing works
School reform from a constructivist perspective
Hubbard, L., Mehan, H. B., & Datnow, A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.05035-1 · Cited by 4 · see citing works
Self-citationThe role of parents in the school accountability system: Insights from a Hong Kong case
Xie, Q. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.101114 · Cited by 3 · see citing works
Santos, N. N., & Monteiro, V. (2024) · Psychology in the Schools · doi:10.1002/pits.23130 · Cited by 3 · see citing works
How Professional Learning Networks Can Support Teachers’ Data Literacy: In Conversation with Experts
Warmoes, A., Decabooter, I., Gasse, R. V., Struyven, K., & Consuegra, E. (2024) · Education Sciences · doi:10.3390/educsci14101071 · Cited by 7 · see citing works
Verändern Bildungsstandards, Standardüberprüfungen und Ergebnisrückmeldungen die schulische Arbeit?
Kemethofer, D., & Wiesner, C. (2018) · Educational governance · doi:10.1007/978-3-658-22241-3_10 · Cited by 3 · see citing works
Building Coherence through Whole School Reform: The Case of the AVID Elementary Program
Hubbard, L., Metz-Matthews, K., & Resultan, B. (2021) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2021.1981907 · Cited by 3 · see citing works
Self-citationHow teacher educators learn to use data in a data team
Bolhuis, E. (2017) · UvA-DARE (University of Amsterdam) · Cited by 3 · see citing works
Bridging perspectives: Insights from different stakeholders on data coaching in education
Decabooter, I., Warmoes, A., Consuegra, E., Gasse, R. V., Goffin, E., & Struyven, K. (2024) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2024.101392 · Cited by 3 · see citing works
Vanlommel, K. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80043-141-620221030 · Cited by 2 · see citing works
„Data Richness“ als Merkmal erfolgreicher Schulen. Ein Systematisierungsversuch
Klein, E. D., & Hejtmanek, R. A. (2023) · Educational governance · doi:10.1007/978-3-658-38377-0_10 · Cited by 2 · see citing works
Martin, B. N., & Gragg, J. D. (2021) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.84.10003 · Cited by 1 · see citing works
Vanlommel, K., & Pepermans, E. (2022) · Studia paedagogica · doi:10.5817/sp2021-4-3 · Cited by 1 · see citing works
Performance Standards in Assessment and Possible Alternatives
Tolo, A. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80071-589-920221009 · Cited by 1 · see citing works
Federal Policy to Local Level: Data-Driven Education Planning in Nigeria
Iyengar, R., Mahal, A. R., Felicia, U.-N. I., Aliyu, B., & Karim, A. (2015) · The International Education Journal: Comparative Perspectives · Cited by 1 · see citing works
Deunk, M., Maslowski, R., van Kuijk, M. F., & Doolaard, S. (2015) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 1 · see citing works
Wilkerson, C. L. (2017) · VTechWorks (Virginia Tech)
Tracking Turnaround: Understanding Data Use as a Shared Leadership Practice
Tellier, S. L. (2018)
Soysal, Y. (2024) · ECNU Review of Education · doi:10.1177/20965311241256364
The Role of Assessment in Data-Informed Instructional Practice
Abrams, L. M. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-429-020251017
Intelligent accountability in education policy: a case study of New Zealand
Niu, H., & Bin, Z. (2026) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-026-09493-0
Teachers’ assessment data use: The roles of capacity, collaboration, and leadership
Sandvik, L. V., & Engvik, G. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105653
Kessel, M. V., Horvers, A., de Jonge, M., Molenaar, I., & Saab, N. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105768
- Authors
- Hubbard, L., Datnow, A., & Pruyn, L.
- Affiliations
- University of San Diego (US)
- University of California San Diego (US)
- Corresponding author
- Hubbard, Lea
- ORCID
- Datnow, Amanda
- Venue
- Studies in Educational Evaluation
- Publisher
- Elsevier BV
- Published
- 2014-09
- Volume
- 42
- Pages
- 54-62
- ISSN
- 0191-491X (ISSN-L)
- OpenAlex
- W2057568166
- Cited by
- 60
- References
- 40
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 5 · 2023: 2 · 2022: 9 · 2021: 6 · 2020: 7 · 2019: 5 · 2018: 6 · 2017: 8 · 2016: 3 · 2015: 4 · 2014: 1
- FWCI
- 5.86
- Type
- journal article
- Language
- en
- Update notices
- erratum (2014-12-01)
- Open access
- closed
- Locations
- Studies In Educational Evaluation (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Educational Assessment and Improvement
- Social Sciences › Education › Teacher Education and Leadership Studies
- Social Sciences › Education › Teacher Education and Assessments
- Keywords
- data-driven decision making, data use in schools, educational reform, Common Core State Standards, 21st century skills, student-centered learning, primary school teachers, instructional planning, teacher motivation, school leadership capacity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review