Strengthening the Research Base That Informs STEM Instructional Improvement Efforts: A Meta-Analysis
The DOI matches its Crossref record; 121 of the 123 references it cites were found in a registry or an index.
Abstract
We present results from a meta-analysis of 95 experimental and quasi-experimental pre-K–12 science, technology, engineering, and mathematics (STEM) professional development and curriculum programs, seeking to understand what content, activities, and formats relate to stronger student outcomes. Across rigorously conducted studies, we found an average weighted impact estimate of +0.21 standard deviations. Programs saw stronger outcomes when they helped teachers learn to use curriculum materials; focused on improving teachers’ content knowledge, pedagogical content knowledge, and/or understanding of how students learn; incorporated summer workshops; and included teacher meetings to troubleshoot and discuss classroom implementation. We discuss implications for policy and practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, Lynch et al. (2019) found no significant relation between these variables.”
From Teacher Professional Development and Student Mathematics Achievement: A Meta-Analysis of the Effects and Moderators (2025) · cites this paper as Lynch et al. (2019)
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Those Who Understand: Knowledge Growth in Teaching
SHULMAN, L. S. (1986) · Educational Researcher · doi:10.3102/0013189x015002004 · Cited by 18,546
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
(2013) · Cited by 6,708
Desimone, L. M. (2009) · Educational Researcher · doi:10.3102/0013189x08331140 · Cited by 4,862
Second Handbook of Research on Mathematics Teaching and Learning.
Lester, F. (2007) · Cited by 3,090
Scientific Research in Education
(2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,723
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716
Next Generation Science Standards: For States, By States
(2013) · National Academies Press eBooks · doi:10.17226/18290 · Cited by 1,321
How Does Professional Development Improve Teaching?
Kennedy, M. M. (2016) · Review of Educational Research · doi:10.3102/0034654315626800 · Cited by 1,305
Systematic Reviews and Meta-Analysis
Littell, J. H., Corcoran, J., & Pillai, V. (2008) · doi:10.1093/acprof:oso/9780195326543.001.0001 · Cited by 1,293
Teachers and Student Achievement in the Chicago Public High Schools
Aaronson, D., Barrow, L., & Sander, W. (2007) · Journal of Labor Economics · doi:10.1086/508733 · Cited by 1,291
Digital Games, Design, and Learning: A Systematic Review and Meta-Analysis
Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016) · Review of Educational Research · doi:10.3102/0034654315582065 · Cited by 1,274
Ball, D. L., & Cohen, D. K. (1996) · Educational Researcher · doi:10.2307/1177151 · Cited by 1,167
Designing Educative Curriculum Materials to Promote Teacher Learning
Davis, E. A., & Krajcik, J. S. (2005) · Educational Researcher · doi:10.3102/0013189x034003003 · Cited by 1,140
Experimental and Quasi-Experimental Studies of Inquiry-Based Science Teaching: A Meta-Analysis
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012) · Review of Educational Research · doi:10.3102/0034654312457206 · Cited by 1,021
Using Knowledge of Children's Mathematics Thinking in Classroom Teaching: An Experimental Study
Carpenter, T. P., Fennema, E., Peterson, P. L., Chiang, C.-P., & Loef, M. (1989) · American Educational Research Journal · doi:10.2307/1162862 · Cited by 1,015
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950
Shanahan, C. R. (2011) · Cited by 872
Teacher Preparation and Student Achievement
Boyd, D. J., Grossman, P. L., Lankford, H., Loeb, S., & Wyckoff, J. (2009) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373709353129 · Cited by 818
Instructional Policy and Classroom Performance: The Mathematics Reform in California
Cohen, D. K., & Hill, H. C. (2000) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1111/0161-4681.00057 · Cited by 759
Self-citationMcKimm, J., & Swanwick, T. (2013) · Understanding Medical Education · doi:10.1002/9781118472361.ch33 · Cited by 685
A Research Agenda for Online Teacher Professional Development
Dede, C., Jass Ketelhut, D., Whitehouse, P., Breit, L., & McCloskey, E. M. (2009) · Journal of Teacher Education · doi:10.1177/0022487108327554 · Cited by 666
Effects of a Preschool Mathematics Curriculum: Summative Research on the Building Blocks Project
Clements, D. H., & Sarama, J. H. (2007) · Journal for Research in Mathematics Education · doi:10.2307/30034954 · Cited by 625
Smith, M. S., & O'Day, J. (1990) · Journal of Education Policy · doi:10.1080/02680939008549074 · Cited by 591
Tanner-Smith, E. E., & Tipton, E. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1091 · Cited by 588
Slavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
A Primer on Effective Professional Development
Desimone, L. M. (2011) · Phi Delta Kappan · doi:10.1177/003172171109200616 · Cited by 522
Learning policy: when state education reform works
(2002) · Choice Reviews Online · doi:10.5860/choice.39-5306 · Cited by 512
Vote-counting methods in research synthesis.
Hedges, L. V., & Olkin, I. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.2.359 · Cited by 495
Selecting Studies and Collecting Data
Higgins, J. P., & Deeks, J. J. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch7 · Cited by 467
Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis
Slavin, R. E., & Lake, C. (2008) · Review of Educational Research · doi:10.3102/0034654308317473 · Cited by 407
Designing Powerful Professional Development for Teachers and Principals.
Sparks, D. (2002) · Cited by 403
(2012) · TigerPrints (Clemson University) · Cited by 402
Handling Complex Meta-analytic Data Structures Using Robust Variance Estimates: a Tutorial in R
Tanner-Smith, E. E., Tipton, E., & Polanin, J. R. (2016) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-016-0026-5 · Cited by 390
Experimental Evaluation of the Effects of a Research-Based Preschool Mathematics Curriculum
Clements, D. H., & Sarama, J. (2008) · American Educational Research Journal · doi:10.3102/0002831207312908 · Cited by 388
Inquiry‐based science in the middle grades: Assessment of learning in urban systemic reform
Marx, R. W., Blumenfeld, P. C., Krajcik, J. S., Fishman, B., Soloway, E., Geier, R., & Tal, R. T. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20039 · Cited by 385
Tipton, E., & Pustejovsky, J. E. (2015) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998615606099 · Cited by 362
Learning Policy: When State Education Reform Works
Cohen, D. K., & Hill, H. C. (2001) · doi:10.12987/yale/9780300089479.001.0001 · Cited by 361
Self-citationProfessional Development for Science Teachers
Wilson, S. M. (2013) · Science · doi:10.1126/science.1230725 · Cited by 325
Clements, D. H., Sarama, J., Spitler, M. E., Lange, A. A., & Wolfe, C. B. (2011) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.42.2.0127 · Cited by 317
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317
Empirical bayes meta-analysis.
Raudenbush, S. W., & Bryk, A. S. (1985) · Journal of Educational Statistics · doi:10.3102/10769986010002075 · Cited by 299
Dietrichson, J., Bøg, M., Filges, T., & Klint Jørgensen, A.-M. (2017) · Review of Educational Research · doi:10.3102/0034654316687036 · Cited by 288
Hiebert, J., Stigler, J. W., Jacobs, J. K., Givvin, K. B., Garnier, H., Smith, M., Hollingsworth, H., Manaster, A., Wearne, D., & Gallimore, R. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027002111 · Cited by 282
Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., & Groff, C. (2009) · Review of Educational Research · doi:10.3102/0034654308330968 · Cited by 281
robumeta: An R-package for robust variance estimation in meta-analysis
Fisher, Z., & Tipton, E. (2015) · arXiv · doi:10.48550/arxiv.1503.02220 · Cited by 280
The impact of an integrated approach to science and literacy in elementary school classrooms
Cervetti, G. N., Barber, J., Dorph, R., Pearson, P. D., & Goldschmidt, P. G. (2012) · Journal of Research in Science Teaching · doi:10.1002/tea.21015 · Cited by 256
Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234
Fixing Teacher Professional Development
Hill, H. C. (2009) · Phi Delta Kappan · doi:10.1177/003172170909000705 · Cited by 217
Self-citationSaxe, G. B., Gearhart, M., & Nasir, N. S. (2001) · Journal of Mathematics Teacher Education · doi:10.1023/a:1009935100676 · Cited by 216
Roschelle, J., Shechtman, N., Tatar, D., Hegedus, S., Hopkins, B., Empson, S., Knudsen, J., & Gallagher, L. P. (2010) · American Educational Research Journal · doi:10.3102/0002831210367426 · Cited by 211
Becker, K. H., & Park, K. (2011) · Journal of STEM Education Innovations and Research · Cited by 210
(2014) · Cited by 207
On evaluating curricular effectiveness judging the quality of K-12 mathematics evaluations
Confrey, J., Stohl, V., & National Research Council (U.S.) (2004) · Cited by 206
Helping Teachers Teach Well: Transforming Professional Development: (383832004-001)
Corcoran, T. B. (1995) · PsycEXTRA Dataset · doi:10.1037/e383832004-001 · Cited by 206
Penuel, W. R., Sun, M., Frank, K. A., & Gallagher, H. A. (2012) · American Journal of Education · doi:10.1086/667756 · Cited by 201
Careless Errors Made by Sixth-Grade Children on Written Mathematical Tasks
Clements, M. A. (1982) · Journal for Research in Mathematics Education · doi:10.2307/748360 · Cited by 191
Harris, C., Penuel, W. R., D’Angelo, C. M., DeBarger, A. H., Gallagher, L. P., Kennedy, C. A., Cheng, B. H., & Krajcik, J. S. (2015) · Journal of Research in Science Teaching · doi:10.1002/tea.21263 · Cited by 173
Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2011.8 · Cited by 173
Accelerating math development in Head Start classrooms.
Arnold, D. H., Fisher, P. H., Doctoroff, G. L., & Dobbs‐Oates, J. (2002) · Journal of Educational Psychology · doi:10.1037//0022-0663.94.4.762 · Cited by 170
Penuel, W. R., Gallagher, L. P., & Moorthy, S. (2011) · American Educational Research Journal · doi:10.3102/0002831211410864 · Cited by 160
Effects of a Pre-Kindergarten Mathematics Intervention: A Randomized Experiment
Klein, A., Starkey, P., Clements, D., Sarama, J., & Iyer, R. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802114533 · Cited by 155
Professional Development for K–12 Math and Science Teachers: What Do We Really Know?
Scher, L., & O'Reilly, F. (2009) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802641527 · Cited by 147
Lara‐Alecio, R., Tong, F., Irby, B. J., Guerrero, C., Huerta, M., & Fan, Y. (2012) · Journal of Research in Science Teaching · doi:10.1002/tea.21031 · Cited by 142
Zaslow, M. J., Tout, K., Halle, T., Whittaker, J. V., & Lavelle, B. (2010) · Cited by 139
Gardella, J. H., Fisher, B. W., & Teurbe-Tolon, A. R. (2017) · Review of Educational Research · doi:10.3102/0034654316689136 · Cited by 139
Advancing Educational Policy by Advancing Research on Instruction
Raudenbush, S. W. (2008) · American Educational Research Journal · doi:10.3102/0002831207312905 · Cited by 135
Alozie, N. M., Moje, E. B., & Krajcik, J. S. (2010) · Science Education · doi:10.1002/sce.20365 · Cited by 126
The Efficacy of Student-Centered Instruction in Supporting Science Learning
Granger, E. M., Bevis, T. H., Saka, Y., Southerland, S. A., Sampson, V. D., & Tate, R. L. (2012) · Science · doi:10.1126/science.1223709 · Cited by 121
Experimental evaluations of elementary science programs: A best-evidence synthesis
Slavin, R. E., Lake, C., Hanley, P., & Thurston, A. (2014) · Journal of Research in Science Teaching · doi:10.1002/tea.21139 · Cited by 115
Mathematics for the future: developing a Head Start curriculum to support mathematics learning
Sophian, C. (2004) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2004.01.015 · Cited by 115
Montague, M., Krawec, J., Enders, C., & Dietz, S. (2014) · Journal of Educational Psychology · doi:10.1037/a0035176 · Cited by 112
DeBarger, A. H., Penuel, W. R., Moorthy, S., Beauvineau, Y., Kennedy, C. A., & Boscardin, C. (2016) · Science Education · doi:10.1002/sce.21249 · Cited by 111
Learning from comparison in algebra
Star, J. R., Pollack, C., Durkin, K., Rittle-Johnson, B., Lynch, K., Newton, K., & Gogolen, C. (2015) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.05.005 · Cited by 106
Self-citationSantagata, R., Kersting, N., Givvin, K. B., & Stigler, J. W. (2010) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2010.498562 · Cited by 106
Impact of a Large-Scale Science Intervention Focused on English Language Learners
Llosa, L., Lee, O., Jiang, F., Haas, A., O’Connor, C., Booven, C. D. V., & Kieffer, M. J. (2016) · American Educational Research Journal · doi:10.3102/0002831216637348 · Cited by 103
Dash, S., Magidin de Kramer, R., O’Dwyer, L. M., Masters, J., & Russell, M. (2012) · Journal of Research on Technology in Education · doi:10.1080/15391523.2012.10782595 · Cited by 101
Effects of Blended Instructional Models on Math Performance
Bottge, B. A., Ma, X., Gassaway, L. J., Toland, M. D., Butler, M., & Cho, S.-J. (2014) · Exceptional Children · doi:10.1177/0014402914527240 · Cited by 96
Professional Development Standards and Practices in Elementary School Mathematics
Hill, H. C. (2004) · The Elementary School Journal · doi:10.1086/499750 · Cited by 94
Self-citationImpact of Enhanced Anchored Instruction in Inclusive Math Classrooms
Bottge, B. A., Toland, M. D., Gassaway, L., Butler, M., Choo, S., Griffen, A. K., & Ma, X. (2015) · Exceptional Children · doi:10.1177/0014402914551742 · Cited by 91
Kisker, E. E., Lipka, J., Adams, B. L., Rickard, A., Andrew-Ihrke, D., Yanez, E. E., & Millard, A. (2012) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.43.1.0075 · Cited by 87
Sarama, J., Clements, D. H., Starkey, P., Klein, A., & Wakeley, A. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740801941332 · Cited by 87
Piasta, S. B., Logan, J. A. R., Pelatti, C. Y., Capps, J. L., & Petrill, S. A. (2014) · Journal of Educational Psychology · doi:10.1037/a0037621 · Cited by 87
Summary of Research on the Effectiveness of Math Professional Development Approaches. REL 2014-010.
Gersten, R. M., Taylor, M. J., Keys, T. D., Rolfhus, E. L., & Newman-Gonchar, R. (2014) · Cited by 84
Clarke, B., Smolkowski, K., Baker, S. K., Fien, H., Doabler, C. T., & Chard, D. J. (2011) · The Elementary School Journal · doi:10.1086/659033 · Cited by 84
Lewis, C., & Perry, R. (2014) · Mathematics teacher education and development · Cited by 81
Kinzie, M. B., Whittaker, J. V., Williford, A. P., DeCoster, J., McGuire, P., Lee, Y.-J., & Kilday, C. R. (2014) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2014.06.007 · Cited by 74
Instructional Policy and Classroom Performance: The Mathematics Reform in California
Cohen, D. K., & Hill, H. C. (1998) · PsycEXTRA Dataset · doi:10.1037/e382712004-001 · Cited by 68
Self-citationThe impact of state and national standards on K-12 science teaching
Sunal, D. W., & Wright, E. L. (2006) · Cited by 62
Taylor, J. A., Getty, S. R., Kowalski, S. M., Wilson, C. D., Carlson, J., & Scotter, P. V. (2015) · American Educational Research Journal · doi:10.3102/0002831215585962 · Cited by 57
Integrating pharmacology topics in high school biology and chemistry classes improves performance
Schwartz‐Bloom, R. D., & Halpin, M. J. (2003) · Journal of Research in Science Teaching · doi:10.1002/tea.10116 · Cited by 56
A Randomized Trial of Teacher Development in Elementary Science: First-Year Achievement Effects
Borman, G. D., Gamoran, A., & Bowdon, J. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802328273 · Cited by 54
Maerten‐Rivera, J., Ahn, S., Lanier, K., Diaz, J. D., & Lee, O. (2016) · The Elementary School Journal · doi:10.1086/686250 · Cited by 54
Scaling Up Innovative Technology-Based Mathematics
Tatar, D., Roschelle, J., Knudsen, J., Shechtman, N., Kaput, J., & Hopkins, B. (2008) · Journal of the Learning Sciences · doi:10.1080/10508400801986090 · Cited by 50
Hand, B. M., Norton‐Meier, L. A., Günel, M., & Akkuş, R. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9622-9 · Cited by 49
Lewis, C., & Perry, R. (2015) · Springer eBooks · doi:10.1007/978-3-319-07716-1_7 · Cited by 47
Miles, K. H., Odden, A. R., Fermanich, M. L., Archibald, S., & Gallagher, A. (2004) · Cited by 45
Effective secondary science programs: A best‐evidence synthesis
Cheung, A., Slavin, R. E., Kim, E., & Lake, C. (2017) · Journal of Research in Science Teaching · doi:10.1002/tea.21338 · Cited by 45
Confrey, J. (2006) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737028003195 · Cited by 42
McCoach, D. B., Gubbins, E. J., Foreman, J., Rubenstein, L. D., & Rambo-Hernandez, K. E. (2014) · Gifted Child Quarterly · doi:10.1177/0016986214547631 · Cited by 39
Clewell, B. C., de Cohen, C. C., Campbell, P. B., & Perlman, L. (2004) · Cited by 38
Sussman, J., & Wilson, M. R. (2018) · American Journal of Evaluation · doi:10.1177/1098214018767313 · Cited by 37
Hill, H. C., Litke, E. G., & Lynch, K. (2018) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146811812001207 · Cited by 35
Self-citationMalouf, D. B., & Taymans, J. M. (2016) · Educational Researcher · doi:10.3102/0013189x16678417 · Cited by 34
Taylor, J. A., Kowalski, S. M., Polanin, J. R., Askinas, K., Stuhlsatz, M. A. M., Wilson, C. D., Tipton, E., & Wilson, S. J. (2018) · AERA Open · doi:10.1177/2332858418791991 · Cited by 32
Schneider, M. C., & Meyer, J. P. (2012) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v8i17.291 · Cited by 26
Schochet, P. Z. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610375840 · Cited by 24
Argentin, G., Pennisi, A., Vidoni, D., Abbiati, G., & Caputo, A. (2014) · Evaluation Review · doi:10.1177/0193841x14529125 · Cited by 23
Module‐based professional development for teachers: a cost‐effective Philippine experiment
Antonio, D. M. S., Morales, N. S., & Moral, L. S. (2011) · Teacher Development · doi:10.1080/13664530.2011.571496 · Cited by 21
Heller, J. I., Curtis, D. A., Rabe‐Hesketh, S., & Verboncoeur, C. J. (2007) · Cited by 11
Batiza, A. F., Gruhl, M., Zhang, B., Harrington, T., Roberts, M., LaFlamme, D., Haasch, M. A., Knopp, J., Vogt, G., Goodsell, D. S., et al. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.12-09-0155 · Cited by 10
The causal effect of East Asian 'mastery' teaching methods on English children's mathematics skills?Preprint
Jerrim, J., & Vignoles, A. F. (2015) · RePEc: Research Papers in Economics · Cited by 9
Testing the Consensus Model of Effective PD: Analysis of Practice and the PD Research Terrain
Roth, K., Wilson, C., Taylor, J. A., Hvidsten, C., Stennett, B., & Wickler, N. I. Z. (2015) · Cited by 6
Changing the Developmental Trajectory in Early Math through a Two-Year Preschool Math Intervention.
Starkey, P., Klein, A., & DeFlorio, L. (2013) · Society for Research on Educational Effectiveness · Cited by 5
Report of the What Works Clearinghouse Expert Panel.
Brown, C. H., Card, D., Dickersin, K., Greenhouse, J. B., Kling, J. R., & Littell, J. H. (2008) · Cited by 4
Jaciw, A. P., Hegseth, W., Ma, B., & Lai, G. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2509464 · Cited by 2
Research works printed but not linked: 27
- Agodini R., 2013, After two years, three elementary math curricula outperform a fourth
- 10.1037/0022-0663.94.4.762 · doi:10.1037/0022-0663.94.4.762 · Paper page
- 10.3102/0013189x025009006 · doi:10.3102/0013189x025009006 · Paper page
- Becker K., 2011, Journal of STEM Education: Innovations and Research, 12, 23
- Blank R. K., 2010, Paper presented at the Society for Research on Educational Effectiveness Spring Conference
- Borman K. M., 2009, Paper presented at the Society for Research on Educational Effectiveness Spring Conference
- Chambers E. A. (2003). Efficacy of educational technology in elementary and secondary classrooms: A meta-analysis of the research literature from 1992–2002 (Unpublished doctoral dissertation). Southern Illinois University Carbondale.
- Darling-Hammond L., 1995, Phi Delta Kappan, 76, 597
- Devlin-Scherer W., 1998, Paper presented at the Annual Meeting of the American Association of Colleges for Teacher Education
- Frechtling J., 1995, Professional development programs: A perspective on the last four decades
- Garet M. S., 2010, Middle school mathematics professional development impact study: Findings after the first year of implementation
- 10.1037/0033-2909.88.2.359 · DOI · Paper page
- Kennedy M. M., 1999, Form and substance in in-service teacher education
- Kim J. S., 2012, Paper presented at the annual meeting of the Society for Research on Educational Effectiveness
- Kulik J. A., 2003, Effects of using instructional technology in elementary and secondary schools: What controlled evaluation studies say
- Miles K. H., 2004, Journal of Education Finance, 30, 1
- Miller B., 1994, Staff development for teachers: A study of configurations and costs in four districts
- Murphy R., 2002, E-DESK: A review of recent evidence on discrete educational software
- National Research Council, 2004, On evaluating curricular effectiveness: Judging the quality of K-12 mathematics evaluations
- National Research Council, 2011, Successful K-12 STEM education: Identifying effective approaches in science, technology, engineering, and mathematics
- Presser A. L., 2015, Paper presented at the Society for Research on Educational Effectiveness Spring Conference
- Resendez M., 2006, 2005 Prentice Hall Science Explorer randomized control trial
- Russell S. J., 2006, Investigations in Number, Data, and Space. Grade 1
- Timperley H., 2008, Teacher professional learning and development
- Van Egeren L. A., 2014, Poster presented at the 2014 Discovery Research K-12 PI Meeting
- What Works Clearinghouse, 2008, Middle school math curricula
- What Works Clearinghouse, 2010, Procedures and standards handbook
Cited by
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
“…among measures of student achievement, effect sizes for researcher-designed and specialized topic tests aligned with the treatment are often two to four times larger than effects on broad standardized state tests (Cheung & Slavin, 2016; Hill et al., 2008; Lipsey et al., 2012; Lynch et al., 2019).”
Identifying the characteristics of effective teacher professional development: a critical review
Sims, S., & Fletcher-Wood, H. (2021) · School Effectiveness and School Improvement · doi:10.1080/09243453.2020.1772841 · Cited by 582
“In particular, this approach identified a number of reviews which did not endorse the consensus view (e.g. Kennedy, 2016; Lynch et al., 2019; Yoon, 2011; Kraft, Blazar, & Hogan, 2018), as well as a wide range of relevant original research papers.”
BackgroundResultSablić, M., Mirosavljević, A., & Škugor, A. (2021) · Technology, Knowledge and Learning · doi:10.1007/s10758-020-09455-5 · Cited by 235
“Watching the video, shaping lessons, studying students’ work and similar professional development activities may differentially affect program outcomes such as curriculum design features, e.g. length of implementation and degree of teacher support (Lynch et al. 2019).”
BackgroundEffective Teacher Professional Development: New Theory and a Meta-Analytic Test
Sims, S., Fletcher-Wood, H., O’Mara-Eves, A., Cottingham, S., Stansfield, C., Goodrich, J., Van Herwegen, J., & Anders, J. (2025) · Review of Educational Research · doi:10.3102/00346543231217480 · Cited by 168
“A second strand of research has used meta-regression to investigate the associations between different aspects of PD design and impact on pupil outcomes (Basma & Savage, 2017; Didion et al., 2020; Kraft et al., 2018; Lynch et al, 2019).”
Huang, B., Siu-Yung Jong, M., Tu, Y.-F., Hwang, G.-J., Chai, C. S., & Yi-Chao Jiang, M. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104577 · Cited by 167
Metadata
- Authors
- Lynch, K., Hill, H. C., Gonzalez, K. E., & Pollard, C.
- Affiliations
- Brown University (US)
- Harvard University (US)
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2019-06-03
- Volume
- 41
- Issue
- 3
- Pages
- 260-293
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2948530858
- Cited by
- 160
- References
- 123
- Citations by year
- 2026: 27 · 2025: 38 · 2024: 21 · 2023: 24 · 2022: 21 · 2021: 17 · 2020: 9 · 2019: 3
- FWCI
- 3.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Evaluation and Policy Analysis (publishedVersion)
- Funders
- Directorate for Education and Human Resources (1348669)
- Topics
- Social Sciences › Education › Mathematics Education and Teaching Techniques
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Teacher Education and Leadership Studies
- Keywords
- STEM education, teacher professional development, curriculum implementation, pedagogical content knowledge, teacher content knowledge, summer workshop, teacher collaboration, student outcomes, teaching improvement, K-12 education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.