Research Synthesis and Meta-Analysis
Abstract
As the volume of primary research across all fields of social science continues to grow at rapid rates, research synthesis has become more important today than at any other time in history. With the development of metaanalysis, a set of procedures for summarizing the quantitative results from multiple studies, the rigor, systematicity, and transparency of research syntheses was greatly improved. However, a number of developments, including the creation of the Cochrane Collaboration and Campbell Collaboration, have heightened the profile of meta-analysis in recent years. Furthermore, recent advancements in analytic strategies, including the use of a random effects model of error, the development of meta-regression, and improved methods for dealing with missing data and data censoring, have enhanced the popularity, efficiency, and trustworthiness of meta-analyses. We begin this chapter with a brief history of meta-analysis and research synthesis. We then describe the different stages of a rigorous research synthesis. Next, we outline a set of generally useful meta-analytic techniques and follow this with a discussion of some of the difficult decisions that research synthesists face in carrying out a meta-analysis. We conclude by addressing some broader issues concerning criteria for evaluating the quality of knowledge syntheses in general and meta-analyses in particular. A general theme of the chapter is that social scientists who are conducting research syntheses need to think…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A post hoc reassessment of 10 randomly selected studies was conducted and inter-rater reliability was excellent (>95%).
“We also conducted a post hoc reassessment of 10 randomly selected studies and compared the extracted results.15 Coder drift was <10% in all cases for each investigator and inter-rater (RWM, KTM and SRM) reliability was excellent (>95%).”
Cited by
Sorted by citations
Hall, W. J., Chapman, M. V., Lee, K. M., Merino, Y. M., Thomas, T. W., Payne, B. K., Eng, E., Day, S. H., & Coyne-Beasley, T. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302903 · Cited by 2,176 · see citing works
Writing Integrative Literature Reviews: Using the Past and Present to Explore the Future
Torraco, R. J. (2016) · Human Resource Development Review · doi:10.1177/1534484316671606 · Cited by 1,345 · see citing works
Morton, R. W., Murphy, K. T., McKellar, S. R., Schoenfeld, B. J., Henselmans, M., Helms, E., Aragon, A. A., Devries, M. C., Banfield, L., Krieger, J. W., et al. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-097608 · Cited by 1,154 · see citing works
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130 · see citing works
Osbaldiston, R., & Schott, J. P. (2012) · Environment and Behavior · doi:10.1177/0013916511402673 · Cited by 754 · see citing works
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · see citing works
Reviewing the methodology of an integrative review
Hopia, H., Latvala, E., & Liimatainen, L. (2016) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.12327 · Cited by 459 · see citing works
Tipton, E., & Pustejovsky, J. E. (2015) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998615606099 · Cited by 362 · see citing works
Identifying the characteristics of effective teacher professional development: a critical review
Sims, S., & Fletcher-Wood, H. (2021) · School Effectiveness and School Improvement · doi:10.1080/09243453.2020.1772841 · Cited by 347 · see citing works
Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education
Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017) · Review of Educational Research · doi:10.3102/0034654316670999 · Cited by 346 · see citing works
Risk factors for child sexual abuse victimization: A meta-analytic review.
Assink, M., van der Put, C. E., Meeuwsen, M. W. C. M., de Jong, N. M., Oort, F. J., Stams, G. J. J. M., & Hoeve, M. (2019) · Psychological bulletin · doi:10.1037/bul0000188 · Cited by 322 · see citing works
Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · see citing works
Mobile-assisted ESL/EFL vocabulary learning: a systematic review and meta-analysis
Lin, J.-J., & Lin, H. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1541359 · Cited by 262 · see citing works
Hall, W. J. (2018) · Journal of Homosexuality · doi:10.1080/00918369.2017.1317467 · Cited by 238 · see citing works
Panadero, E., & Alqassab, M. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1600186 · Cited by 232 · see citing works
Racial Discrimination and Asian Mental Health: A Meta-Analysis
Lee, D. L., & Ahn, S. (2011) · The Counseling Psychologist · doi:10.1177/0011000010381791 · Cited by 227 · see citing works
The Residual Medium and Long-term Cognitive Effects of Benzodiazepine Use: An Updated Meta-analysis
Crowe, S. F., & Stranks, E. K. (2018) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acx120 · Cited by 209 · see citing works
Discrimination Against Latina/os: A Meta-Analysis of Individual-Level Resources and Outcomes
Lee, D. L., & Ahn, S. (2012) · The Counseling Psychologist · doi:10.1177/0011000011403326 · Cited by 208 · see citing works
Templier, M., & Paré, G. (2018) · European Journal of Information Systems · doi:10.1080/0960085x.2017.1398880 · Cited by 180 · see citing works
Insfran-Rivarola, A., Tlapa, D., Limon-Romero, J., Baez-Lopez, Y., Miranda-Ackerman, M., Arredondo-Soto, K., & Ontiveros, S. (2020) · Foods · doi:10.3390/foods9091169 · Cited by 160 · see citing works
Givens Rolland, R. (2012) · Review of Educational Research · doi:10.3102/0034654312464909 · Cited by 138 · see citing works
A Meta-analysis of the Segmenting Effect
Rey, G. D., Beege, M., Nebel, S., Wirzberger, M., Schmitt, T. H., & Schneider, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-018-9456-4 · Cited by 131 · see citing works
Executive functions in learning processes: Do they benefit from physical activity?
Barenberg, J., Berse, T., & Dutke, S. (2011) · Educational Research Review · doi:10.1016/j.edurev.2011.04.002 · Cited by 126 · see citing works
Conn, V. S., Koopman, R. J., Ruppar, T. M., Phillips, L. J., Mehr, D. R., & Hafdahl, A. R. (2014) · Journal of Primary Care & Community Health · doi:10.1177/2150131913520328 · Cited by 99 · see citing works
The Social Information Processing Model in Child Physical Abuse and Neglect: A Meta-analytic Review
Camilo, C., Garrido, M. V., & Calheiros, M. M. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104666 · Cited by 37 · see citing works
Tirone, V., Orlowska, D., Lofgreen, A. M., Blais, R. K., Stevens, N. R., Klassen, B., Held, P., & Zalta, A. K. (2021) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.1883925 · Cited by 31 · see citing works
A systematic review of the evidence for hyporesponsivity in ASD
Watts, S. J., Rodgers, J., & Riby, D. (2016) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-016-0084-y · Cited by 21 · see citing works
- Authors
- Cooper, H., Patall, E., & Lindsay, J.
- ORCID
- Patall, Erika
- Venue
- The SAGE Handbook of Applied Social Research Methods
- Publisher
- SAGE Publications, Inc.
- Published
- 2009
- Pages
- 344-370
- OpenAlex
- W3021683231
- Cited by
- 397
- References
- 0
- Citations by year
- 2026: 2 · 2025: 11 · 2024: 24 · 2023: 28 · 2022: 36 · 2021: 33 · 2020: 30 · 2019: 25 · 2018: 38 · 2017: 40 · 2016: 36 · 2015: 28 · 2014: 21 · 2013: 5 · 2012: 21
- FWCI
- 74.45
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Sage eBooks (publishedVersion)
- DukeSpace (Duke University) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Diverse Academic Research Areas
- Keywords
- evidence synthesis, meta-analysis, systematic reviews, Cochrane Collaboration, Campbell Collaboration, random effects models, meta-regression, missing data, data censoring, history of meta-analysis, social science research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review