The DOI matches its Crossref record.
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Abstract
Preface to the Fourth Edition Acknowledgments About the Author Chapter 1. Introduction Chapter 2. Step 1: Formulating the Problem Chapter 3. Step 2: Searching the Literature Chapter 4. Step 3: Gathering Information From Studies Chapter 5. Step 4: Evaluating the Quality of Studies Chapter 6. Step 5: Analyzing and Integrating the Outcomes of Studies Chapter 7. Step 6: Interpreting the Evidence Chapter 8. Step 7: Presenting the Results Chapter 9. Conclusion: Threats to the Validity of Research Synthesis Conclusions References Author Index Subject Index
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers conducting evidence synthesis must transform narrative study reports into tabular records before quantitative integration can begin [1,2].”
From Diagnosing the limits of large language models for structured scientific evidence extraction (2026) · cites this paper as [2]
In the citing paper
“To ensure coding reliability and to mitigate inconsistencies in the data extraction223, 30 articles were randomly selected and independently coded by author D.F. Any inconsistencies were discussed to reach consensus, also drawing on a third author (U.S.T.), if needed.”
From Prevalence and severity of mental health problems in early-career researchers: a systematic review and meta-analysis (2026) · cites this paper as [223]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 501–600 of 1,005
Item grouping and item randomization in personality measurement
Schell, K. L., & Oswald, F. L. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.03.008 · Cited by 36
The Institutional Work of Payments for Ecosystem Services: Why the Mundane Should Matter
Jespersen, K., & Gallemore, C. T. (2017) · Ecological Economics · doi:10.1016/j.ecolecon.2017.12.013 · Cited by 38
Does State-Level Nurse Practitioner Scope-of-Practice Policy Affect Access to Care?
Patel, E., Petermann, V. M., & Mark, B. A. (2018) · Western Journal of Nursing Research · doi:10.1177/0193945918795168 · Cited by 36
A Series of Meta-Analytic Tests of the Efficacy of Long-Term Psychoanalytic Psychotherapy
Woll-Weber, C. F. J., & Schönbrodt, F. D. (2019) · European Psychologist · doi:10.1027/1016-9040/a000385 · Cited by 37
Attitudes toward Concealed Carry of Firearms on Campus: A Systematic Review of the Literature
Hassett, M. R., Kim, B., & Seo, C. (2019) · Journal of School Violence · doi:10.1080/15388220.2019.1703717 · Cited by 36
“GIS works!”—But why, how, and for whom? Findings from a systematic review
Schulze, U. (2020) · Transactions in GIS · doi:10.1111/tgis.12704 · Cited by 44
The systematic review of literature: Synthesizing evidence for practice
Rew, L. (2010) · Journal for Specialists in Pediatric Nursing · doi:10.1111/j.1744-6155.2010.00270.x · Cited by 36
Systematic Reviews and Meta-Analysis Applied to Ethnobiological Research
Albuquerque, U. P., & de Medeiros, P. M. (2012) · Ethnobiology and Conservation · doi:10.15451/ec2012-8-1.6-1-08 · Cited by 36
INTERRATER RELIABILITY IN SECOND LANGUAGE META-ANALYSES
Norouzian, R. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263121000061 · Cited by 35
Towards a conceptual systematic review: proposing a methodological framework
Schreiber, F., & Cramer, C. (2022) · Educational Review · doi:10.1080/00131911.2022.2116561 · Cited by 77
Kim, S., & Park, S. (2023) · International Journal of Mental Health Nursing · doi:10.1111/inm.13198 · Cited by 35
Language learning development in human-AI interaction: A thematic review of the research landscape
Wang, F., Cheung, A., & Chai, C. S. (2024) · System · doi:10.1016/j.system.2024.103424 · Cited by 42
Chinni, M. L., & Hubley, A. (2014) · Social indicators research series · doi:10.1007/978-3-319-07794-9_4 · Cited by 20
Watkins, C. S., & Howard, M. O. (2015) · Journal of Children and Poverty · doi:10.1080/10796126.2015.1031728 · Cited by 49
Quasi-experimental study designs series—paper 9: collecting data from quasi-experimental studies
Aloe, A. M., Becker, B. J., Duvendack, M., Valentine, J. C., Shemilt, I., & Waddington, H. S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.013 · Cited by 35
Delaney, A., & Tamás, P. A. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1282 · Cited by 38
Global Meta‐Analysis of Cotton Yield and Weed Suppression from Cover Crops
Toler, H. D., Augé, R. M., Benelli, V. G., Allen, F. L., & Ashworth, A. J. (2019) · Crop Science · doi:10.2135/cropsci2018.10.0603 · Cited by 35
Frequent emergency department use in the paediatric population: A systematic literature review
Giannouchos, T. V., Washburn, D. J., Gary, J. C., & Foster, M. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13382 · Cited by 35
Learning English vocabulary from word cards: A research synthesis
Lei, Y., & Reynolds, B. L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.984211 · Cited by 55
A Systematic Review of Research on High-Immersion Virtual Reality for Language LearningPreprint
Dhimolea, T. K., Kaplan‐Rakowski, R., & Lin, L. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3863724 · Cited by 35
The Impact of Big Data and Sports Analytics on Professional Football: A Systematic Literature Review
Herberger, T. A., & Litke, C. (2021) · Springer proceedings in business and economics · doi:10.1007/978-3-030-77340-3_12 · Cited by 34
Gallagher, M. A., & Scrivner, S. (2024) · Review of Educational Research · doi:10.3102/00346543241257533 · Cited by 42
Atnafu Alemu, B. (2025) · Business Ethics and Leadership · doi:10.61093/bel.9(1).79-94.2025 · Cited by 34
Beelmann, A. (2014) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-014-0509-2 · Cited by 42
A Qualitative Metasynthesis of Consultation Process Research: What We Know and Where to Go
Newman, D. S., McKenney, E. L. W., Silva, A. E., Clare, M. M., Salmon, D., & Jackson, S. (2016) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2015.1127164 · Cited by 34
Morin, K. L., Ganz, J. B., Vannest, K. J., Haas, A., Nagro, S. A., Peltier, C. J., Fuller, M. C., & Ura, S. K. (2018) · The Journal of Special Education · doi:10.1177/0022466918798361 · Cited by 34
Proof and argumentation in K-12 mathematics: a review of conceptions, content, and support
Campbell, T. G., Boyle, J. D., & King, S. (2019) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2019.1626503 · Cited by 34
Tong, F., Wang, Z., Min, Y., & Tang, S. (2020) · SAGE Open · doi:10.1177/2158244020926510 · Cited by 34
Xu, E., Wang, W., & Wang, Q. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11445-2 · Cited by 48
Effectiveness and characteristics of multifaceted osteoporosis group education—a systematic review
Jensen, A. L., Lomborg, K. E., Wind, G., & Langdahl, B. L. (2013) · Osteoporosis International · doi:10.1007/s00198-013-2573-5 · Cited by 34
Xue, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12596-0 · Cited by 33
Technologies Applied to Artificial Lighting in Indoor Agriculture: A Review
Lozano-Castellanos, L. F., Navas-Gracia, L. M., Lozano-Castellanos, I. C., & Corrêa-Guimarães, A. (2025) · Sustainability · doi:10.3390/su17073196 · Cited by 33
Trudgill, D. I. N., Gorey, K. M., & Donnelly, E. A. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00584-x · Cited by 40
Implications of the open science era for educational psychology research syntheses
Patall, E. A. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897009 · Cited by 37
Hagger, M. S. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1966824 · Cited by 41
The Use of Mobile Phones in Classrooms: A Systematic Review
Calderón-Garrido, D., Pardo, F. J. R., & Guerrero, C. S. (2022) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v17i06.29181 · Cited by 33
A meta-analysis of the effect of juvenile delinquency interventions on academic outcomes
Sander, J. B., Patall, E. A., Amoscato, L. E., Fisher, A. L., & Funk, C. L. (2012) · Children and Youth Services Review · doi:10.1016/j.childyouth.2012.04.005 · Cited by 33
Kim, D., Lim, J. H., & An, J. (2022) · PLoS ONE · doi:10.1371/journal.pone.0269996 · Cited by 32
Job flourishing research: A systematic literature review
A’yuninnisa, R. N., Carminati, L., & Wilderom, C. P. M. (2023) · Current Psychology · doi:10.1007/s12144-023-04618-w · Cited by 44
Machine learning in smart production logistics: a review of technological capabilities
Flores-García, E., Kwak, D. H., Jeong, Y., & Wiktorsson, M. (2024) · International Journal of Production Research · doi:10.1080/00207543.2024.2381145 · Cited by 40
Weingarten, E., Chen, Q., McAdams, M., Yi, J., Hepler, J., & Albarracín, D. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.04.015 · Cited by 37
Kcomt, L., & Gorey, K. M. (2017) · Journal of Social Work in End-of-Life & Palliative Care · doi:10.1080/15524256.2017.1387214 · Cited by 32
Significance bias in the tourism-led growth literature
Fonseca, N., & Rivero, M. S. (2019) · Tourism Economics · doi:10.1177/1354816619833564 · Cited by 32
Acosta, S. T., Garza, T., Hsu, H.-Y. M., Goodson, P., Padrón, Y. N., Goltz, H. H., & Johnston, A. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09511-2 · Cited by 38
Jayathirtha, G., & Kafai, Y. B. (2020) · ACM Transactions on Computing Education · doi:10.1145/3418299 · Cited by 32
The Effects of MALL on L2 Pronunciation Learning: A Meta-Analysis
Tseng, W., Chen, S., Wang, S.-P., Cheng, H.-F., Yang, P.-S., & Gao, X. A. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331211058662 · Cited by 32
Ncube, S., Dube, L., & Ngulube, P. (2014) · Mediterranean Journal of Social Sciences · doi:10.5901/mjss.2014.v5n16p357 · Cited by 32
Singh, S. K., & Gorey, K. M. (2018) · Social Work in Mental Health · doi:10.1080/15332985.2017.1373266 · Cited by 32
Sánchez-Meca, J., & Marín-Martínez, F. (2010) · International Encyclopedia of Education · doi:10.1016/b978-0-08-044894-7.01345-2 · Cited by 31
Zhang, Z., Xia, E., & Huang, J. (2022) · JMIR mhealth and uhealth · doi:10.2196/30960 · Cited by 39
Online Teacher Professional Development: A Research Synthesis on Effectiveness and Evaluation
Stavermann, K. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09792-9 · Cited by 31
Tablets for teaching and learning: A systematic review and meta-analysis
Tamim, R., Borokhovski, E., Pickup, D., Bernard, R. M., & Saadi, L. E. (2015) · Commonwealth of Learning · doi:10.13140/rg.2.1.3670.5042 · Cited by 31
Effectiveness of Cognitive Skills-Based Computer-Assisted Instruction for Students With Disabilities
Weng, P.-L., Maeda, Y., & Bouck, E. C. (2014) · Remedial and Special Education · doi:10.1177/0741932513514858 · Cited by 31
Culturally Adapted Substance Use Interventions for Latino Adolescents
Robles, E. H., Maynard, B. R., Salas‐Wright, C. P., & Todić, J. (2016) · Research on Social Work Practice · doi:10.1177/1049731516676601 · Cited by 34
A Meta-Analysis of Schema Instruction Implemented in Single-Case Experimental Designs
Peltier, C., Vannest, K. J., & Marbach, J. (2018) · The Journal of Special Education · doi:10.1177/0022466918763173 · Cited by 30
Technology effectiveness in the mathematics classroom: a systematic review of meta-analytic research
Young, J., Gorumek, F., & Hamilton, C. (2018) · Journal of Computers in Education · doi:10.1007/s40692-018-0104-2 · Cited by 31
Changes in interlanguage complexity during study abroad: A meta-analysis
Xu, Y. (2018) · System · doi:10.1016/j.system.2018.11.008 · Cited by 31
Bayuo, J., Wong, F. K. Y., & Agyei, F. B. (2020) · Journal of Nursing Scholarship · doi:10.1111/jnu.12563 · Cited by 31
Srimoragot, M., Hershberger, P. E., Park, C., Hernandez, T. L., & Izci‐Balserak, B. (2022) · Journal of Sleep Research · doi:10.1111/jsr.13625 · Cited by 31
Meta-análisis e Intervención Psicosocial Basada en la Evidencia
Sánchez‐Meca, J., Marín‐Martínez, F., & López-López, J. A. (2011) · Psychosocial Intervention · doi:10.5093/in2011v20n1a8 · Cited by 31
Complex Moral Injury: Shattered Moral Assumptions
Fleming, W. H. (2022) · Journal of Religion and Health · doi:10.1007/s10943-022-01542-4 · Cited by 34
Araújo, S., Domingues, M., & Fernandes, T. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09651-4 · Cited by 36
The impact of background music on learners: A systematic review and meta-analysis
Velasco, E. D. L. M., Chen, Y., Hirumi, A. “. C., & Bai, H. (2023) · Psychology of Music · doi:10.1177/03057356231153070 · Cited by 30
Fong, C. J., Patall, E. A., Snyder, K. E., Hoff, M. A., Jones, S. J., & Zuniga-Ortega, R. E. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100566 · Cited by 43
Rice, M., Lambright, K., & Wijekumar, K. K. (2024) · Reading Research Quarterly · doi:10.1002/rrq.546 · Cited by 61
Systematic review of research methods: the case of business instruction
Fiegen, A. M. (2010) · Reference Services Review · doi:10.1108/00907321011070883 · Cited by 30
Liu, G., Tsui, E., & Kianto, A. (2021) · Knowledge Management Research & Practice · doi:10.1080/14778238.2021.1970492 · Cited by 30
Time Spent on Homework and Academic Achievement: A Meta-analysis Study Related to Results of TIMSS
Özyıldırım, G. (2021) · Psicologí a Educativa · doi:10.5093/psed2021a30 · Cited by 30
PEMANFAATAN MEDIA ONLINE SEBAGAI SARANA EDUKASI KESEHATAN PADA REMAJA : TINJAUAN LITERATUR
Sembada, S. D., Pratomo, H., Fauziah, I., Amani, S. A., Nazhofah, Q., & Kurniawati, R. (2022) · PREPOTIF Jurnal Kesehatan Masyarakat · doi:10.31004/prepotif.v6i1.3110 · Cited by 30
Literature reviews in operations research: A new taxonomy and a meta review
Schryen, G., & Sperling, M. (2023) · Computers & Operations Research · doi:10.1016/j.cor.2023.106269 · Cited by 29
Using meta-analyses for comparative effectiveness research
Conn, V. S., Ruppar, T. M., Phillips, L. J., & Chase, J. D. (2012) · Nursing Outlook · doi:10.1016/j.outlook.2012.04.004 · Cited by 30
Escobar, K. M., & Gorey, K. M. (2018) · Social Work in Mental Health · doi:10.1080/15332985.2018.1476284 · Cited by 34
Writing Interventions for Individuals with Autism Spectrum Disorder: A Research Synthesis
Accardo, A. L., Finnegan, E. G., Kuder, S. J., & Bomgardner, E. M. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-03955-9 · Cited by 31
Meta-Analytic Structural Equation Modeling
Cheung, M. W. ‐. (2021) · Oxford University Press eBooks · doi:10.1093/acrefore/9780190224851.013.225 · Cited by 33
Risk as an Approach to Regulatory Governance: An Evidence Synthesis and Research Agenda
van der Heijden, J. (2021) · SAGE Open · doi:10.1177/21582440211032202 · Cited by 44
Trindade, N. V., Ferreira, A., Pereira, J. M., & Oliveira, S. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105018 · Cited by 29
A methodological synthesis of narrative inquiry research in applied linguistics: What's the story?
Ghanbar, H., Cinaglia, C., Randez, R. A., & Costa, P. I. D. (2024) · International Journal of Applied Linguistics · doi:10.1111/ijal.12591 · Cited by 37
The power functions of Begg's and Egger's tests for publication bias
Michael, H. (2024) · Statistica Neerlandica · doi:10.1111/stan.12364 · Cited by 31
Do Performance Trends Suggest Wide-spread Collaborative Cheating on Asynchronous Exams?
Chen, B., West, M., & Zilles, C. B. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3051465 · Cited by 29
McAndrews, M. (2019) · System · doi:10.1016/j.system.2019.04.007 · Cited by 33
Mandatory arrest for domestic violence and repeat offending: A meta-analysis
Hoppe, S. J., Yan, Z., Hayes, B. E., & Bills, M. A. (2020) · Aggression and Violent Behavior · doi:10.1016/j.avb.2020.101430 · Cited by 32
Rasdi, R. M., & Ahrari, S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237838 · Cited by 30
Behavioral Drivers of Performance in Public-Sector Organizations: A Literature Review
Asif, A., & Rathore, K. (2021) · SAGE Open · doi:10.1177/2158244021989283 · Cited by 29
Piwowar‐Sulej, K. (2021) · Environment Development and Sustainability · doi:10.1007/s10668-021-02011-w · Cited by 29
Conn, V. S., Hafdahl, A. R., Phillips, L. J., Ruppar, T. M., & Chase, J. D. (2014) · The Journal of Primary Prevention · doi:10.1007/s10935-014-0352-5 · Cited by 29
Cramer, C., & Binder, K. (2015) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-014-0605-3 · Cited by 37
Handedness and cognitive ability: Using meta-analysis to make sense of the data
Παπαδάτου-Παστού, Μ. (2018) · Progress in brain research · doi:10.1016/bs.pbr.2018.06.008 · Cited by 28
Turner, J. R. (2018) · Performance Improvement Quarterly · doi:10.1002/piq.21275 · Cited by 29
Meta-analysis on effects of artificial intelligence education in K-12 South Korean classrooms
Lee, D., & Kwon, H. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12738-4 · Cited by 41
Schauer, A., Vasconcelos, A. C., & Sen, B. A. (2015) · Journal of Knowledge Management · doi:10.1108/jkm-12-2014-0519 · Cited by 28
Taylor, M. E., & Sanner, J. E. (2015) · The Journal of School Nursing · doi:10.1177/1059840515619683 · Cited by 28
Comparing Bilingual to Monolingual Learners on English Spelling: A Meta‐analytic Review
Zhao, J., Quiroz, B. G., Dixon, L. Q., & Malatesha, R. N. (2016) · Dyslexia · doi:10.1002/dys.1530 · Cited by 30
The Roles and Measurements of Proximity in Sustained Technology Development: A Literature Review
Omobhude, C., & Chen, S. (2019) · Sustainability · doi:10.3390/su11010224 · Cited by 28
Primary Study Quality in Psychological Meta-Analyses: An Empirical Assessment of Recent Practice
Hohn, R. E., Slaney, K. L., & Tafreshi, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02667 · Cited by 27
A revisão sistemática de literatura em psicologia: Desafios e orientações
Camilo, C., & Garrido, M. V. (2019) · Análise Psicológica · doi:10.14417/ap.1546 · Cited by 53
A research synthesis of the impacts of successful educational actions on student outcomes
Folch, T. M., Davids, A. I. R., Cuxart, M. P., & Valls, R. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100482 · Cited by 28
Effects of extended reality on language learning: A meta-analysis
Chen, J., Dai, J., Zhu, K., & Xu, L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1016519 · Cited by 28
The Systematic Review as a Research Process in Music Therapy
Hanson‐Abromeit, D., & Moore, K. S. (2014) · Journal of Music Therapy · doi:10.1093/jmt/thu002 · Cited by 37
A research synthesis on the interface between lean construction and safety management
Antillon, E. I. (2010) · CU Scholar (University of Colorado Boulder) · Cited by 28
‘Dare to be silent’: Re-conceptualising silence as a positive pedagogical approach in schools
Su, F., Wood, M., & Tribe, R. (2023) · Research in Education · doi:10.1177/00345237231152604 · Cited by 27
Metadata
- Authors
- Cooper, H.
- Corresponding author
- Cooper, Harris
- ORCID
- Cooper, Harris
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc
- Published
- 2017
- OpenAlex
- W1420162645
- Cited by
- 1,716
- References
- 0
- Citations by year
- 2026: 51 · 2025: 136 · 2024: 176 · 2023: 163 · 2022: 142 · 2021: 167 · 2020: 159 · 2019: 154 · 2018: 97 · 2017: 81
- FWCI
- 57.19
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Sage eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Diverse Academic Research Areas
- Keywords
- evidence synthesis, meta-analysis, literature searching, study quality assessment, evidence integration, threats to validity, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review