The DOI matches its Crossref record.
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Abstract
Preface to the Fourth Edition Acknowledgments About the Author Chapter 1. Introduction Chapter 2. Step 1: Formulating the Problem Chapter 3. Step 2: Searching the Literature Chapter 4. Step 3: Gathering Information From Studies Chapter 5. Step 4: Evaluating the Quality of Studies Chapter 6. Step 5: Analyzing and Integrating the Outcomes of Studies Chapter 7. Step 6: Interpreting the Evidence Chapter 8. Step 7: Presenting the Results Chapter 9. Conclusion: Threats to the Validity of Research Synthesis Conclusions References Author Index Subject Index
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers conducting evidence synthesis must transform narrative study reports into tabular records before quantitative integration can begin [1,2].”
From Diagnosing the limits of large language models for structured scientific evidence extraction (2026) · cites this paper as [2]
In the citing paper
“To ensure coding reliability and to mitigate inconsistencies in the data extraction223, 30 articles were randomly selected and independently coded by author D.F. Any inconsistencies were discussed to reach consensus, also drawing on a third author (U.S.T.), if needed.”
From Prevalence and severity of mental health problems in early-career researchers: a systematic review and meta-analysis (2026) · cites this paper as [223]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
Gusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379
Hall, W. J., Chapman, M. V., Lee, K. M., Merino, Y. M., Thomas, T. W., Payne, B. K., Eng, E., Day, S. H., & Coyne-Beasley, T. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302903 · Cited by 2,176
Identifying effective climate change education strategies: a systematic review of the research
Monroe, M. C., Plate, R. R., Oxarart, A., Bowers, A. W., & Chaves, W. A. (2017) · Environmental Education Research · doi:10.1080/13504622.2017.1360842 · Cited by 1,615
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330
INNOVATION IN THE PUBLIC SECTOR: A SYSTEMATIC REVIEW AND FUTURE RESEARCH AGENDA
DE VRIES, H., BEKKERS, V., & TUMMERS, L. (2016) · Public Administration · doi:10.1111/padm.12209 · Cited by 1,214
Organizational Resilience: A Valuable Construct for Management Research?
Hillmann, J., & Guenther, E. (2020) · International Journal of Management Reviews · doi:10.1111/ijmr.12239 · Cited by 1,321
A New Paradigm for Systematic Literature Reviews in Supply Chain Management
Durach, C. F., Kembro, J. H., & Wieland, A. (2017) · Journal of Supply Chain Management · doi:10.1111/jscm.12145 · Cited by 1,061
A meta-analysis of the effect of cognitive bias modification on anxiety and depression
Hallion, L. S., & Ruscio, A. M. (2011) · Psychological Bulletin · doi:10.1037/a0024355 · Cited by 891
Environmental education outcomes for conservation: A systematic review
Ardoin, N. M., Bowers, A. W., & Gaillard, E. (2020) · Biological Conservation · doi:10.1016/j.biocon.2019.108224 · Cited by 924
Organizational Ambidexterity and Performance: A Meta-Analysis
Junni, P., Sarala, R. M., Taras, V., & Tarba, S. Y. (2013) · Academy of Management Perspectives · doi:10.5465/amp.2012.0015 · Cited by 891
How Effective Are Mentoring Programs for Youth? A Systematic Assessment of the Evidence
DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011) · Psychological Science in the Public Interest · doi:10.1177/1529100611414806 · Cited by 889
Integrative data analysis: The simultaneous analysis of multiple data sets
Curran, P. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015914 · Cited by 867
Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014) · Journal of Computing in Higher Education · doi:10.1007/s12528-013-9077-3 · Cited by 870
Conducting systematic literature review in operations management
Thomé, A. M. T., Scavarda, L. F., & Scavarda, A. (2016) · Production Planning & Control · doi:10.1080/09537287.2015.1129464 · Cited by 904
Dent, A. L., & Koenka, A. C. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9320-8 · Cited by 1,011
Richardson, J. C., Maeda, Y., Lv, J., & Caskurlu, S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.02.001 · Cited by 787
Coping During Public Service Delivery: A Conceptualization and Systematic Review of the Literature
Tummers, L. L. G., Bekkers, V., Vink, E., & Musheno, M. (2015) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muu056 · Cited by 756
Perceived Racism and Mental Health Among Black American Adults: A Meta-Analytic Review
Pieterse, A. L., Todd, N. R., Neville, H. A., & Carter, R. T. (2012) · Journal of Counseling Psychology · doi:10.1037/a0026208 · Cited by 649
Risk Factors for School Absenteeism and Dropout: A Meta-Analytic Review
Gubbels, J., van der Put, C. E., & Assink, M. (2019) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-01072-5 · Cited by 596
Augé, R. M., Toler, H. D., & Saxton, A. M. (2014) · Mycorrhiza · doi:10.1007/s00572-014-0585-4 · Cited by 613
Meta-evaluation of meta-analysis: ten appraisal questions for biologists
Nakagawa, S., Noble, D. W. A., Senior, A. M., & Lagisz, M. (2017) · BMC Biology · doi:10.1186/s12915-017-0357-7 · Cited by 579
The effectiveness of celebrity endorsements: a meta-analysis
Knoll, J., & Matthes, J. (2017) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-016-0503-8 · Cited by 601
Schot, E., Tummers, L., & Noordegraaf, M. (2020) · Journal of Interprofessional Care · doi:10.1080/13561820.2019.1636007 · Cited by 579
Methodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568
Booth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 542
Reporting standards for research in psychology: why do we need them? What might they be?
APA Publications and Communications Board Working Group on Journal Article Reporting Standards (2008) · American Psychologist · doi:10.1037/0003-066x.63.9.839 · Cited by 571
Modern attitudes toward older adults in the aging world: A cross-cultural meta-analysis.
North, M. S., & Fiske, S. T. (2015) · Psychological Bulletin · doi:10.1037/a0039469 · Cited by 569
Classroom management self-efficacy and burnout: A multivariate meta-analysis
Aloe, A. M., Amo, L. C., & Shanahan, M. E. (2014) · Educational Psychology Review · doi:10.1007/s10648-013-9244-0 · Cited by 560
Hillmayr, D., Ziernwald, L., Reinhold, F., Hofer, S. I., & Reiss, K. M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103897 · Cited by 574
“Therefore, a random-effects model seems more appropriate than a fixed-effect model (Borenstein et al., 2009; Cooper, 2010; Lipsey & Wilson, 2001).”
MethodDo AI chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576
Lawson, G. M., Hook, C. J., & Farah, M. J. (2018) · Developmental Science · doi:10.1111/desc.12529 · Cited by 556
Yorio, P. L., & Ye, F. (2012) · Academy of Management Learning and Education · doi:10.5465/amle.2010.0072 · Cited by 552
A Framework for Guiding and Evaluating Literature Reviews
Templier, M., & Paré, G. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03706 · Cited by 553
Bibri, S. E., Krogstie, J., Kaboli, A., & Alahi, A. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2023.100330 · Cited by 536
Supply chain finance: a literature review
Gelsomino, L. M., Mangiaracina, R., Perego, A., & Tumino, A. (2016) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-08-2014-0173 · Cited by 532
25 Years of Transparency Research: Evidence and Future Directions
Cucciniello, M., Porumbescu, G. A., & Grimmelikhuijsen, S. (2017) · Public Administration Review · doi:10.1111/puar.12685 · Cited by 512
Spieske, A., & Birkel, H. S. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2021.107452 · Cited by 586
Meta‐analysis and traditional systematic literature reviews—What, why, when, where, and how?
Paul, J., & Barari, M. M. (2022) · Psychology and Marketing · doi:10.1002/mar.21657 · Cited by 640
Weigel, F. K., & Hazen, B. T. (2013) · Advances in healthcare information systems and administration book series · doi:10.4018/978-1-4666-4619-3.ch008 · Cited by 497
Yeager, D. S., Fong, C. J., Lee, H. Y., & Espelage, D. L. (2015) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2014.11.005 · Cited by 472
Methodological Guidance Paper: The Art and Science of Quality Systematic Reviews
Alexander, P. A. (2020) · Review of Educational Research · doi:10.3102/0034654319854352 · Cited by 564
Böhm, S., Mersmann, F., & Arampatzis, A. (2015) · Sports Medicine - Open · doi:10.1186/s40798-015-0009-9 · Cited by 465
A meta-analysis of consumer impulse buying
Amos, C., Holmes, G. R., & Keneson, W. C. (2013) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2013.11.004 · Cited by 450
Reading from paper compared to screens: A systematic review and meta‐analysis
Clinton‐Lisell, V. (2019) · Journal of Research in Reading · doi:10.1111/1467-9817.12269 · Cited by 588
Meta-Synthesis of Qualitative Case Studies
Hoon, C. (2013) · Organizational Research Methods · doi:10.1177/1094428113484969 · Cited by 426
Morgan, S. J., Pullon, S. R. H., & McKinlay, E. M. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.03.008 · Cited by 460
Early childhood environmental education: A systematic review of the research literature
Ardoin, N. M., & Bowers, A. W. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100353 · Cited by 637
Best practice guidelines for abstract screening large‐evidence systematic reviews and meta‐analyses
Polanin, J. R., Pigott, T., Espelage, D. L., & Grotpeter, J. K. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1354 · Cited by 413
A multivariate meta-analysis of student misbehavior and teacher burnout
Aloe, A. M., Shisler, S. M., Norris, B. D., Nickerson, A. B., & Rinker, T. W. (2014) · Educational Research Review · doi:10.1016/j.edurev.2014.05.003 · Cited by 376
Prevalence of low back pain in children and adolescents: a meta-analysis
Calvo, I., Gómez‐Conesa, A., & Sánchez‐Meca, J. (2013) · BMC Pediatrics · doi:10.1186/1471-2431-13-14 · Cited by 380
Teachers’ Instructional Adaptations: A Research Synthesis
Parsons, S. A., Vaughn, M., Scales, R. Q., Gallagher, M. A., Parsons, A. W., Davis, S. G., Pierczynski, M., & Allen, M. H. (2017) · Review of Educational Research · doi:10.3102/0034654317743198 · Cited by 468
Environmental education and K-12 student outcomes: A review and analysis of research
Ardoin, N. M., Bowers, A. W., Roth, N. W., & Holthuis, N. I. (2017) · The Journal of Environmental Education · doi:10.1080/00958964.2017.1366155 · Cited by 352
Zych, I., Ortega-Ruiz, R., & Del Rey, R. (2015) · Aggression and Violent Behavior · doi:10.1016/j.avb.2015.10.001 · Cited by 439
Cooper, H., & Patall, E. A. (2009) · Psychological Methods · doi:10.1037/a0015565 · Cited by 339
Self-citationThe impact of gamification in educational settings on student learning outcomes: a meta-analysis
Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09807-z · Cited by 340
Evaluation of the measurement properties of the Epworth sleepiness scale: A systematic review
Kendzerska, T. B., Smith, P. M., Brignardello-Petersen, R., Leung, R. S., & Tomlinson, G. A. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2013.08.002 · Cited by 334
Quarshie, A. M., Salmi, A., & Leuschner, R. (2015) · Journal of Purchasing and Supply Management · doi:10.1016/j.pursup.2015.11.001 · Cited by 358
Cross-National Predictors of Crime: A Meta-Analysis
Nivette, A. E. (2011) · Homicide Studies · doi:10.1177/1088767911406397 · Cited by 323
Kazemi, N., Modak, N. M., & Govindan, K. (2018) · International Journal of Production Research · doi:10.1080/00207543.2018.1471244 · Cited by 329
Green vehicle routing problem: A state-of-the-art review
Asghari, M., & Al-e-Hashem, S. M. J. M. (2020) · International Journal of Production Economics · doi:10.1016/j.ijpe.2020.107899 · Cited by 312
Risk factors for post–intensive care syndrome: A systematic review and meta-analysis
Lee, M., Kang, J., & Jeong, Y. J. (2019) · Australian Critical Care · doi:10.1016/j.aucc.2019.10.004 · Cited by 332
Garcia, G. A., Núñez, A.-M., & Sansone, V. A. (2019) · Review of Educational Research · doi:10.3102/0034654319864591 · Cited by 347
The effects of psychological distance on abstraction: Two meta-analyses.
Soderberg, C. K., Callahan, S. P., Kochersberger, A. O., Amit, E., & Ledgerwood, A. (2014) · Psychological Bulletin · doi:10.1037/bul0000005 · Cited by 350
Motivation Terminology in Reading Research: A Conceptual Review
Conradi, K., Jang, B. G., & McKenna, M. C. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9245-z · Cited by 351
Global Patterns in the Implementation of Payments for Environmental Services
Ezzine‐de‐Blas, D., Wunder, S., Ruíz-Pérez, M., & Moreno-Sánchez, R. D. P. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149847 · Cited by 305
Kroll, A. (2015) · Public Performance & Management Review · doi:10.1080/15309576.2015.1006469 · Cited by 297
Blut, M., Durham University Business School, U., Chong, A. Y. L., Nottingham University Business School–Ningbo, C., Tsigna, Z., Nottingham University Business School–Ningbo, C., Venkatesh, V., & Pamplin College of Business, V. T. (2022) · Journal of the Association for Information Systems · doi:10.17705/1jais.00719 · Cited by 228
Global response patterns of plant photosynthesis to nitrogen addition: A meta‐analysis
Liang, X., Tong, Z., Lu, X., Ellsworth, D. S., BassiriRad, H., You, C., Wang, D., He, P., Deng, Q., Liu, H., et al. (2020) · Global Change Biology · doi:10.1111/gcb.15071 · Cited by 288
Bystander Education Training for Campus Sexual Assault Prevention: An Initial Meta-Analysis
Katz, J., & Moore, J. (2013) · Violence and Victims · doi:10.1891/0886-6708.vv-d-12-00113 · Cited by 288
How effective are mobile devices for language learning? A meta-analysis
Sung, Y., Chang, K.-E., & Yang, J.-M. (2015) · Educational Research Review · doi:10.1016/j.edurev.2015.09.001 · Cited by 321
Mathematics teacher learning to notice: a systematic review of studies of video-based programs
Santagata, R., König, J., Scheiner, T., Nguyen, H., Adleff, A.-K., Yang, X., & Kaiser, G. (2021) · ZDM · doi:10.1007/s11858-020-01216-z · Cited by 275
Mastering the digital transformation through organizational capabilities: A conceptual framework
Konopik, J., Jahn, C., Schuster, T., Hoßbach, N., & Pflaum, A. (2021) · Digital Business · doi:10.1016/j.digbus.2021.100019 · Cited by 359
Yip, T., Wang, Y., Mootoo, C., & Mirpuri, S. (2019) · Developmental Psychology · doi:10.1037/dev0000708 · Cited by 265
Huguley, J. P., Wang, M., Vasquez, A. C., & Guo, J. (2019) · Psychological Bulletin · doi:10.1037/bul0000187 · Cited by 267
Quintana, D. S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01549 · Cited by 284
Mapping the Mixed Methods–Mixed Research Synthesis Terrain
Sandelowski, M., Voils, C. I., Leeman, J., & Crandell, J. (2011) · Journal of Mixed Methods Research · doi:10.1177/1558689811427913 · Cited by 290
Debunking Myths and Urban Legends About Meta-Analysis
Aguinis, H., Pierce, C. A., Bosco, F. A., Dalton, D. R., & Dalton, C. M. (2010) · Organizational Research Methods · doi:10.1177/1094428110375720 · Cited by 264
Linking Goal Progress and Subjective Well-Being: A Meta-analysis
Klug, H. J. P., & Maier, G. W. (2015) · Journal of Happiness Studies · doi:10.1007/s10902-013-9493-0 · Cited by 257
A Meta-Analytic Review of Preschool Social and Emotional Learning Interventions
Murano, D. M., Sawyer, J., & Lipnevich, A. A. (2020) · Review of Educational Research · doi:10.3102/0034654320914743 · Cited by 344
Using Science as Evidence in Public Policy
National Research Council (2012) · National Academies Press eBooks · doi:10.17226/13460 · Cited by 265
A literature review of nursing turnover costs
Li, Y., & Jones, C. B. (2012) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2012.01411.x · Cited by 251
Zheng, L. (2016) · Asia Pacific Education Review · doi:10.1007/s12564-016-9426-9 · Cited by 294
TBLT implementation and evaluation: A meta-analysis
Bryfonski, L., & McKay, T. (2017) · Language Teaching Research · doi:10.1177/1362168817744389 · Cited by 301
The Built Environment and Social Capital: A Systematic Review
Mazumdar, S., Learnihan, V., Cochrane, T., & Davey, R. (2017) · Environment and Behavior · doi:10.1177/0013916516687343 · Cited by 246
Integrative Data Analysis in Clinical Psychology Research
Hussong, A. M., Curran, P. J., & Bauer, D. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185522 · Cited by 245
Are Computers Effective Lie Detectors? A Meta-Analysis of Linguistic Cues to Deception
Hauch, V., Blandón‐Gitlin, I., Masip, J., & Sporer, S. L. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314556539 · Cited by 256
Menne-Lothmann, C., Viechtbauer, W., Höhn, P., Kasanova, Z., Haller, S. P., Drukker, M., van Os, J., Wichers, M., & Lau, J. Y. F. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100925 · Cited by 235
Meta‐analysis of predictors of favorable employment outcomes among individuals with bipolar disorder
Tse, S. S.-K., Chan, S. H., Ng, K. L., & Yatham, L. N. (2013) · Bipolar Disorders · doi:10.1111/bdi.12148 · Cited by 238
Ali, R., Lynch, R., Melewar, T. C., & Jin, Z. (2014) · Journal of Business Research · doi:10.1016/j.jbusres.2014.10.013 · Cited by 227
Yaffe, J., Montgomery, P., Hopewell, S., & Shepard, L. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036626 · Cited by 220
Multicultural education professional development: A review of the literature
Parkhouse, H., Lu, C. Y., & Massaro, V. R. (2019) · Review of Educational Research · doi:10.3102/0034654319840359 · Cited by 219
The lot sizing problem: A tertiary study
Glock, C. H., Grosse, E. H., & Ries, J. M. (2013) · International Journal of Production Economics · doi:10.1016/j.ijpe.2013.12.009 · Cited by 219
Order picker routing in warehouses: A systematic literature review
Masae, M., Glock, C. H., & Grosse, E. H. (2019) · International Journal of Production Economics · doi:10.1016/j.ijpe.2019.107564 · Cited by 217
Interventions to Increase Physical Activity Among Older Adults: A Meta-Analysis
Chase, J. D. (2014) · The Gerontologist · doi:10.1093/geront/gnu090 · Cited by 215
Caskurlu, S., Maeda, Y., Richardson, J. C., & Lv, J. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103966 · Cited by 280
The relationship between adult attachment style and post-traumatic stress symptoms: A meta-analysis
Woodhouse, S., Ayers, S., & Field, A. P. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.07.002 · Cited by 210
Systematic Review of Design-Based Research Progress
McKenney, S. E., & Reeves, T. C. (2013) · Educational Researcher · doi:10.3102/0013189x12463781 · Cited by 256
Moran, K. R., & Valle, S. Y. D. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164541 · Cited by 214
Metadata
- Authors
- Cooper, H.
- Corresponding author
- Cooper, Harris
- ORCID
- Cooper, Harris
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc
- Published
- 2017
- OpenAlex
- W1420162645
- Cited by
- 1,716
- References
- 0
- Citations by year
- 2026: 51 · 2025: 136 · 2024: 176 · 2023: 163 · 2022: 142 · 2021: 167 · 2020: 159 · 2019: 154 · 2018: 97 · 2017: 81
- FWCI
- 57.19
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Sage eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Diverse Academic Research Areas
- Keywords
- evidence synthesis, meta-analysis, literature searching, study quality assessment, evidence integration, threats to validity, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review