The DOI matches its Crossref record.
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Abstract
Preface to the Fourth Edition Acknowledgments About the Author Chapter 1. Introduction Chapter 2. Step 1: Formulating the Problem Chapter 3. Step 2: Searching the Literature Chapter 4. Step 3: Gathering Information From Studies Chapter 5. Step 4: Evaluating the Quality of Studies Chapter 6. Step 5: Analyzing and Integrating the Outcomes of Studies Chapter 7. Step 6: Interpreting the Evidence Chapter 8. Step 7: Presenting the Results Chapter 9. Conclusion: Threats to the Validity of Research Synthesis Conclusions References Author Index Subject Index
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers conducting evidence synthesis must transform narrative study reports into tabular records before quantitative integration can begin [1,2].”
From Diagnosing the limits of large language models for structured scientific evidence extraction (2026) · cites this paper as [2]
In the citing paper
“To ensure coding reliability and to mitigate inconsistencies in the data extraction223, 30 articles were randomly selected and independently coded by author D.F. Any inconsistencies were discussed to reach consensus, also drawing on a third author (U.S.T.), if needed.”
From Prevalence and severity of mental health problems in early-career researchers: a systematic review and meta-analysis (2026) · cites this paper as [223]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 901–1,000 of 1,005
Lions, S., Monsalve, C., Dartnell, P., Blanco, M. P., Ortega, G., & Lemarié, J. (2022) · Applied Measurement in Education · doi:10.1080/08957347.2022.2067539 · Cited by 10
Ghannam, S., & Gorey, K. M. (2022) · Journal of Religion & Spirituality in Social Work Social Thought · doi:10.1080/15426432.2022.2111395 · Cited by 11
What contributed to students’ online learning satisfaction during the pandemic?
Kim, S., & Park, S. (2022) · Distance Education · doi:10.1080/01587919.2022.2150147 · Cited by 16
KASIMİ, Y., & FİDAN, Ş. (2023) · International Journal of Educational Spectrum · doi:10.47806/ijesacademic.1341110 · Cited by 10
A systematic literature review of changeability in engineering systems along the life cycle
Sullivan, B. P., Arias–Nava, E. H., Rossi, M., & Terzi, S. (2023) · Journal of Engineering Design · doi:10.1080/09544828.2023.2273248 · Cited by 10
How well do fertilizer enhancers work?
Jenkins, T. A., Randhawa, P. S., & Jenkins, V. (2018) · Journal of Plant Nutrition · doi:10.1080/01904167.2018.1426018 · Cited by 10
Analyzing the decline of student scores over time in self‐scheduled asynchronous exams
Chen, B., West, M., & Zilles, C. B. (2019) · Journal of Engineering Education · doi:10.1002/jee.20292 · Cited by 10
Jaremka, L. M., Kane, H. S., Sunami, N., Lebed, O., & Austin, K. A. (2020) · Personal Relationships · doi:10.1111/pere.12338 · Cited by 10
Tamim, R. M., Borokhovski, E., Bernard, R. M., Schmid, R. F., Abrami, P. C., & Pickup, D. I. (2021) · Australasian Journal of Educational Technology · doi:10.14742/ajet.6322 · Cited by 10
Wilson, M. L. (2022) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2134236 · Cited by 15
Ahmad, A. M. K., & Ahmad, Q. (2015) · International Journal of Marketing Studies · doi:10.5539/ijms.v7n6p92 · Cited by 16
Stress Management Interventions Among U.S. High School Adolescents: A Meta-Analysis
Ng, T. J., Ling, J., Robbins, L. B., & Kao, T. A. (2023) · Journal of the American Psychiatric Nurses Association · doi:10.1177/10783903231161608 · Cited by 15
Do citizen perceptual measures align with archival performance measures: a meta-analysis
Hsu, H., & Lu, J. (2023) · International Public Management Journal · doi:10.1080/10967494.2023.2204085 · Cited by 9
Sims, W. A., King, K. R., Preast, J. L., Burns, M. K., & Panameño, S. (2023) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2023.2232785 · Cited by 9
Porkodi, S., & Raman, A. M. (2024) · Management Review Quarterly · doi:10.1007/s11301-023-00401-0 · Cited by 9
Effects of Flipped Learning on Language Learning Outcomes: A Meta-Analysis investigating Moderators
Chen, H.-J., Chen, C.-H., & Wu, W. V. (2025) · SAGE Open · doi:10.1177/21582440251331298 · Cited by 15
Opportunities and Challenges for Research Synthesis in Applied Linguistics: Three Scholars Reflect
Plonsky, L., Isaacs, T., & Taylor, L. B. (2025) · Research Synthesis in Applied Linguistics · doi:10.1080/29984475.2025.2518085 · Cited by 9
CSCL in STEM Education: Preliminary Findings from a Meta-Analysis
Jeong, H., Hmelo‐Silver, C. E., Jo, K., & Shin, M. (2016) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2016.11 · Cited by 9
An Empirical Review of Research and Reporting Practices in Psychological Meta-Analyses
Hohn, R. E., Slaney, K. L., & Tafreshi, D. (2020) · Review of General Psychology · doi:10.1177/1089268020918844 · Cited by 8
A Rigorous Standalone Literature Review of Residential Electricity Load Profiles
Kewo, A., Manembu, P. D. K., & Nielsen, P. S. (2023) · Energies · doi:10.3390/en16104072 · Cited by 9
A systematic review: pedagogies and outcomes of formal leadership programs for college students
Ueda, N., & Kezar, A. J. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2314718 · Cited by 9
Structural Changes in Academic Motivation From Elementary School to University :
Okada, R. (2010) · The Japanese Journal of Educational Psychology · doi:10.5926/jjep.58.414 · Cited by 9
Qin, H., & Grigsby, M. (2016) · Human Ecology Review · doi:10.22459/her.22.02.2016.05 · Cited by 9
The Impact of Religiosity on Substance Abuse and Obesity in African Americans
Dodor, B. A., Robinson, M. A., Watson, R., Meetze, D., & Whicker, R. (2017) · Journal of Religion and Health · doi:10.1007/s10943-017-0501-2 · Cited by 9
Szedlak, C., Leyendecker, B., Reinemann, H., & Pötters, P. (2020) · Lecture notes on multidisciplinary industrial engineering · doi:10.1007/978-3-030-43616-2_12 · Cited by 9
Musculoskeletal injury survivors’ resiliency: A systematic review
Moran, M. E., Hodgson, J. L., Jensen, J. F., & Wood, T. L. (2020) · Disability and health journal · doi:10.1016/j.dhjo.2020.100987 · Cited by 8
Technology for Research Synthesis: An Application of Sociotechnical Systems Theory
Dell, N. A., Maynard, B. R., Murphy, A. M., & Stewart, M. (2021) · Journal of the Society for Social Work and Research · doi:10.1086/713525 · Cited by 10
Hakim, S., Wati, L. N., & Mardiana, R. (2022) · Advances in economics, business and management research/Advances in Economics, Business and Management Research · doi:10.2991/978-94-6463-068-8_7 · Cited by 9
Encouraging Sustainability and Innovation: Green Banking Practices Growing in Indonesia
Khaer, M., & Anwar, S. (2022) · EKSYAR Jurnal Ekonomi Syari ah & Bisnis Islam · doi:10.54956/eksyar.v9i2.422 · Cited by 9
Determining When an Object Enters the Headlight Beam Pattern of a Vehicle
Muttart, J., Bartlett, W. D., Kauderer, C., Johnston, G. L., Romoser, M. R. E., Unarski, J., & Barshinger, D. (2013) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2013-01-0787 · Cited by 9
Quantitative research methods in ISLA
Li, S. (2022) · Research methods in applied linguistics · doi:10.1075/rmal.3.02li · Cited by 8
Dardas, L. A., Xu, H., Franklin, M. S., Scott, J., Vance, A. J., van de Water, B. J., & Pan, W. (2023) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465822000662 · Cited by 8
Individual Participant Data Meta-Analysis Including Moderators: Empirical Validation
Moeyaert, M., Yang, P., & Xue, Y. (2023) · The Journal of Experimental Education · doi:10.1080/00220973.2023.2208062 · Cited by 8
Mubarrak, H., Yahya, F., & Iskandar, I. (2023) · JURIS (Jurnal Ilmiah Syariah) · doi:10.31958/juris.v22i2.10258 · Cited by 8
Is Phonological-Only Instruction Helpful for Reading?: A Meta-Analysis
Stalega, M. V., Kearns, D. M., Bourget, J., Bayer, N., & Hebert, M. A. (2024) · Scientific Studies of Reading · doi:10.1080/10888438.2024.2340708 · Cited by 8
Exploring determinants of school dropout across regions in India: a comprehensive meta-analysis
Venkatesan, R. G., Karmegam, D., & Mappillairaju, B. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00285-4 · Cited by 11
Ellison, T. L., Compton‐Lilly, C. F., & Rogers, R. (2024) · Reading Research Quarterly · doi:10.1002/rrq.558 · Cited by 8
The effectiveness of virtual reality training on social skills in education: A meta-analysis
Li, X., Hu, Y., Yang, X., Bi, X., Zhang, J., & Tao, P. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12941-3 · Cited by 8
Early years of biased random-key genetic algorithms: a systematic review
Londe, M. A., Pessoa, L. S., Andrade, C. E., & Resende, M. G. C. (2024) · Journal of Global Optimization · doi:10.1007/s10898-024-01446-5 · Cited by 8
Zhang, C., Sun, N., Jiang, Y., Liu, H., & Huang, Q. (2024) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-024-00960-0 · Cited by 8
Li, A. C. M., Chio, F. H. N., Mak, W. W. S., Fong, T., Chan, S. H. W., Tran, Y. H. R., & Kakani, K. (2025) · Social Science & Medicine · doi:10.1016/j.socscimed.2025.117749 · Cited by 8
Wang, J., Tigelaar, D. E. H., Ye, T., & Admiraal, W. (2025) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70168 · Cited by 8
Wang, Y., Zhang, Z. J., & Zhou, H. (2026) · Research Synthesis in Applied Linguistics · doi:10.1080/29984475.2026.2647961 · Cited by 10
Towards an Evidence-based Research Approach in Information Systems
Goeken, M. (2011) · Journal of the Association for Information Systems · Cited by 8
Ramírez, S., Míguez, G., Quezada-Scholz, V. E., Pardo, L., Alfaro, F., Varas, F. I., & Laborda, M. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.934600 · Cited by 7
A multilevel meta-analysis of cyberstalking: Domains (and subdomains) of contributing factors
Kim, B. (2023) · Journal of criminal justice · doi:10.1016/j.jcrimjus.2023.102084 · Cited by 7
A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching
Kim, Y., & Lee, S. Y. (2023) · Sustainability · doi:10.3390/su15129727 · Cited by 8
Lee, S. A. W., & Gates, K. M. (2023) · Multivariate Behavioral Research · doi:10.1080/00273171.2023.2229310 · Cited by 10
Bernard, R. M., Borokhovski, E., Schmid, R. F., & Tamim, R. M. (2023) · Springer eBooks · doi:10.1007/978-3-319-17461-7_109 · Cited by 9
Peran Psikologi Pendidikan dalam Proses Pembelajaran di Kelas untuk Peserta Didik yang Beragam
Azzahra, L., & Darmiyanti, A. (2024) · Jurnal Psikologi · doi:10.47134/pjp.v1i4.2661 · Cited by 29
Positive leadership and employees’ pro-environmental behavior: a meta-analysis
Zhang, Y., Duan, C., Zhang, J., & Akhtar, M. N. (2024) · Current Psychology · doi:10.1007/s12144-024-06727-6 · Cited by 14
Recall, Robustness, and Lexicographic Evaluation
Díaz, F., Ekstrand, M. D., & Mitra, B. (2025) · ACM Transactions on Recommender Systems · doi:10.1145/3728373 · Cited by 8
Mentoring Youth with Emotional and Behavioral Problems: A Meta-Analytic Review
Meyerson, D. A. (2013) · Digital Commons-DePaul (DePaul University) · Cited by 8
Chuang, E. K., Mensch, B., Psaki, S. R., Haberland, N. A., & Kozak, M. (2019) · Campbell Systematic Reviews · doi:10.1002/cl2.1047 · Cited by 11
Phases and tools for supply chain risk management: a systematic literature review
Gaspar, P. G. P., Ceryno, P. S., Ferrer, A. L., & Thomé, A. M. T. (2020) · Gestão & Produção · doi:10.1590/0104-530x4227-20 · Cited by 8
Effects of digital learning in anaesthesiology
Shih, Y. D., Liu, C.-C., Chang, C.-C., & Lee, Y.-W. (2020) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000001262 · Cited by 7
Effects of exercise on depressive symptoms among nursing home residents: a meta-analysis
Li, L., Luo, J., Reangsing, C., & Schneider, J. K. (2021) · Aging & Mental Health · doi:10.1080/13607863.2021.1951658 · Cited by 8
On the bias of complete‐ and shifting‐case meta‐regressions with missing covariates
Schauer, J. M., Lee, J., Diaz, K. G., & Pigott, T. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1558 · Cited by 7
Bühler, D., Hemmert, F., Hurtienne, J., & Petersen, C. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102816 · Cited by 8
Liu, G., Tsui, E., & Kianto, A. (2022) · Knowledge Management Research & Practice · doi:10.1080/14778238.2022.2147459 · Cited by 8
A Meta-Analysis of Common Factors in Child Therapy Interventions
Warwick, L. A., Lenz, A., Branch, M. L., & Lemberger-Truelove, M. E. (2023) · Journal of Child and Adolescent Counseling · doi:10.1080/23727810.2023.2215157 · Cited by 6
Consensus in a Fuzzy Environment: A Bibliometric Study
Cabrerizo, F. J., Mart́ınez, M. A., Herrera, M., & Herrera‐Viedma, E. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.07.065 · Cited by 8
Use of Diffusion of Innovations Theory in Medical Informatics Research
Weigel, F. K., Rainer, R. K., Hazen, B. T., Cegielski, C. G., & Ford, F. N. (2012) · International Journal of Healthcare Information Systems and Informatics · doi:10.4018/jhisi.2012070104 · Cited by 8
Clark, T. T., McGovern, P., Mgbeokwere, D., Wooten, N. R., Owusu, H., & McGraw, K. A. (2013) · Journal of Social Work · doi:10.1177/1468017313479858 · Cited by 8
Wescoat, J. L. (2014) · Digital Library Of The Commons Repository (Indiana University) · Cited by 8
A meta-synthesis approach to specify components of future banking
Parast, E. S. (2019) · foresight · doi:10.1108/fs-10-2018-0089 · Cited by 8
Tredoux, C. G., Sporer, S. L., Vredeveldt, A., Kempen, K., & Nortje, A. (2020) · Journal of Experimental Criminology · doi:10.1007/s11292-020-09432-z · Cited by 8
Fundamentals of Criminological and Criminal Justice Inquiry
Mears, D. P., & Cochran, J. C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108149815 · Cited by 8
Tuncer, M., & Dikmen, M. (2017) · Journal of Human Sciences · doi:10.14687/jhs.v14i1.4314 · Cited by 8
Maggio, L. A., Thomas, A., & Durning, S. J. (2018) · Wiley eBooks · doi:10.1002/9781119373780.ch31 · Cited by 9
Digital gestützte Zusammenarbeit von Organisationen in der beruflichen Bildung
Hähn, K., & Niehoff, A. (2021) · Waxmann Verlag GmbH eBooks · doi:10.31244/9783830994558.05 · Cited by 7
Han, B.-S., Lee, J., Yim, S., & Kim, D. M. (2024) · Topics in Stroke Rehabilitation · doi:10.1080/10749357.2024.2329849 · Cited by 7
Hou, J., Lee, J. F., & Doherty, S. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13118 · Cited by 7
Zheng, X., Hu, X., Wu, C., Li, Y., & Yang, D. (2025) · Journal of Construction Engineering and Management · doi:10.1061/jcemd4.coeng-15869 · Cited by 7
Effects of Artificial Intelligence on Educational Functioning: A Review and Meta-Analysis
Yeo, G., & Lansford, J. E. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10085-5 · Cited by 16
L2 writing and its internal correlates
Kojima, M., & Kaneta, T. (2022) · Bilingual processing and acquisition · doi:10.1075/bpa.13.05koj · Cited by 7
Sistematik Derleme Metodolojisi ve Yazımı
Cinar, N. D., & Suzan, Ö. K. (2022) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.2053 · Cited by 7
Susanti, E. Y., Mulyanti, R. Y., & Wati, L. N. (2022) · Advances in economics, business and management research/Advances in Economics, Business and Management Research · doi:10.2991/978-94-6463-068-8_4 · Cited by 12
Introduction: A Scoping Review of Second Language Vocabulary Learning in the Wild
Reynolds, B. L. (2023) · Springer eBooks · doi:10.1007/978-981-99-1490-6_1 · Cited by 11
Second-order synthesis of meta-analytic studies in applied linguistics (1998–2021)
Sarab, M. R. A., & Farsani, M. A. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01692-x · Cited by 7
The State of Dyadic Methodology: An Analysis of the Literature on Interventions for Military Couples
Lewis, M. E., Lamson, A. L. S., & White, M. B. (2016) · Journal of Couple & Relationship Therapy · doi:10.1080/15332691.2015.1106998 · Cited by 7
Pemanfaatan Hasil Akreditasi dan Kredibilitas Asesor Sekolah/Madrasah
--, H. (2013) · Jurnal Pendidikan dan Kebudayaan · doi:10.24832/jpnk.v19i4.308 · Cited by 7
Burns, M. K., Taylor, C. N., Brann, K. L., Preast, J. L., Hosp, J. L., & Ford, J. W. (2017) · Psychology in the Schools · doi:10.1002/pits.22022 · Cited by 7
Understanding Teacher Reflectivity in Contemporary Times: A (Re)Review of the Literature
Rigney, J., Ferland, T., & Dana, N. F. (2019) · The New Educator · doi:10.1080/1547688x.2019.1631923 · Cited by 7
Sværke, K., Niemeijer, M., & Løkkegaard, A. (2019) · Journal of Parkinson s Disease · doi:10.3233/jpd-191726 · Cited by 7
Let's collaborate but how: Discussing collaboration barriers and opportunities in the digital era
Rouzbehani, R. (2020) · Canadian Public Administration · doi:10.1111/capa.12397 · Cited by 7
Mobility in a Globalised World 2018
Sucky, E., Obermeier-Hartmann, C., Zitzmann, I., Dobhan, A., Klötzer, C., Ankenbrand, K., Linß, I., Eberhardt, L., Biethahn, N., Tubbesing, F., et al. (2019) · Schriftenreihe Logistik und Supply Chain Management · doi:10.20378/irbo-54827 · Cited by 7
Beltrano, N. R., Archer‐Kuhn, B., & MacKinnon, S. L. (2021) · Teachers and Teaching · doi:10.1080/13540602.2021.1955672 · Cited by 7
Findings of qualitative studies on Understanding by Design: A meta-synthesis
Uluçınar, U. (2021) · Uluslararası Eğitim Programları ve Öğretim Çalışmaları Dergisi · doi:10.31704/ijocis.2021.009 · Cited by 7
Meta-Analysis for Nonprofit Research: Synthesizing Quantitative Evidence for Knowledge Advancement
Hung, C., & Lu, J. (2022) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-022-00505-3 · Cited by 7
Wu, S. (2022) · CALICO Journal · doi:10.1558/cj.23991 · Cited by 9
Two decades of research in Electronic Word of Mouth: a bibliometric analysis
Orejuela, A. R., Andrade, C. F. O., & Muñoz, J. P. (2021) · Revista científica Pensamiento y Gestión · doi:10.14482/pege.48.658.84 · Cited by 11
Schreiber, F., & Cramer, C. (2023) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-023-01140-4 · Cited by 7
Lanzini, P., & Tencati, A. (2023) · Business Ethics the Environment & Responsibility · doi:10.1111/beer.12525 · Cited by 7
Individual and contextual risk factors of prisoners' victimization: A best fit framework synthesis
Goossens, E., Robert, L., & Daems, T. (2023) · Aggression and Violent Behavior · doi:10.1016/j.avb.2023.101826 · Cited by 11
Campus Carry Attitude, Intention, Behavior, and Impact: A Multilevel Meta-analysis
Kim, B. (2023) · Justice quarterly · doi:10.1080/07418825.2023.2197611 · Cited by 6
Knafl, K. A. (2015) · Journal of Family Nursing · doi:10.1177/1074840714568740 · Cited by 7
Leveraging Research Synthesis for Promoting and Expanding Library Services and Educational Programs
Mi, M. (2016) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2015.12.012 · Cited by 7
Escobar, K. M., & Gorey, K. M. (2018) · Journal of Social Service Research · doi:10.1080/01488376.2018.1428923 · Cited by 8
The Concept of Justice in Stakeholder Theory: A Systematic Literature Review
de Melo, V. P., dos Santos, Í. A. T., Jhunior, R. D. O. S., & Uchôa, M. T. (2020) · BASE - Revista de Administração e Contabilidade da Unisinos · doi:10.4013/base.2020.173.03 · Cited by 7
Metadata
- Authors
- Cooper, H.
- Corresponding author
- Cooper, Harris
- ORCID
- Cooper, Harris
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc
- Published
- 2017
- OpenAlex
- W1420162645
- Cited by
- 1,716
- References
- 0
- Citations by year
- 2026: 51 · 2025: 136 · 2024: 176 · 2023: 163 · 2022: 142 · 2021: 167 · 2020: 159 · 2019: 154 · 2018: 97 · 2017: 81
- FWCI
- 57.19
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Sage eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Diverse Academic Research Areas
- Keywords
- evidence synthesis, meta-analysis, literature searching, study quality assessment, evidence integration, threats to validity, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review