The DOI matches its Crossref record.
Systematic Reviews and Meta-Analysis
Abstract
This book aims to make familiar current methods and standards for research synthesis. It describes systematic reviews and meta-analyses, with numerous examples relevant to social work practice and policy. Systematic reviews and meta-analysis can overcome important limitations that are inherent in traditional, narrative summaries of research. The process of conducting a systematic review is described. The book is organized according to the steps involved in conducting a meta-analysis within a systematic review.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Documentation of the search process “makes the search replicable and provides a clear starting point for later updates.”8”
In the citing paper
“Ideally, the difference between pre-intervention and post-intervention data for each group should be used in a meta-analysis [47].”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [47]
Citations
Cited by
Sorted by citations
Gusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379
“” 8 Building a systematic review team that incorporates diverse expertise in areas such as content, systematic review methods, searching, and quantitative synthesis has been shown to significantly improve the quality of the review work.”
BackgroundHall, W. J., Chapman, M. V., Lee, K. M., Merino, Y. M., Thomas, T. W., Payne, B. K., Eng, E., Day, S. H., & Coyne-Beasley, T. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302903 · Cited by 2,176
Pharmacologic management of neuropathic pain: Evidence-based recommendations
Dworkin, R. H., O’Connor, A. B., Backonja, M., Farrar, J. T., Finnerup, N. B., Jensen, T. S., Kalso, E. A., Loeser, J. D., Miaskowski, C., Nurmikko, T. J., et al. (2007) · Pain · doi:10.1016/j.pain.2007.08.033 · Cited by 2,126
How Many Studies Do You Need?: A Primer on Statistical Power for Meta-Analysis
Valentine, J. C., Pigott, T. D., & Rothstein, H. R. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998609346961 · Cited by 1,294
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130
Review articles: purpose, process, and structure
Palmatier, R. W., Houston, M. B., & Hulland, J. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0563-4 · Cited by 1,051
The effectiveness of corrective feedback in SLA: A meta-analysis
Li, S. (2010) · Language Learning · doi:10.1111/j.1467-9922.2010.00561.x · Cited by 941
The effect of loneliness on depression: A meta-analysis
Erzen, E., & Çikrikci, Ö. (2018) · International Journal of Social Psychiatry · doi:10.1177/0020764018776349 · Cited by 838
Cairns, G., Angus, K., Hastings, G., & Caraher, M. (2013) · Appetite · doi:10.1016/j.appet.2012.04.017 · Cited by 680
Tricco, A. C., Ivers, N. M., Grimshaw, J. M., Moher, D., Turner, L., Galipeau, J., Halperin, I., Vachon, B., Ramsay, T., Manns, B., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60480-2 · Cited by 652
Single-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503
A meta-analytic review of the effect of implementation intentions on physical activity
Bélanger-Gravel, A., Godin, G., & Amireault, S. (2013) · Health Psychology Review · doi:10.1080/17437199.2011.560095 · Cited by 413
Gaffney, H., Farrington, D. P., Espelage, D. L., & Ttofi, M. M. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.07.002 · Cited by 363
Viewing systematic reviews and meta-analysis in social research through different lenses
Davis, J., Mengersen, K., Bennett, S., & Mazerolle, L. (2014) · SpringerPlus · doi:10.1186/2193-1801-3-511 · Cited by 364
Teachers' Perceptions of Technology Integration in Teaching-Learning Practices: A Systematic Review
Akram, H., Abdelrady, A. H., Al-Adwan, A. S., & Ramzan, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.920317 · Cited by 358
“By considering the fact that a literature review entails an organized and invariable approach (Littell et al., 2008), the researcher followed all the tactics of the method.”
MethodMorioka, S. N., & de Carvalho, M. M. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.01.104 · Cited by 347
Biological invasions: a field synopsis, systematic review, and database of the literature
Lowry, E., Rollinson, E. J., Laybourn, A. J., Scott, T. E., Aiello‐Lammens, M. E., Gray, S. M., Mickley, J., & Gurevitch, J. (2013) · Ecology and Evolution · doi:10.1002/ece3.431 · Cited by 332
Cugelman, B., Thelwall, M., & Dawes, P. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1367 · Cited by 323
Interventions to Reduce the Consequences of Stress in Physicians: A Review and Meta-Analysis
Regehr, C., Glancy, D., Pitts, A., & LeBlanc, V. R. (2014) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000130 · Cited by 310
Gaffney, H., Ttofi, M. M., & Farrington, D. P. (2021) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1143 · Cited by 313
Dealing with effect size multiplicity in systematic reviews and meta‐analyses
López‐López, J. A., Page, M. J., Lipsey, M. W., & Higgins, J. P. T. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1310 · Cited by 294
Ageism and Psychological Well-Being Among Older Adults: A Systematic Review
Kang, H., & Kim, H. (2022) · Gerontology and Geriatric Medicine · doi:10.1177/23337214221087023 · Cited by 305
Meta-Analysis and Systematic Review Assessing the Efficacy of Dialectical Behavior Therapy (DBT)
Panos, P. T., Jackson, J. W., Hasan, O., & Panos, A. (2014) · Research on Social Work Practice · doi:10.1177/1049731513503047 · Cited by 299
A meta-analysis of the UTAUT model: Eleven years later
Khechine, H., Lakhal, S., & Ndjambou, P. (2016) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l'Administration · doi:10.1002/cjas.1381 · Cited by 246
A Guide to Conducting a Meta-Analysis
Cheung, M. W.-L., & Vijayakumar, R. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9319-z · Cited by 239
Hall, W. J. (2018) · Journal of Homosexuality · doi:10.1080/00918369.2017.1317467 · Cited by 238
Meta-analysis in Second Language Research: Choices and Challenges
Oswald, F. L., & Plonsky, L. (2010) · Annual Review of Applied Linguistics · doi:10.1017/s0267190510000115 · Cited by 237
Cary, C. E., & McMillen, J. C. (2012) · Children and Youth Services Review · doi:10.1016/j.childyouth.2012.01.003 · Cited by 231
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Characterization of rodent models of HIV-gp120 and anti-retroviral-associated neuropathic pain
Wallace, V. C. J., Blackbeard, J., Segerdahl, A. R., Hasnie, F., Pheby, T., McMahon, S. B., & Rice, A. S. C. (2007) · Brain · doi:10.1093/brain/awm195 · Cited by 176
A meta-analysis of adventure therapy outcomes and moderators
Bowen, D. J., & Neill, J. T. (2013) · The Open Psychology Journal · doi:10.2174/1874350120130802001 · Cited by 179
Strengthening the research base that informs STEM instructional improvement efforts: A meta-analysis
Lynch, K., Hill, H. C., Gonzalez, K. E., & Pollard, C. (2019) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373719849044 · Cited by 160
Pantelic, M., Steinert, J. I., Park, J., Mellors, S., & Murau, F. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001285 · Cited by 156
Does student agency benefit student learning? A systematic review of higher education research
Stenalt, M. H., & Lassesen, B. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.1967874 · Cited by 148
Kremer, K. P., Maynard, B. R., Polanin, J. R., Vaughn, M. G., & Sarteschi, C. M. (2015) · Journal of Youth and Adolescence · doi:10.1007/s10964-014-0226-4 · Cited by 132
Kelley, G. A., Kelley, K. S., Roberts, S., & Haskell, W. (2012) · Clinical Nutrition · doi:10.1016/j.clnu.2011.11.011 · Cited by 125
Shintani, N., Li, S., & Ellis, R. (2013) · Language Learning · doi:10.1111/lang.12001 · Cited by 117
Naclerio, F., & Larumbe-Zabala, E. (2016) · Sports Medicine · doi:10.1007/s40279-015-0403-y · Cited by 106
Bushman, B. J., Rothstein, H. R., & Anderson, C. A. (2010) · Psychological Bulletin · doi:10.1037/a0018718 · Cited by 104
The effects of online education on academic success: A meta-analysis study
Ulum, H. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10740-8 · Cited by 96
Meta-analytic insights into evolutionary ecology: an introduction and synthesis
Nakagawa, S., & Poulin, R. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9593-z · Cited by 77
Almeida, M., Ramos, C., Maciel, L., Basto-Pereira, M., & Leal, I. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.995981 · Cited by 81
Rowe, H. L., & Trickett, E. J. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9425-3 · Cited by 79
Safe landing strategies during a fall: Systematic review and meta-analysis
Moon, Y., & Sosnoff, J. J. (2017) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2016.08.460 · Cited by 79
Systematic reviews in political science: What can the approach contribute to political research?
Dacombe, R. (2018) · Political Studies Review · doi:10.1177/1478929916680641 · Cited by 75
Meta-Analysis of Complex Interventions
Tanner-Smith, E. E., & Grant, S. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014112 · Cited by 62
Tutal, Ö., & Yazar, T. (2021) · Asia Pacific Education Review · doi:10.1007/s12564-021-09706-9 · Cited by 57
Cho, M.-K., & Kim, M. Y. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312750 · Cited by 57
Animal-assisted Psychotherapy and Trauma: A Meta-analysis
Germain, S. M., Wilkie, K. D., Milbourne, V. M. K., & Theule, J. (2018) · Anthrozoös · doi:10.1080/08927936.2018.1434044 · Cited by 49
The Impact of ChatGPT on Students' Academic Achievement: A Meta‐Analysis
Liu, Z., Zuo, H., & Lu, Y. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70096 · Cited by 44
Kong, S.-Y., & Cho, M.-K. (2024) · Healthcare · doi:10.3390/healthcare12050571 · Cited by 36
Jackson, K. F., Hodge, D. R., & Vaughn, M. G. (2010) · Journal of Social Service Research · doi:10.1080/01488371003697780 · Cited by 30
Examining the cultural context of youth mentoring: A systematic review
Farruggia, S. P., Bullen, P., Solomon, F., Collins, E., & Dunphy, A. (2011) · The Journal of Primary Prevention · doi:10.1007/s10935-011-0258-4 · Cited by 25
Lanier, P., Jensen, T., Bryant, K., Chung, G., Rose, R., Smith, Q., & Lackmann, L. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.104951 · Cited by 20
Methodological quality is underrated in systematic reviews and meta-analyses in health psychology
Oliveras, I., Losilla, J.-M., & Vives, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.002 · Cited by 15
Littell, J. H., & Shlonsky, A. (2011) · Clinical Social Work Journal · doi:10.1007/s10615-010-0308-z · Cited by 13
Self-citationBaan Wahh, W., Wong Sek Khin, E., & Abdullah, M. (2020) · Asian Journal of Accounting Perspectives · doi:10.22452/ajap.vol13no2.2 · Cited by 7
Metadata
- Authors
- Littell, J. H., Corcoran, J., & Pillai, V.
- Affiliations
- Bryn Mawr College (US)
- Virginia Commonwealth University (US)
- Venue
- Oxford University Press eBooks
- Publisher
- Oxford University Press
- Published
- 2008-03-13
- OpenAlex
- W1532814563
- Cited by
- 1,293
- References
- 0
- Citations by year
- 2026: 42 · 2025: 66 · 2024: 88 · 2023: 106 · 2022: 83 · 2021: 127 · 2020: 110 · 2019: 82 · 2018: 72 · 2017: 73 · 2016: 73 · 2015: 52 · 2014: 66 · 2013: 63 · 2012: 69
- FWCI
- 3.39
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Oxford University Press eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- systematic reviews, meta-analysis, evidence synthesis, social work practice, social policy, evidence-based practice, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review