Viewing systematic reviews and meta-analysis in social research through different lenses
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
Systematic reviews and meta-analyses are used to combine results across studies to determine an overall effect. Meta-analysis is especially useful for combining evidence to inform social policy, but meta-analyses of applied social science research may encounter practical issues arising from the nature of the research domain. The current paper identifies potential resolutions to four issues that may be encountered in systematic reviews and meta-analyses in social research. The four issues are: scoping and targeting research questions appropriate for meta-analysis; selecting eligibility criteria where primary studies vary in research design and choice of outcome measures; dealing with inconsistent reporting in primary studies; and identifying sources of heterogeneity with multiple confounded moderators. The paper presents an overview of each issue with a review of potential resolutions, identified from similar issues encountered in meta-analysis in medical and biological sciences. The discussion aims to share and improve methodology in systematic reviews and meta-analysis by promoting cross-disciplinary communication, that is, to encourage ‘viewing through different lenses’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
(2002) · Cited by 13,211
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 10,854 · cited 1×
“ance (Durlak et al. 2011), for example.”
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
(2000) · Cited by 9,198
Research works printed but not linked: 6
- Becker BJ Hedges LV Pigott TD Statistical Analysis Policy Brief Prepared for the Campbell Collaboration Steering Committee 2004
- Hall PA Neighborhood Watch and Participant Perceptions (Unpublished doctoral dissertation) 1987 California University of Southern California
- Higgins JPT Green S Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration 2011
- Shadish WR Myers D Research Design Policy Brief for the Campbell Collaboration Steering Committee 2004
- Sherman LW Strang H Barnes GC Braithwaite J Inkpen N Teh M Experiments in restorative policing: A progress report on the Canberra Reintegrative Shaming Experiments (RISE) 1998 Canberra, Australia Australian Federal Police and Australian National University
- Skogan WG Steiner L CAPS at Ten: An Evaluation of Chicago’s Alternative Policing Strategy 2004 Chicago, IL Illinois Criminal Justice Information Authority
Cited by
Items 301–361 of 361
Use and Application of Symbolic Solar Lighting in Mayan and Inca Architecture: A Literary Review
Guzmán, J. R. L., & Villacis-Ormaza, M. (2022) · Lecture notes in civil engineering · doi:10.1007/978-981-16-6932-3_48
Synthesis of data from trials of interventions designed to change health behaviour; a case studyPreprint
Rhodes, S., Dias, S., Wilkinson, J., & Cotterill, S. (2021) · doi:10.22541/au.163256037.77153698/v1
Literature Review Research Design
Hunziker, S., & Blankenagel, M. (2024) · Springer eBooks · doi:10.1007/978-3-658-42739-9_13
The Effect of Covid-19 on the Teaching and Learning Process of Entrepreneurship Education
Ntimbwa, M. C., & Ryakitimbo, C. M. (2023) · Springer eBooks · doi:10.1007/978-3-031-25998-2_74
Ryakitimbo, C. M., Mrutu, L., & Minja, M. D. (2023) · Asian Research Journal of Arts & Social Sciences · doi:10.9734/arjass/2023/v19i3426
Владимирович, Д. В. (2023) · Regional Economics Theory and Practice · doi:10.24891/re.21.3.406
Kierunki badań nad kontraktem psychologicznym – systematyczny przegląd literatury
Bera, A. (2023) · Krakow Review of Economics and Management/Zeszyty Naukowe Uniwersytetu Ekonomicznego w Krakowie · doi:10.15678/znuek.2022.0998.0407
USING THE GAME APPROACHES FOR DEVELOPING THE SPEECH OF CHILDREN WITH MODERATE MENTAL RETARDATION
Saratikyan, L. (2023) · Armenian Journal of Special Education · doi:10.24234/se.v6i1.308
Overview of Social Media and Africa’s Public Sector
Adae, E. K., Twum, K. K., Hinson, R. E., Duh, H. I., & Odame, D. A. (2023) · Palgrave studies of public sector management in Africa · doi:10.1007/978-3-031-22642-7_1
Şimşek, N., Güler, O., & HASEKİ, M. İ. (2023) · Journal of Tourism and Gastronomy Studies · doi:10.21325/jotags.2023.1261
The Impact of Using Technology Integration on Supply Chain Functions and Stages
Ezmigna, I., & Omain, S. Z. (2023) · Studies in systems, decision and control · doi:10.1007/978-3-031-28314-7_81
Evaluation of MCP anticancer activity using molecular imaging
da Silva, F. F. A. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.85.2023.tde-24082023-114509
The Evolution of Health Workers as A Motivating Factor Towards the Administrations of Health Units
(2023) · Journal of System and Management Sciences · doi:10.33168/jsms.2023.0439
de Medina, C. R. B. L. (2023) · Revista del Museo de Antropología · doi:10.31048/1852.4826.v16.n2.41246
Managing smart grids – Experiences from Hungary
Piricz, N. (2023) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti59972.2023.10382100
Technologies in Sustainable Supply Chain: Insights from a Systematic Literature Review
Siju, N. M., & Shivdas, A. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-351220240000036027
Twenty Years of IFRS 'Success'? A Systematic Review of Scopus LiteraturePreprint
Pirveli, E., & Zimmermann, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4699908
Albino, L. A. M., Rocha, S. O., Martines, G. B., Dell’Agli, B. A. V., & Caetano, L. M. (2024) · Contribuciones a las Ciencias Sociales · doi:10.55905/revconv.17n.1-393
Gracia, J. A. B. D., Novoa, J. A., Gallegos-Romero, E., & Villegas-Rugel, J. (2024) · Scientia Agropecuaria · doi:10.17268/sci.agropecu.2024.002
“The works of Baumeister & Leary (1997), Davis et al. (2014), and Pillai (2020), both in theory and practice, assert that literature review is a versatile social research method applicable across diverse scientific disciplines.”
BackgroundHiatt, B. J. (2023) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2257697
A zöld ellátási láncok aktuális kérdései : Kritikai szakirodalmi összefoglalás
Piricz, N. (2024) · Soproni Egyetem Kiadó eBooks · doi:10.35511/978-963-334-499-6-piricz
Overcome COVID-19 through Collaboration between Components in Indonesia
Aprina, F. (2024) · KnE Social Sciences · doi:10.18502/kss.v9i18.16325
“Meta-analysis is a statistical method that combines the results of different studies to weigh, compare and identify patterns, inequalities, or association relationships that emerge in a study with the same context and research topic [9].”
MethodSilva, L. E. N. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.12.2024.tde-29042024-150923
Santos, E. H., & Cardoso, J. R. (2024) · Muscles Ligaments and Tendons Journal · doi:10.32098/mltj.02.2024.01
Beyond blood ties: Constructing the meaning of ‘family’ among Spanish children in foster care
Ie, J. (2024) · UVaDOC UVaDOC University of Valladolid Documentary Repository (University of Valladolid) · doi:10.35376/10324/68360
Literaturüberprüfungs-Forschungsdesign
Hunziker, S., & Blankenagel, M. (2024) · Springer eBooks · doi:10.1007/978-3-658-44859-2_13
A 40-Year Systematic Literature Review: About Researches of Duan Yucai’s Study of the Book of Songs
Qianqian, Z., & Hiong, S. W. (2024) · International Journal of Religion · doi:10.61707/052kjq91
“Researchers regard systematic literature reviews as the gold standard among review methods because of their systematic, transparent, and reproducible nature (Davis et al., 2014).”
BackgroundAzman, A. B., Majid, M. A. A., & Zulkifly, M. I. (2024) · Practice, progress, and proficiency in sustainability · doi:10.4018/979-8-3693-7989-9.ch017
Using Moluccas Ornament in Church Interior Aesthetics
Maspaitella, E. I., & Wardhana, M. (2024) · KnE Social Sciences · doi:10.18502/kss.v9i32.17452
22. SEXUAL PROBLEMS AMONG OLDER ADULTS IN ASIA AND AFRICA: A REVIEW
Hanh, N. T., & Ogunyomi, S. (2024) · Tạp chí Y học Cộng đồng · doi:10.52163/yhc.v65i13.1805
The Impact of Intercultural Perspectives on Environmental Ethics
Molotokienė, E. (2025) · E3S Web of Conferences · doi:10.1051/e3sconf/202560804002
Digital Marketing Strategies in Sustainable Tourism
Correia, P. Á. P. (2025) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/979-8-3693-5395-0.ch004
E-Öğrenme Ortamlarında Öz Düzenleme Destekleri Üzerine Sistematik Derleme Çalışması
İpek, M., & Gök, B. (2025) · Journal of Computer and Education Research · doi:10.18009/jcer.1599427
Supply Chain Management of Renewable Energy: Current Practices and Future Research Directions
Tiara, A. R., Tjahjono, B., Beltran, M., Riyanti, W., & Siregar, G. S. (2024) · IEEE Technology & Engineering Management Conference - Asia Pacific (TEMSCON-ASPAC) · doi:10.1109/temscon-aspac62480.2024.11024902 · Cited by 1
“A systematic literature review (SLR) was performed to thoroughly investigate various implementations of SCM in RE by synthesizing existing empirical evidence [20], [21].”
Ritter, D., Rohringer, C., Afshari, A., Chicote, M. A., Hernández-Cruz, P., Dünzen, K., Bauknecht, D., & Attia, S. (2026) · Energy Informatics · doi:10.1186/s42162-026-00673-2 · Cited by 2
“Complementing the empirical component, a systematic literature review [54, 55] was conducted to map the existing body of literature on non-technical barriers for decentralised flexibility and TABS.”
Zhu, T., & Ali, S. I. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0923-1.ch002
Linden, A., Ulvenblad, P., & Barth, H. (2025) · Journal of Forest Business Research · doi:10.62320/jfbr.v4i2.73
Hidden champions: Through a retrospective systematic literature review
Arougay, S., & Mabrouki, M. N. E. (2025) · Multidisciplinary Reviews · doi:10.31893/multirev.2026123
Twenty years of IFRS ‘success’? A systematic review of Scopus literature
Pirveli, E., & Zimmermann, J. (2025) · Journal of International Accounting Auditing and Taxation · doi:10.1016/j.intaccaudtax.2025.100739 · Cited by 3
Sustainable human resource management: a review of three decades of research
Leal, Y. L. R., Madero, S., & Olivas‐Luján, M. R. (2025) · Management Research The Journal of the Iberoamerican Academy of Management · doi:10.1108/mrjiam-11-2024-1634 · Cited by 3
How to seek help? A systematic literature review of help-seeking practices in organizations
Pagnozzi, F., & Antonelli, G. (2025) · Management Review Quarterly · doi:10.1007/s11301-025-00570-0 · Cited by 1
Singh, A. R., Karattuthodi, S., Thirumurugan, V., Joshi, N., Ramesh, C., & Prabakaran, N. (2025) · Biodiversity and Conservation · doi:10.1007/s10531-025-03227-2 · Cited by 1
“…to systematically select studies, extract relevant secondary data, and apply statistical techniques (quantitative) to generate a narrative review (qualitative) of the literature related to the research topic (Liberati et al. 2009 ; Gurevitch et al. 2018; Davis et al. 2014 ; Nakagawa et al. 2019 ).”
A Systematic Review of the Western Indian Ocean Mangrove Research Efforts
Oteke, R. A., Liwenga, E. T., & Alavaisha, E. (2025) · International Journal of Forestry Research · doi:10.1155/ijfr/6703734
مراجعة الأدب في مجال العلوم الإدارية والمالية: دليل مقترح للبحاث الجدد
الحصادي, س. س., & زاقوب, ع. ع. (2025) · دراسات في الاقتصاد والتجارة · doi:10.37376/deb.v43i2.7456
The gender gap in personal financial planning: A Systematic Literature review using the ADO model
Choudhary, N., & Sharma, U. (2026) · SN Business & Economics · doi:10.1007/s43546-025-01030-3 · Cited by 1
Peer-to-Peer Lending: A Review of the Literature and Future Research Agenda
Khan, S., Singh, R., & Paul, J. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2754-586520260000005001
Ezedigbo, C. (2026) · 3 INTERNATIONAL RESEARCH JOURNAL OF MULTIDISCIPLINARY-PRACTICES PUBLIC AND COMMUNITY HEALTH · doi:10.66001/nyrm1929
Post-COVID-19 restaurant consumer behavior – insights and future research directions
Sujood, Yadav, P., Choudhary, B., & Chowdhary, N. R. (2026) · Journal of Hospitality and Tourism Horizons · doi:10.1108/jhth-09-2025-0124 · Cited by 2
Mičík, M., & Eger, L. (2026) · Eastern European Economics · doi:10.1080/00128775.2026.2642909
Process research in entrepreneurial ecosystems: Reviewing the past and preparing the futurePreprint
Toepler, F., Theodoraki, C., & Velamuri, V. K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6467492
Magnagna, U. D. (2023) · theses.fr (ABES) · doi:10.70675/ff252fddz5de5z4450zaaa4zffa51ab0af74 · Cited by 1
Auffret, M. (2023) · theses.fr (ABES) · doi:10.70675/44c65190zd60cz491dzb41ez6a2d332d3a80
Exploring the Links Between Ageism and Career Outcomes: A Systematic Review
Yu, Y., Beigi, M., & Parry, J. (2026) · Human Resource Development Review · doi:10.1177/15344843261451382
AI storytelling across media: synthetic agency and the force vectors of narrative world-making
Sánchez-López, I., Castells, A. G., & Roig, A. (2026) · Frontiers in Communication · doi:10.3389/fcomm.2026.1821118 · Cited by 6
Stein, V., Merino-Benítez, T., Weiser, A., & Lang, D. J. (2026) · Scientometrics · doi:10.1007/s11192-026-05757-0
“…conducting literature reviews already exist as well as different approaches, such as meta-narrative, integrative, critical, systematic reviews or mixed studies (Callahan, 2014; Davis et al., 2014; Jesson & Lacey, 2006; Liberati et al., 2009; Moher et al., 2009; Snyder, 2019; Wee & Banister, 2016).”
Kumar, A., Melese, E., & Kashyap, A. K. (2026) · Journal of Trade Science · doi:10.1108/jts-01-2026-0005
Edge Intelligence in Healthcare: A Systematic Literature Review
Marques, S., & dos Reis, J. C. G. (2026) · Springer proceedings in business and economics · doi:10.1007/978-3-032-29260-5_3
Evaluating Sustainable Transportation Planning in Peri-Urban Areas: Lessons for Indian Smart Cities
Verma, A. A., & Prasad, P. (2025) · Conference of Transportation Research Group of India (CTRG) · doi:10.1109/ctrg67840.2025.11725429
Metadata
- Authors
- Davis, J., Mengersen, K., Bennett, S., & Mazerolle, L.
- Affiliations
- The University of Queensland (AU)
- Queensland University of Technology (AU)
- Corresponding author
- Mengersen, Kerrie
- Venue
- SpringerPlus
- Published
- 2014-09-10
- Volume
- 3
- Issue
- 1
- Pages
- 511-511
- ISSN
- 2193-1801 (ISSN-L)
- PMC
- PMC4167883
- OpenAlex
- W2136868285
- Cited by
- 364
- References
- 59
- Citations by year
- 2026: 22 · 2025: 59 · 2024: 80 · 2023: 74 · 2022: 56 · 2021: 27 · 2020: 23 · 2019: 6 · 2018: 7 · 2017: 6 · 2016: 3 · 2015: 1
- FWCI
- 0.92
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- SpringerPlus (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion, cc-by)
- VU Research Portal (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Science & Engineering Faculty
- Funders
- George Mason University
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
- Keywords
- systematic reviews, meta-analysis, social research, eligibility criteria, reporting inconsistency, heterogeneity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

