The Benefits and Challenges of Using Systematic Reviews in International Development Research
Abstract
Although first applied in the medical sciences in the 1970s, systematic reviews have been recently, and increasingly, used in the field of international development to examine the impacts of a range of development and humanitarian interventions. However, to date, there has been only limited critical reflection on their application within this field. Drawing on the authors' first-hand experiences of conducting eight systematic reviews, this article reflects upon the use of systematic reviews in international development research. It is concluded that although using systematic review principles can help researchers improve the rigour and breadth of literature reviews, conducting a full systematic review is a resource-intensive process which involves a number of practical challenges. Further, it raises a series of fundamental concerns for those working in international development, as well as the social sciences more broadly. Ultimately, systematic reviews should be viewed as a means to finding a robust and sensible answer to a focused research question, but not as an end in themselves.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adhering to SER methodology can be difficult, particularly when the method is applied to non-biomedical research.
“Adhering to SER methodology can be difficult, particularly when the method is applied to non-biomedical research (Mallett et al., 2012).”
From Sysrev: A FAIR Platform for Data Curation and Systematic Evidence Review (2021) · cites this paper as Mallett et al., 2012
Cites
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,074 · see citing works
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586 · see citing works
Introduction to Systematic Reviews
(2013) · Active Learning Exercises · doi:10.21019/ale.2000.252 · Cited by 1,239 · see citing works
(2003) · Digital Education Resource Archive (University College London) · Cited by 902 · see citing works
Systematic Reviews from Astronomy to Zoology: Myths and Misconceptions
Petticrew, M. (2001) · BMJ · doi:10.1136/bmj.322.7278.98 · Cited by 550 · see citing works
Integrating qualitative research with trials in systematic reviews
Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J. (2004) · BMJ · doi:10.1136/bmj.328.7446.1010 · Cited by 515 · see citing works
(2011) · The University of Bath Online Publications Store (The University of Bath) · Cited by 284 · see citing works
Systematic Reviews of Educational Research: Does the medical model fit?
Evans, J. M., & Benefield, P. (2001) · British Educational Research Journal · doi:10.1080/01411920120095717 · Cited by 233 · see citing works
Qualitative research in systematic reviews
Dixon‐Woods, M., & Fitzpatrick, R. M. (2001) · BMJ · doi:10.1136/bmj.323.7316.765 · Cited by 232 · see citing works
Systematic Research Synthesis to Inform Policy, Practice and Democratic Debate
Gough, D., & Elbourne, D. R. (2002) · Social Policy and Society · doi:10.1017/s147474640200307x · Cited by 161 · see citing works
Best Practice in Systematic Reviews: The Importance of Protocols and Registration
Editors, T. P. M. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001009 · Cited by 160 · see citing works
Application of Systematic Review Methodology to the Field of Nutrition
Lichtenstein, A. H., Yetley, E. A. D., & Lau, J. (2008) · Journal of Nutrition · doi:10.3945/jn.108.097154 · Cited by 139 · see citing works
Combining Campbell Standards and the Realist Evaluation Approach
van der Knaap, L. M., Leeuw, F. L., Bogaerts, S., & Nijssen, L. T. J. (2008) · American Journal of Evaluation · doi:10.1177/1098214007313024 · Cited by 99 · see citing works
Vaessen, J., Rivas, A., Duvendack, M., Jones, R. P., Leeuw, F. L., Gils, G. H. C. V., Lukach, R., Holvoet, N., Bastiaensen, J., Hombrados, J. G., et al. (2014) · Campbell Systematic Reviews · doi:10.4073/csr.2014.8 · Cited by 89 · see citing works
Self-citationSystematic Reviews: What have they got to offer evidence based policy and practice?
Nagyová, I. (2015) · European Journal of Public Health · doi:10.1093/eurpub/ckv173.021 · Cited by 61 · see citing works
Assessing ‘what works’ in international development: meta-analysis for sophisticated dummies
Duvendack, M., Hombrados, J. G., Palmer-Jones, R., & Waddington, H. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.710642 · Cited by 52 · see citing works
Self-citationIntroduction to Systematic Reviews
Goodwin, G. M., & Geddes, J. R. (2004) · Journal of Psychopharmacology · doi:10.1177/0269881104042629 · Cited by 46 · see citing works
High Noon for Microfinance Impact Evaluations: Re-Investigating the Evidence from BangladeshPreprint
Duvendack, M., & Palmer‐Jones, R. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1735615 · Cited by 40 · see citing works
Self-citationDevkar, G. A., Mahalingam, A., Deep, A., et al. (2013) · Utilities Policy · doi:10.1016/j.jup.2013.08.002 · Cited by 30 · see citing works
Systematic Review of the Impact of Employment Guarantee Schemes and Cash Transfers on the Poor
Booker, F., Hagen‐Zanker, J., Holmes, R. L., McCord, A., & Molinari, E. (2011) · Cited by 28 · see citing works
Self-citationHolmes, R. L., McCord, A., Hagen‐Zanker, J., et al. (2013) · Cited by 18 · see citing works
Self-citationSmoke and mirrors : evidence from microfinance impact evaluations in India and Bangladesh
Duvendack, M. (2010) · Cited by 9 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
The ABC of systematic literature review: the basic methodological guidance for beginners
Mohamed Shaffril, H. A., Samsuddin, S. F., & Abu Samah, A. (2021) · Quality & Quantity · doi:10.1007/s11135-020-01059-6 · Cited by 656 · see citing works
Sample Selection in Systematic Literature Reviews of Management Research
Hiebl, M. R. W. (2023) · Organizational Research Methods · doi:10.1177/1094428120986851 · Cited by 635 · see citing works
Skin cancer detection: A review using deep learning techniques
Dildar, M., Akram, S., Irfan, M., Khan, H. U., Ramzan, M., Mahmood, A. R., Alsaiari, S. A., Saeed, A. H. M., Alraddadi, M. O., & Mahnashi, M. H. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18105479 · Cited by 597 · see citing works
Children’s sleep and health: A meta-review
Matricciani, L., Paquet, C., Galland, B., Short, M., & Olds, T. (2019) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2019.04.011 · Cited by 453 · see citing works
Sysrev: A FAIR Platform for Data Curation and Systematic Evidence Review
Bozada, T., Borden, J., Workman, J., Del Cid, M., Malinowski, J., & Luechtefeld, T. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.685298 · Cited by 118 · see citing works
Characteristics of systematic reviews in the social sciences
Chapman, K. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102396 · Cited by 93 · see citing works
Housing Risk Factors Associated with Respiratory Disease: A Systematic Review
Wimalasena, N. N., Chang-Richards, A., Wang, K. I.-K., & Dirks, K. N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18062815 · Cited by 91 · see citing works
Screening articles for systematic reviews with ChatGPT
Syriani, E., David, I., & Kumar, G. (2024) · Journal of Computer Languages · doi:10.1016/j.cola.2024.101287 · Cited by 82 · see citing works
Child Sexual Abuse and the Internet—A Systematic Review
Ali, S., Haykal, H. A., & Youssef, E. Y. M. (2023) · Human Arenas · doi:10.1007/s42087-021-00228-9 · Cited by 77 · see citing works
Mental health literacy intervention on help-seeking in athletes: a systematic review
Bu, D., Chung, P.-K., Zhang, C.-Q., Liu, J., & Wang, X. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17197263 · Cited by 61 · see citing works
Koensgen, N., Rombey, T., Allers, K., Mathes, T., Hoffmann, F., & Pieper, D. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.012 · Cited by 34 · see citing works
Khirfan, L., Mohtat, N., & Peck, M. (2020) · Water Security · doi:10.1016/j.wasec.2020.100067 · Cited by 33 · see citing works
Christopoulou, S., Kotsilieris, T., & Anagnostopoulos, I. (2018) · Healthcare · doi:10.3390/healthcare6030109 · Cited by 20 · see citing works
- Authors
- Mallett, R., Hagen-Zanker, J., Slater, R., & Duvendack, M.
- Affiliations
- Overseas Development Institute (GB)
- Social Protection Programme, Overseas Development Institute
- Venue
- Journal of Development Effectiveness
- Publisher
- Informa UK Limited
- Published
- 2012-09
- Volume
- 4
- Issue
- 3
- Pages
- 445-455
- ISSN
- 1943-9342 (ISSN-L)
- 1943-9407
- OpenAlex
- W1982170224
- Cited by
- 565
- References
- 22
- Citations by year
- 2026: 29 · 2025: 40 · 2024: 67 · 2023: 68 · 2022: 78 · 2021: 83 · 2020: 62 · 2019: 51 · 2018: 36 · 2017: 19 · 2016: 4 · 2015: 10 · 2014: 8 · 2013: 7 · 2012: 3
- FWCI
- 2.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Development Effectiveness (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- systematic reviews, international development research, scientific rigor, humanitarian intervention, development interventions, research methodology challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review