Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal
Open accessThe DOI matches its Crossref record; 25 of the 37 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Systematic reviews of research are increasingly recognised as important for informing decisions across policy sectors and for setting priorities for research. Although reviews draw on international research, the host institutions and countries can focus attention on their own priorities. The uneven capacity for conducting research around the world raises questions about the capacity for conducting systematic reviews. METHODS: A rapid appraisal was conducted of current capacity and capacity strengthening activities for conducting systematic reviews in low- and middle-income countries (LMICs). A systems approach to analysis considered the capacity of individuals nested within the larger units of research teams, institutions that fund, support, and/or conduct systematic reviews, and systems that support systematic reviewing internationally. RESULTS: International systematic review networks, and their support organisations, are dominated by members from high-income countries. The largest network comprising a skilled workforce and established centres is the Cochrane Collaboration. Other networks, although smaller, provide support for systematic reviews addressing questions beyond effective clinical practice which require a broader range of methods. Capacity constraints were apparent at the levels of individuals, review teams, organisations, and system wide. Constraints at each level limited the capacity at levels nested within them. Skills training for individuals had limited utility if not allied to opportunities for review teams to practice the skills. Skills development was further constrained by language barriers, lack of support from academic organisations, and the limitations of wider systems for communication and knowledge management. All networks hosted some activities for strengthening the capacities of individuals and teams, although these were usually independent of core academic programmes and traditional career progression. Even rarer were efforts to increase demand for systematic reviews and to strengthen links between producers and potential users of systematic reviews. CONCLUSIONS: Limited capacity for conducting systematic reviews within LMICs presents a major technical and social challenge to advancing their health systems. Effective capacity in LMICs can be spread through investing effort at multiple levels simultaneously, supported by countries (predominantly high-income countries) with established skills and experience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“We previously observed that relevant literature for low- and middle-income countries, such as working and policy papers, is often not included in databases, and is located from organisational websites, contacting authors or internet search engines [3].”
From Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic? (2016) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 2×
“porting technologies and ways of working” [32].”
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063 · cited 1×
“There was a paucity of model examples for incorporating different methodologies required for health systems research or for questions other than about effectiveness (‘what works?’), although this situation has since improved [29].”
MethodSelf-citationBridges, brokers and boundary spanners in collaborative networks: a systematic review
Long, J. C., Cunningham, F. C., & Braithwaite, J. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-158 · Cited by 523 · cited 1×
“Help can come from people spanning organisational and cultural boundaries or knowledge brokers, preferably working in teams [33].”
BackgroundIntroduction to systematic reviews: (657462011-001)
O'Connor, E., Whitlock, E., & Spring, B. (2011) · PsycEXTRA Dataset · doi:10.1037/e657462011-001 · Cited by 463
A framework to evaluate research capacity building in health care
Cooke, J. (2005) · BMC Family Practice · doi:10.1186/1471-2296-6-44 · Cited by 422 · cited 3×
“Dimensions for strengthening capacity for health research [1] and methods for its evaluation [2] have been developed from systematic reviews of research literature and good practice.”
BackgroundMethodSearching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371 · cited 1×
“Despite these difficulties, guidance is available [15].”
Basic Concepts and Techniques of Rapid Appraisal
Beebe, J. (1995) · Human Organization · doi:10.17730/humo.54.1.k84tv883mr2756l3 · Cited by 341 · cited 1×
“It employs a systems perspective, triangulation of data collection, and iterative data collection and analysis [5].”
How Can We Support the Use of Systematic Reviews in Policymaking?
Lavis, J. N. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000141 · Cited by 246 · cited 1×
“It reports a rapid appraisal of LMICs current capacity and efforts to enhance capacity to synthesise the evidence available for policy decisions; evidence not only about assessing policy options, but also about understanding the nature and scale of policy problems and about policy implementation [4], as well as the ap…”
BackgroundImproving the use of research evidence in guideline development: introduction
SURE, Oxman, A. D., Fretheim, A., & Schünemann, H. J. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-12 · Cited by 135
Evaluating Health Research Capacity Building: An Evidence-Based Tool
Bates, I., Osei‐Akoto, A., Ansong, D., Karikari, P., Bedu‐Addo, G., Critchley, J., Agbenyega, T., & Nsiah-Asare, A. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030299 · Cited by 110 · cited 2×
“Dimensions for strengthening capacity for health research [1] and methods for its evaluation [2] have been developed from systematic reviews of research literature and good practice.”
BackgroundMethod
Research works printed but not linked: 2
- Florenzano F, Benitez J, Pantoja T. Identifying methodological challenges in conducting systematic reviews of health policy and systems research: a study case in low- and middle-income countries. Santiago, Chile: Methodology Centre for Systematic Reviews of Health Policy and Systems Research in Low and Middle Income Countries; 2010.
- Cole D, Kakuma R, Fonn S, Izugbara C, Thorogood M, Bates I. Evaluations of health research capacity development: a review of the evidence. Am J Trop Med Hyg. 2012;87(5 Suppl 1):226–305.
Cited by
Stansfield, C., Dickson, K., & Bangpan, M. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0371-9 · Cited by 122
Self-citationRohwer, A., Pfadenhauer, L., Burns, J., Brereton, L., Gerhardus, A., Booth, A., Oortwijn, W., & Rehfuess, E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.06.012 · Cited by 121
“290 Strengthening research capacity in conducting research synthesis is of utmost importance and has 291 been widely advocated as a means of overcoming the paucity of evidence relevant to SSA and other 292 LMICs [3, 5, 7, 63-65].”
BackgroundInfluentialChildhood Sexual Violence in Indonesia: A Systematic Review
Rumble, L., Febrianto, R. F., Larasati, M. N., Hamilton, C., Mathews, B., & Dunne, M. P. (2018) · Trauma Violence & Abuse · doi:10.1177/1524838018767932 · Cited by 134
Medical research productivity in the Arab countries: 2007-2016 bibliometric analysis
Rassi, R. E., Meho, L. I., Nahlawi, A., Salameh, J., Bazarbachi, A., & Akl, E. (2018) · Journal of Global Health · doi:10.7189/jogh.08.020411 · Cited by 69
“Oliver et al. (2015) has proposed conducting capacity building at the levels of individuals, research teams, organizations, and country wide.”
BackgroundAtkins, S. A., Marsden, S., Diwan, V., Zwarenstein, M., & for the ARCADE consortium (2016) · Global Health Action · doi:10.3402/gha.v9.30524 · Cited by 70
“for decision-making, including systematic reviews, which are key to informing policymakers (8).”
Background
Metadata
- Authors
- Oliver, S., Bangpan, M., Stansfield, C., & Stewart, R.
- Affiliations
- University College London (GB)
- University of Johannesburg (ZA)
- Corresponding author
- Oliver, Sandy
- Venue
- Health Research Policy and Systems
- Published
- 2015-04-26
- Volume
- 13
- Issue
- 1
- Pages
- 23-23
- ISSN
- 1478-4505 (ISSN-L)
- PMC
- PMC4443541
- OpenAlex
- W2114178586
- Cited by
- 59
- References
- 37
- Citations by year
- 2026: 7 · 2025: 3 · 2024: 1 · 2023: 10 · 2022: 4 · 2021: 8 · 2020: 4 · 2019: 2 · 2018: 12 · 2017: 3 · 2016: 3 · 2015: 2
- FWCI
- 1.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Health Research Policy and Systems (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- International Development Research Centre
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Global Health and Surgery
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- systematic reviews, research capacity, low- and middle-income countries, capacity building, Cochrane Collaboration, skills training, language barriers, knowledge management, research workforce, evidence-based decision making
- MeSH terms
- Developing Countries, Research, Review Literature as Topic, Access to Information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal. https://app.cochat.ai/papers/10.1186/s12961-015-0012-0
- The paper
- Oliver, S., Bangpan, M., Stansfield, C., & Stewart, R. (2015). Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal. Health Research Policy and Systems. https://doi.org/10.1186/s12961-015-0012-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

