CoChat

Real world reviews: a beginner's guide to undertaking systematic reviews of public health policy interventions

Open access
Bambra, C · 2011 · Journal of Epidemiology and Community Health
Cited by 50

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Background: The systematic review is becoming an increasingly popular and established research method in public health. Obtaining systematic review skills are therefore becoming a common requirement for most public health researchers and practitioners. However, most researchers still remain apprehensive about conducting their first systematic review. This is often because an ‘ideal’ type of systematic review is promoted in the methods literature. Methods: This brief guide is intended to help dispel these concerns by providing an accessible overview of a ‘real’ approach to conducting systematic reviews. The guide draws upon an extensive practical experience of conducting various types of systematic reviews of complex social interventions. Results: The paper discusses what a systematic review is and how definitions vary. It describes the stages of a review in simple terms. It then draws on case study reviews to reflect on five key practical aspects of the conduct of the method, outlining debates and potential ways to make the method shorter and smarter—enhancing the speed of production of systematic reviews and reducing labour intensity while still maintaining high methodological standards. Conclusion: There are clear advantages in conducting the high quality pragmatic reviews that this guide has described: (1) time and labour resources are saved; (2) it enables reviewers to inform or respond to developments in policy and practice in a timelier manner; and (3) it encourages researchers to conduct systematic reviews before embarking on primary research. Well-conducted systematic reviews remain a valuable part of the public health methodological tool box.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/jech.2009.088740

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 24

  1. Solesbury, 2002, The ascendancy of evidence, Plann Theory Practice, 3, 90, 10.1080/14649350220117834 · DOI
  2. Klein, 2000, From evidence based medicine to evidence based policy?, J Health Serv Res Policy, 5, 65, 10.1177/135581960000500201 · DOI
  3. Davies H Nutley S Smith P . What works? Evidence-based policy and practice in public services. Bristol: Policy Press, 2000. · DOI · Paper page
  4. Higgins JP Green S . Cochrane handbook for systematic reviews of interventions. Cambridge: Wiley Blackwell, 2008. · DOI · Paper page
  5. Egger M Davey Smith G Altman D , eds. Systematic reviews in health care: meta-analysis in context. Cambridge: Wiley Blackwell, 2001. · DOI · Paper page
  6. 10.1016/j.socscimed.2004.09.002 · DOI · Paper page
  7. 10.1136/jech.2006.054965 · DOI · Paper page
  8. 10.1136/jech.2006.054999 · DOI · Paper page
  9. 10.1016/j.amepre.2007.12.023 · DOI
  10. 10.1136/jech.2007.067249 · DOI · Paper page
  11. Smith KE Bambra C Joyce KE . Partners in health? A systematic review of the effects on health and health inequalities of partnership working. J Public Health 2009;210–21. · DOI · Paper page
  12. Bambra, 2005, Reviewing the evidence: reflections from experience, Evidence Policy – Journal, 1, 241
  13. Egan, 2009, Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions, J Epidemiol Community Health, 61, 4, 10.1136/jech.2007.071233 · DOI · Paper page
  14. Oakley A Fullerton D . ‘The lamp-post of research: support or illumination’? In: Oakley A Roberts H , eds. Evaluating social interventions: a report of two workshops funded by the Economic and Social Research Council. Ilford: Barnardos, 1998:4–38.
  15. 10.1016/j.ypmed.2008.12.018 · DOI
  16. 10.1136/jech.57.5.327 · DOI · Paper page
  17. 10.1186/1471-2458-8-178 · DOI · Paper page
  18. 10.1016/S0749-3797(00)00137-9 · DOI
  19. 10.1136/bmj.322.7280.204 · DOI · Paper page
  20. 10.1136/ip.9.3.200 · DOI · Paper page
  21. 10.1136/bmj.38216.714560.55 · DOI · Paper page
  22. Egan, 2003, New roads and human health: a systematic review, Am J Public Health, 93, 1463, 10.2105/AJPH.93.9.1463 · DOI · Paper page
  23. 10.1136/jech.2005.034181 · DOI · Paper page
  24. Petticrew, 2003, Why certain systematic reviews reach uncertain conclusions, BMJ, 7392, 756, 10.1136/bmj.326.7392.756 · DOI · Paper page

Cited by

Metadata

Authors
Bambra, C.
Venue
Journal of Epidemiology and Community Health
Publisher
BMJ
Published
2009-08-25
Volume
65
Issue
1
Pages
14-19
ISSN
  • 0141-7681 (ISSN-L)
  • 0143-005X
  • 1470-2738
OpenAlex
W2142019074
Cited by
50
References
8
FWCI
0.23
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.