Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go?: Table 1
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Study objective: There is little guidance on how to identify useful evidence about the health effects of social interventions. The aim of this study was to assess the value of different ways of finding this type of information. Design: Retrospective analysis of the sources of studies for one systematic review. Setting: Case study of a systematic review of the effectiveness of interventions in promoting a population shift from using cars towards walking and cycling. Main results: Only four of the 69 relevant studies were found in a “first-line” health database such as Medline. About half of all relevant studies were found through the specialist Transport database. Nine relevant studies were found through purposive internet searches and seven relevant studies were found by chance. The unique contribution of experts was not to identify additional studies, but to provide more information about those already found in the literature. Conclusions: Most of the evidence needed for this review was not found in studies indexed in familiar literature databases. Applying a sensitive search strategy across multiple databases and interfaces is very labour intensive. Retrospective analysis suggests that a more efficient method might have been to search a few key resources, then to ask authors and experts directly for the most robust reports of studies identified. However, internet publications and serendipitous discoveries did make a significant contribution to the total set of relevant evidence. Undertaking a comprehensive search may provide unique evidence and insights that would not be obtained using a more focused search.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Appraising the Evidence: Reviewing Disparate Data Systematically
Hawker, S., Payne, S., Kerr, C., Hardey, M., & Powell, J. (2002) · Qualitative Health Research · doi:10.1177/1049732302238251 · Cited by 1,216
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
McAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812 · cited 1×
“For example, excluding grey literature from meta-analyses of trials has been found to result in an overestimation of effect size by an average of 12%,[ 36 ] but another study has suggested that a comprehensive search strategy may have little effect on the overall result and may introduce bias by including trials of lo…”
Royle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693 · cited 2×
“In practice, the number of databases searched varies widely between reviews; in one sample from the Cochrane library, between one and 27 databases had been searched for each review.[ 29 ] Even in the field of health promotion and public health, a substantial minority of journals are not indexed in a popular biomedical…”
BackgroundInfluentialEvidence, hierarchies, and typologies: horses for courses: Table 1
Petticrew, M., & Roberts, H. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.7.527 · Cited by 539
Self-citationOgilvie, D., Egan, M., Hamilton, V., & Petticrew, M. (2005) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2005.034199 · Cited by 167
Self-citationSearching multiple databases for systematic reviews: added value or diminishing returns?
Stevinson, C., & Lawlor, D. A. (2004) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2004.09.003 · Cited by 143
Cited by
Welch, V., Petticrew, M., Tugwell, P., Moher, D., O'Neill, J., Waters, E., White, H., & the PRISMA-Equity Bellagio group (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001333 · Cited by 704
Self-citationHaddaway, N. R., Grainger, M. J., & Gray, C. T. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1563 · Cited by 604
Cooper, C., Booth, A., Varley-Campbell, J., Britten, N., & Garside, R. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0545-3 · Cited by 561
Booth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 569
Gibson, M., Petticrew, M., Bambra, C., Sowden, A. J., Wright, K. E., & Whitehead, M. (2011) · Health & Place · doi:10.1016/j.healthplace.2010.09.011 · Cited by 539
Self-citation
Metadata
- Authors
- Ogilvie, D., Hamilton, V., Egan, M., & Petticrew, M.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2005-08-12
- Volume
- 59
- Issue
- 9
- Pages
- 804-808
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2134539995
- Cited by
- 120
- References
- 8
- FWCI
- 1.70
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.