The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
The Use of Research Evidence in Public Health Decision Making Processes: Systematic Review
Open accessAbstract
BACKGROUND: The use of research evidence to underpin public health policy is strongly promoted. However, its implementation has not been straightforward. The objectives of this systematic review were to synthesise empirical evidence on the use of research evidence by public health decision makers in settings with universal health care systems. METHODS: To locate eligible studies, 13 bibliographic databases were screened, organisational websites were scanned, key informants were contacted and bibliographies of included studies were scrutinised. Two reviewers independently assessed studies for inclusion, extracted data and assessed methodological quality. Data were synthesised as a narrative review. FINDINGS: 18 studies were included: 15 qualitative studies, and three surveys. Their methodological quality was mixed. They were set in a range of country and decision making settings. Study participants included 1063 public health decision makers, 72 researchers, and 174 with overlapping roles. Decision making processes varied widely between settings, and were viewed differently by key players. A range of research evidence was accessed. However, there was no reliable evidence on the extent of its use. Its impact was often indirect, competing with other influences. Barriers to the use of research evidence included: decision makers' perceptions of research evidence; the gulf between researchers and decision makers; the culture of decision making; competing influences on decision making; and practical constraints. Suggested (but largely untested) ways of overcoming these barriers included: research targeted at the needs of decision makers; research clearly highlighting key messages; and capacity building. There was little evidence on the role of research evidence in decision making to reduce inequalities. CONCLUSIONS: To more effectively implement research informed public health policy, action is required by decision makers and researchers to address the barriers identified in this systematic review. There is an urgent need for evidence to support the use of research evidence to inform public health decision making to reduce inequalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742
Qualitative Research in Health Care
(2006) · Wiley eBooks · doi:10.1002/9780470750841 · Cited by 2,712
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
Guidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 1,363
Rigor or rigor mortis: The problem of rigor in qualitative research revisited
Sandelowski, M. (1993) · Advances in Nursing Science · doi:10.1097/00012272-199312000-00002 · Cited by 1,299
The utilisation of health research in policy-making: concepts, examples and methods of assessment
Hanney, S. R., Gonzalez-Block, M. A., Buxton, M. J., & Kogan, M. (2003) · Health Research Policy and Systems · doi:10.1186/1478-4505-1-2 · Cited by 678
Towards systematic reviews that inform health care management and policy-making
Lavis, J., Davies, H., Oxman, A., Denis, J.-L., Golden-Biddle, K., & Ferlie, E. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308549 · Cited by 589
Evidence based policy: proceed with careCommentary: research must be taken seriously
Black, N., & Donald, A. (2001) · BMJ · doi:10.1136/bmj.323.7307.275 · Cited by 588
Pathways to “Evidence-Informed” Policy and Practice: A Framework for Action
Bowen, S., & Zwi, A. B. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020166 · Cited by 539
Evidence-based health policy: context and utilisation
Dobrow, M. J., Goel, V., & Upshur, R. E. G. (2004) · Social Science & Medicine · doi:10.1016/s0277-9536(03)00166-7 · Cited by 476
Health policy: an introduction to process and power
(1995) · Choice Reviews Online · doi:10.5860/choice.32-3542 · Cited by 470
Evidence for public health policy on inequalities: 1: The reality according to policymakers
Petticrew, M., Whitehead, M., Macintyre, S. J., Graham, H., & Egan, M. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.015289 · Cited by 380
Methodolatry and Qualitative Health Research
Chamberlain, K. (2000) · Journal of Health Psychology · doi:10.1177/135910530000500306 · Cited by 257 · cited 1×
“Despite arguments for and against the usefulness and replicability of tools for qualitative studies [40,43–46], most disagreements between reviewers were found to occur when methodological details were unclear rather than as a result of opposing judgements.”
ResultHow and why do interventions that increase health overall widen inequalities within populations?
White, M., Adams, J., & Heywood, P. (2009) · Social inequality and public health · doi:10.1332/policypress/9781847423207.003.0005 · Cited by 249
Health Policy: An Introduction to Process and Power
Feingold, E., & Walt, G. (1995) · Journal of Public Health Policy · doi:10.2307/3342629 · Cited by 246
Evidence for public health policy on inequalities: 2: Assembling the evidence jigsaw
Whitehead, M., Petticrew, M., Graham, H., Macintyre, S. J., Bambra, C., & Egan, M. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.015297 · Cited by 235
Qualitative research in systematic reviews: Has established a place for itself
Dixon-Woods, M., & Fitzpatrick, R. (2001) · BMJ · doi:10.1136/bmj.323.7316.765 · Cited by 231
Elliott, H., & Popay, J. (2000) · Journal of Epidemiology and Community Health · doi:10.1136/jech.54.6.461 · Cited by 230
Chalmers, I. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716203254762 · Cited by 229
Using evidence to inform health policy: case study
Macintyre, S. (2001) · BMJ · doi:10.1136/bmj.322.7280.222 · Cited by 217
Applying clinical epidemiological methods to health equity: the equity effectiveness loop
Tugwell, P., de Savigny, D., Hawker, G., & Robinson, V. (2006) · BMJ · doi:10.1136/bmj.332.7537.358 · Cited by 193
Kiefer, L., Frank, J. W., Di, R. E., Dobbins, M., Manuel, D. G., Gully, P. R., & Mowat, D. L. (2005) · PubMed · Cited by 174
Advocating evidence-based health promotion: reflections and a way forward
Rychetnik, L. (2004) · Health Promotion International · doi:10.1093/heapro/dah212 · Cited by 165
Tannahill, A. (2008) · Health Promotion International · doi:10.1093/heapro/dan032 · Cited by 162
Public Health Decision‐Makers' Informational Needs and Preferences for Receiving Research Evidence
Dobbins, M., Jack, S. M., Thomas, H., & Kothari, A. R. (2007) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00089.x · Cited by 153
The limitations of ‘evidence‐based’ public health
Kemm, J. R. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00600.x · Cited by 147
Priority setting at the micro-, meso- and macro-levels in Canada, Norway and Uganda
Kapiriri, L., Norheim, O. F., & Martin, D. K. (2006) · Health Policy · doi:10.1016/j.healthpol.2006.09.001 · Cited by 146
How do drug policy makers access research evidence?
Ritter, A. J. (2008) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2007.11.017 · Cited by 141
Rudy, E. B., Lucke, J. F., Whitman, G. R., & Davidson, L. J. (2001) · Cited by 121
Getting evidence into policy and practice to address health inequalities
Nutbeam, D. (2004) · Health Promotion International · doi:10.1093/heapro/dah201 · Cited by 117
Nutbeam, D., & Boxall, A.-M. (2008) · Public Health · doi:10.1016/j.puhe.2008.04.020 · Cited by 117
Good intentions and received wisdom are not enough
MacIntyre, S., & Petticrew, M. P. (2000) · Journal of Epidemiology & Community Health · doi:10.1136/jech.54.11.802 · Cited by 115
Dobbins, M., Cockerill, R. W., Barnsley, J. M., & Ciliska, D. K. (2001) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462301107026 · Cited by 100
FACTORS AFFECTING THE UTILIZATION OF SYSTEMATIC REVIEWS
Dobbins, M., Cockerill, R. W., & Barnsley, J. M. (2001) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300105069 · Cited by 98
Social inequality and public health
(2009) · Bristol University Press eBooks · doi:10.1332/policypress/9781847423207.001.0001 · Cited by 85
Béhague, D. P., & Storeng, K. T. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.123117 · Cited by 84
Evidence-based priority-setting: what do the decision-makers think?
Mitton, C., & Patten, S. (2004) · Journal of Health Services Research & Policy · doi:10.1258/1355819041403240 · Cited by 80
Relationship between evidence and policy: A case of evidence-based policy or policy-based evidence?
Hunter, D. J. (2009) · Public Health · doi:10.1016/j.puhe.2009.07.011 · Cited by 76
Epistemology, evidence and experience: evidence based health care in the work of Accident Alliances
Green, J. (2000) · Sociology of Health & Illness · doi:10.1111/1467-9566.00214 · Cited by 68
Multi-sectoral health promotion and public health: the role of evidence
Armstrong, R., Doyle, J., Lamb, C., & Waters, E. (2006) · Journal of Public Health · doi:10.1093/pubmed/fdl013 · Cited by 64
Use of systematic reviews in the development of new provincial public health policies in Ontario
Dobbins, M., Thomas, H., O’Brien, M. A., & Duggan, M. (2004) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462304001278 · Cited by 57
Harries, U., Elliott, H., & Higgins, A. (1999) · Journal of Public Health · doi:10.1093/pubmed/21.1.29 · Cited by 48
Evidence and Policy: Interpreting the Delphic Oracle
Klein, R. T. (2003) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.96.9.429 · Cited by 46
ASTHANA, S., & HALLIDAY, J. (2006) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2006.00459.x · Cited by 45 · cited 3×
“In two studies it was believed that changing the culture within which policy makers work (in terms of structures, rewards and training) so that more value is placed on the use of research evidence for decisions might encourage its use [23,38].”
BackgroundEvidence-Based Medicine as an Instrument for Rational Health Policy
Biller-Andorno, N., Lie, R. K., & ter Meulen, R. (2002) · Health Care Analysis · doi:10.1023/a:1022947707243 · Cited by 44
Making public health interventions more evidence based
Kirkwood, B. (2004) · British medical journal · doi:10.1136/bmj.328.7446.966 · Cited by 37
From research evidence to policy: mental health care in Viet Nam
Harpham, T. (2006) · Bulletin of the World Health Organization · doi:10.2471/blt.05.027789 · Cited by 37
Berg, M., Huijsman, R., Hunter, D. J., & Øvretveit, J. (2007) · Routledge eBooks · doi:10.4324/9780203014349 · Cited by 27
The Role of Evidence in Health Policy Making: A Normative Perspective
Norheim, O. F. (2002) · Health Care Analysis · doi:10.1023/a:1022955909060 · Cited by 20
Evidence and Policy: Interpreting the Delphic Oracle
Κlein, R. (2003) · Journal of the Royal Society of Medicine · doi:10.1177/014107680309600903 · Cited by 20
Research and Knowledge in Ontario Tobacco Control Networks
Bickford, J., & Kothari, A. R. (2008) · Canadian Journal of Public Health · doi:10.1007/bf03403759 · Cited by 11
How and why do interventions that increase health overall widen inequalities within populations?
White, M. J., Adams, J. M., & Heywood, P. (2009) · Policy Press eBooks · doi:10.51952/9781847423221.ch005 · Cited by 10
Research-informed public health
Øvretveit, J. (2007) · Routledge health management series · doi:10.4324/9780203014349.ch6 · Cited by 7
Cited by
A systematic review of barriers to and facilitators of the use of evidence by policymakers
Oliver, K., Innvar, S., Lorenc, T., Woodman, J., & Thomas, J. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-2 · Cited by 1,346
Cohort Profile: The Canadian Longitudinal Study on Aging (CLSA)
Raina, P., Wolfson, C., Kirkland, S., Griffith, L. E., Balion, C., Cossette, B., Dionne, I., Hofer, S., Hogan, D., van den Heuvel, E. R., et al. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz173 · Cited by 542
Gender equality in science, medicine, and global health: where are we at and why does it matter?
Shannon, G., Jansen, M., Williams, K., Cáceres, C., Motta, A., Odhiambo, A., Eleveld, A., & Mannell, J. (2019) · The Lancet · doi:10.1016/s0140-6736(18)33135-0 · Cited by 534
New directions in evidence-based policy research: a critical analysis of the literature
Oliver, K., Lorenc, T., & Innvær, S. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-34 · Cited by 471
Purtle, J., Peters, R., & Brownson, R. C. (2015) · Implementation Science · doi:10.1186/s13012-015-0367-1 · Cited by 446
Metadata
- Authors
- Orton, L., Lloyd-Williams, F., Taylor-Robinson, D., O'Flaherty, M., & Capewell, S.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-07-26
- Volume
- 6
- Issue
- 7
- Pages
- e21704
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2091527106
- Cited by
- 599
- References
- 54
- FWCI
- 4.13
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.