The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
A systematic review of barriers to and facilitators of the use of evidence by policymakers
Open accessAbstract
BACKGROUND: The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review. METHODS: Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population. RESULTS: 145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage. CONCLUSIONS: Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Many Meanings of Research Utilization
Weiss, C. H. (1979) · Public Administration Review · doi:10.2307/3109916 · Cited by 2,222
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Health policy-makers' perceptions of their use of evidence: a systematic review
Innvær, S., Vist, G., Trommald, M., & Oxman, A. (2002) · Journal of Health Services Research & Policy · doi:10.1258/135581902320432778 · Cited by 1,006
Saving Lives: Our Healthier Nation
(1999) · Practice Nursing · doi:10.12968/pnur.1999.10.12.4 · Cited by 638
The Use of Research Evidence in Public Health Decision Making Processes: Systematic Review
Orton, L., Lloyd-Williams, F., Taylor-Robinson, D., O'Flaherty, M., & Capewell, S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021704 · Cited by 599
Towards systematic reviews that inform health care management and policy-making
Lavis, J., Davies, H., Oxman, A., Denis, J.-L., Golden-Biddle, K., & Ferlie, E. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308549 · Cited by 589
Dobbins, M., Robeson, P., Ciliska, D., Hanna, S., Cameron, R., O'Mara, L., DeCorby, K., & Mercer, S. (2009) · Implementation Science · doi:10.1186/1748-5908-4-23 · Cited by 400
Evidence for public health policy on inequalities: 1: The reality according to policymakers
Petticrew, M., Whitehead, M., Macintyre, S. J., Graham, H., & Egan, M. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.015289 · Cited by 380
Implementation Science: A Brief Overview and a Look Ahead
Ogden, T., & Fixsen, D. L. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000160 · Cited by 296
Telling Policy Stories: An Ethnographic Study of the Use of Evidence in Policy-making in the UK
STEVENS, A. (2011) · Journal of Social Policy · doi:10.1017/s0047279410000723 · Cited by 266
the European Implementation Score Collaborative Group (EIS), Boaz, A., Baeza, J., & Fraser, A. (2011) · BMC Research Notes · doi:10.1186/1756-0500-4-212 · Cited by 243
Exploring knowledge exchange: A useful framework for practice and policy
Ward, V., Smith, S., House, A., & Hamer, S. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.09.021 · Cited by 230
Using evidence to inform health policy: case study
Macintyre, S. (2001) · BMJ · doi:10.1136/bmj.322.7280.222 · Cited by 217
JEWELL, C. J., & BERO, L. A. (2008) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2008.00519.x · Cited by 193
Being around and knowing the players: Networks of influence in health policy
Lewis, J. M. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2005.10.004 · Cited by 193
Evidence-Based Practice and the Use of Information in State Agency Decision Making
Jennings, E. T., & Hall, J. L. (2012) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mur040 · Cited by 192
National policy-makers speak out: are researchers giving them what they need?
Hyder, A. A., Corluka, A., Winch, P. J., El-Shinnawy, A., Ghassany, H., Malekafzali, H., Lim, M.-K., Mfutso-Bengo, J., Segura, E., & Ghaffar, A. (2011) · Health Policy and Planning · doi:10.1093/heapol/czq020 · Cited by 180
Dobrow, M. J., Goel, V., Lemieux-Charles, L., & Black, N. A. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.04.020 · Cited by 176
Bryce, J., Victora, C. G., Habicht, J.-P., Vaughan, J. P., & Black, R. E. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.406 · Cited by 166
Murthy, L., Shepperd, S., Clarke, M. J., Garner, S. E., Lavis, J. N., Perrier, L., Roberts, N. W., & Straus, S. E. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009401.pub2 · Cited by 165
How do drug policy makers access research evidence?
Ritter, A. J. (2008) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2007.11.017 · Cited by 141
Lomas, J., & Brown, A. D. (2009) · Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00583.x · Cited by 140
El‐Jardali, F., Lavis, J. N., Ataya, N., & Jamal, D. (2012) · Implementation Science · doi:10.1186/1748-5908-7-2 · Cited by 132
The use of economic evaluations in NHS decision-making: a review and empirical investigation
Williams, I., McIver, S., Moore, D., & Bryan, S. (2008) · Health Technology Assessment · doi:10.3310/hta12070 · Cited by 130
Getting evidence into policy and practice to address health inequalities
Nutbeam, D. (2004) · Health Promotion International · doi:10.1093/heapro/dah201 · Cited by 117
Dobbins, M., Cockerill, R. W., Barnsley, J. M., & Ciliska, D. K. (2001) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462301107026 · Cited by 116
Rocchi, A. R., Menon, D., Verma, S., et al. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00298.x · Cited by 110
Communicating Evidence-Based Information on Cancer Prevention to State-Level Policy Makers
Brownson, R. C., Dodson, E. A., Stamatakis, K. A., Casey, C. M., Elliott, M., Luke, D. A., Wintrode, C. G., & Kreuter, M. W. (2011) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djq529 · Cited by 105
Aaserud, M., Lewin, S. A., Innvær, S., Paulsen, E., Dahlgren, A., Trommald, M., Duley, L., Zwarenstein, M., & Oxman, A. D. (2005) · BMC Health Services Research · doi:10.1186/1472-6963-5-68 · Cited by 101
FACTORS AFFECTING THE UTILIZATION OF SYSTEMATIC REVIEWS
Dobbins, M., Cockerill, R. W., & Barnsley, J. M. (2001) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300105069 · Cited by 98
Albert, M. A., Fretheim, A., & Maïga, D. (2007) · Health Research Policy and Systems · doi:10.1186/1478-4505-5-2 · Cited by 97
Smith, K. E., & Joyce, K. E. (2012) · Evidence & Policy · doi:10.1332/174426412x6201371 · Cited by 95
Perrier, L., Mrklas, K., Lavis, J. N., & Straus, S. E. (2011) · Implementation Science · doi:10.1186/1748-5908-6-43 · Cited by 91
Haynes, A. S., Gillespie, J., Derrick, G., Hall, W., Redman, S., Chapman, S., & Sturk, H. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00643.x · Cited by 81
Weishaar, H., Collin, J., Smith, K., Grüning, T., Mandal, S., & Gilmore, A. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001249 · Cited by 68 · cited 1×
“While perceptions and attitudes are of course important to illuminating the policy process, but there are likely to be other ways - for example documentary, historical, ethnographic or network analyses - in which the role of evidence could be, unpicked [71].”
BackgroundMorrato, E. H., Elias, M., & Gericke, C. A. (2007) · Journal of Public Health · doi:10.1093/pubmed/fdm065 · Cited by 66
Jack, S. M., Brooks, S., Furgal, C. M., & Dobbins, M. (2010) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph7020651 · Cited by 61
Use of health technology assessment in decision making: Coresponsibility of users and producers?
Hivon, M., Lehoux, P., Denis, J.-L., & Tailliez, S. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305050361 · Cited by 60
Getting evidence into policy: The need for deliberative strategies?
Flitcroft, K. L., Gillespie, J., Salkeld, G. P., Carter, S. M., & Trevena, L. J. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.01.034 · Cited by 58
Lencucha, R., Kothari, A. R., & Hamel, N. (2010) · Evidence & Policy · doi:10.1332/174426410x483006 · Cited by 53
The road to smoke-free legislation in Ireland
Currie, L. M., & Clancy, L. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03157.x · Cited by 49
Gagliardi, A. R., Fraser, N., Wright, F. C., Lemieux‐Charles, L., & Davis, D. (2007) · Health Policy · doi:10.1016/j.healthpol.2007.09.002 · Cited by 46
Evidence Check: knowledge brokering to commission research reviews for policy
Campbell, D., Donald, B., Moore, G., & Frew, D. (2011) · Evidence & Policy · doi:10.1332/174426411x553034 · Cited by 46
Who runs public health? A mixed-methods study combining qualitative and network analyses
Oliver, K. A., de Vocht, F., Money, A., & Everett, M. G. (2013) · Journal of Public Health · doi:10.1093/pubmed/fdt039 · Cited by 42
Self-citationBunn, F., & Sworn, K. (2011) · Evidence & Policy · doi:10.1332/174426411x603434 · Cited by 41
Use of evidence in local public health work in Denmark
Bertram, M., Guliš, G., & Pedersen, K. M. (2011) · International Journal of Public Health · doi:10.1007/s00038-011-0324-y · Cited by 40
Legislator Uses of Public Performance Reports: Findings From a Five-Year Study
McDavid, J. C., & Huse, I. (2011) · American Journal of Evaluation · doi:10.1177/1098214011405311 · Cited by 38
Utilizing research in practice and generating evidence from practice
Learmonth, A. (2000) · Health Education Research · doi:10.1093/her/15.6.743 · Cited by 37
The Voice of Experience: How Social Scientists Communicate Family Research to Policymakers
Friese, B., & Bogenschneider, K. (2009) · Family Relations · doi:10.1111/j.1741-3729.2008.00549.x · Cited by 36
Rieckmann, T. R., Kovas, A. E., Cassidy, E. F., & McCarty, D. W. (2011) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2011.02.003 · Cited by 34
Henderson, C. E., Young, D. W., Farrell, J. L., & Taxman, F. S. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.12.006 · Cited by 34
Unpacking capacity to utilize research: A tale of the Burkina Faso public health association
Hamel, N., & Schrecker, T. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.09.051 · Cited by 34
Jönsson, K., Tomson, G. B., Jönsson, C., Kounnavong, S., & Wahlström, R. (2007) · Health Research Policy and Systems · doi:10.1186/1478-4505-5-11 · Cited by 27
Frey, K., & Widmer, T. (2011) · American Journal of Evaluation · doi:10.1177/1098214011401902 · Cited by 22
Innvær, S. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-177 · Cited by 22
Cognizance and Consultation of Randomized Controlled Trials among Ministerial Policy Analysts
Bédard, P., & Ouimet, M. (2012) · Review of Policy Research · doi:10.1111/j.1541-1338.2012.00581.x · Cited by 22
Bunn, F., & Kendall, S. A. (2011) · Journal of research in nursing · doi:10.1177/1744987110392627 · Cited by 21
Information behaviour of Canadian pharmaceutical policy makers
Greyson, D. L., Cunningham, C., & Morgan, S. (2011) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2011.00969.x · Cited by 17
Utilization of Research in Policymaking for Graduated Driver Licensing
Hinchcliff, R., Ivers, R., Poulos, R. G., & Senserrick, T. M. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.184713 · Cited by 17
Kurko, T., Silvast, A., Wahlroos, H., Pietilä, K., & Airaksinen, M. S. A. (2012) · Health Policy · doi:10.1016/j.healthpol.2012.02.013 · Cited by 15
Evaluation by policy makers of a procedure to describe perceived landscape openness
Weitkamp, G., den Berg, A. E. V., Bregt, A. K., & van Lammeren, R. J. A. (2011) · Journal of Environmental Management · doi:10.1016/j.jenvman.2011.09.022 · Cited by 14
Research and Knowledge in Ontario Tobacco Control Networks
Bickford, J., & Kothari, A. R. (2008) · Canadian Journal of Public Health · doi:10.1007/bf03403759 · Cited by 11
Delivering primary care in prison: the need to improve health information
Anaraki, S., Plugge, E., & Hill, A. (2003) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v11i4.566 · Cited by 10
Research works printed but not linked: 15
- Oakley A: Evidence-informed policy and practive: challenges for social science. Educational Research and Evidence-Based Practive. Edited by: Hammersley M. 2007, London: SAGE, 91-105.
- Thomas J, Brunton J: EPPI-Reviewer 3.0: Analysis and Management of Data for Research Synthesis. EPPI-Centre Software. [3.0]. 2006, London: Social Science Research Unit, Institute of Education, Ref Type: Computer Program
- Hinchcliff R, Poulos R, Ivers RQ, Senserrick T: Understanding novice driver policy agenda setting. Public Health. 2011, 125: 217-221. 10.1016/j.puhe.2011.01.001. · doi:10.1016/j.puhe.2011.01.001
- Burris H, Parkhurst J, Du-Sarkodie Y, Mayaud P: Getting research into policy - herpes simplex virus type-2 (HSV-2) treatment and HIV infection: international guidelines formulation and the case of Ghana. Health Res Policy Syst. 2011, 9 (Suppl 1): S5-10.1186/1478-4505-9-S1-S5. · DOI
- Hutchinson E, Parkhurst J, Phiri S, Gibb DM, Chishinga N, Droti B, et al: National policy development for cotrimoxazole prophylaxis in Malawi, Uganda and Zambia: the relationship between context, evidence and links. Health Res Policy Syst. 2011, 9 (Suppl 1): S6-10.1186/1478-4505-9-S1-S6. · doi:10.1186/1478-4505-9-s1-s6
- Wang A, Baerwaldt T, Kuan R, Nordyke R, Halbert R: Payer perspectives on evidence for formulary decision making in the United States. Value Health. 2011, 14: A350. · doi:10.1016/j.jval.2011.08.646
- Carneiro M, Silva-Rosa T: The use of Scientific Knowledge in the Decision Making Process of Environmental Public Policies in Brazil. 2011, Science Communication: Journal of, 10.
- Comptroller and Auditor General of the National Audit Office: Getting the Evidence: Using Research in Policymaking. 2003, London: Stationery Office
- Deelstra Y, Nooteboom SG, Kohlmann HR, Berg J, Innanen S: Using knowledge for decision-making purposes in the context of large projects in The Netherlands. Environ Impact Assess Rev. 2003, 23: 517-541. 10.1016/S0195-9255(03)00070-2. · doi:10.1016/s0195-9255(03)00070-2
- Ortega-Argueta A, Baxter G, Hockings M: Compliance of Australian threatened species recovery plans with legislative requirements. J Environ Manage. 2011, 92: 2054-2060. 10.1016/j.jenvman.2011.03.032. · DOI
- Galani C: Self-reported healthcare decision-makers’ attitudes towards economic evaluations of medical technologies. Curr Med Res Opin. 2008, 24: 3049-3058. 10.1185/03007990802442695. · doi:10.1185/03007990802442695
- Brambila C, Ottolenghi E, Marin C, Bertrand J: Getting results used: evidence from reproductive health programmatic research in Guatemala. Health Policy Plan. 2007, 22: 234-245. 10.1093/heapol/czm013. · doi:10.1093/heapol/czm013
- Hird JA: Policy analysis for what? The effectiveness of nonpartisan policy research organizations. Policy Stud J. 2005, 33: 83-105. 10.1111/j.1541-0072.2005.00093.x. · DOI
- Olson B, Armstrong EP, Grizzle AJ, Nichter MA: Industry’s perception of presenting pharmacoeconomic models to managed care organizations. J Manag Care Pharm. 2003, 9: 159-167. · doi:10.18553/jmcp.2003.9.2.159
- Orton L: The Use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6: e21704-10.1371/journal.pone.0021704. · DOI · Paper page
Cited by
GREENHALGH, T., JACKSON, C., SHAW, S., & JANAMIAN, T. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12197 · Cited by 1,288
The dark side of coproduction: do the costs outweigh the benefits for health research?
Oliver, K., Kothari, A., & Mays, N. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0432-3 · Cited by 754
Self-citationCairney, P., & Oliver, K. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0192-x · Cited by 526
Self-citationSchiff, D. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00270-2 · Cited by 489
“Timing is critical as well, as lack of timely access is one of the most prominent barriers to policy-maker use of evidence (Oliver et al. 2014).”
BackgroundNew directions in evidence-based policy research: a critical analysis of the literature
Oliver, K., Lorenc, T., & Innvær, S. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-34 · Cited by 471
Self-citation
Metadata
- Authors
- Oliver, K., Innvar, S., Lorenc, T., Woodman, J., & Thomas, J.
- Venue
- BMC Health Services Research
- Published
- 2014-01-03
- Volume
- 14
- Issue
- 1
- Pages
- 2-2
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2111637361
- Cited by
- 1,346
- References
- 63
- FWCI
- 17.00
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/2.0 (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.