How Contexts and Issues Influence the Use of Policy‐Relevant Research Syntheses: A Critical Interpretive Synthesis
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Context: Evidence briefs have emerged as a promising approach to synthesizing the best available research evidence for health system policymakers and stakeholders. An evidence brief may draw on systematic reviews and many other types of policy‐relevant information, including local data and studies, to describe a problem, options for addressing it, and key implementation considerations. We conducted a systematic review to examine the ways in which context‐ and issue‐related factors influence the perceived usefulness of evidence briefs among their intended users. Methods: We used a critical interpretive synthesis approach to review both empirical and nonempirical literature and to develop a model that explains how context and issues influence policymakers’ and stakeholders’ views of the utility of evidence briefs prepared for priority policy issues. We used a “compass” question to create a detailed search strategy and conducted electronic searches in CINAHL, EMBASE, HealthSTAR, IPSA, MEDLINE, OAIster (gray literature), ProQuest A&I Theses, ProQuest (Sociological Abstracts, Applied Social Sciences Index and Abstracts, Worldwide Political Science Abstracts, International Bibliography of Social Sciences, PAIS, Political Science), PsychInfo, Web of Science, and WilsonWeb (Social Science Abstracts). Finally, we used a grounded and interpretive analytic approach to synthesize the results. Findings: Of the 4,461 papers retrieved, 3,908 were excluded and 553 were assessed for “relevance,” with 137 included in the initial sample of papers to be analyzed and an additional 23 purposively sampled to fill conceptual gaps. Several themes emerged: (1) many established types of “evidence” are viewed as useful content in an evidence brief, along with several promising formatting features; (2) contextual factors, particularly the institutions, interests, and values of a given context, can influence views of evidence briefs; (3) whether an issue is polarizing and whether it is salient (or not) and familiar (or not) to actors in the policy arena can influence views of evidence briefs prepared for that issue; (4) influential factors can emerge in several ways (as context driven, issue driven, or a result of issue‐context resonance); (5) these factors work through two primary pathways, affecting either the users or the producers of briefs; and (6) these factors influence views of evidence briefs through a variety of mechanisms. Conclusions: Those persons funding and preparing evidence briefs need to consider a variety of context‐ and issue‐related factors when deciding how to make them most useful in policymaking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Olson, M. (1965) · doi:10.4159/9780674041660 · Cited by 14,191
Policy paradigms, social learning, and the state: The case of economic policymaking in Britain
Hall, P. A. (1993) · Comparative Politics · doi:10.2307/422246 · Cited by 7,369 · cited 1×
“, values about what ought to be or beliefs about what is) (Hall 1993).”
BackgroundSystematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 1×
“This in turn prompted us to adopt the critical interpretive synthesis (CIS) approach to qualitative systematic review, as it is ideally suited to deal with a heterogeneous body of literature that is not amenable to the application of traditional systematic review methods (Dixon-Woods et al. 2005, 2006; Greenhalgh et a…”
MethodWhen Effect Becomes Cause: Policy Feedback and Political Change
Pierson, P. (1993) · World Politics · doi:10.2307/2950710 · Cited by 2,600 · cited 1×
“, whether policy is made in a unitary or a federal state) and the legacies of past policies that may shape the policy process by creating incentives and giving some political actors access to more or fewer resources than others, and by creating policy networks that can determine who has access to the policy process (A…”
BackgroundDixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,289
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
How Can Research Organizations More Effectively Transfer Research Knowledge to Decision Makers?
LAVIS, J. N., ROBERTSON, D., WOODSIDE, J. M., McLEOD, C. B., & ABELSON, J. (2003) · The Milbank Quarterly · doi:10.1111/1468-0009.t01-1-00052 · Cited by 1,176
Self-citation“Food deserts”—evidence and assumption in health policy making
Cummins, S., & Macintyre, S. (2002) · BMJ · doi:10.1136/bmj.325.7361.436 · Cited by 558
Examining the Role of Health Services Research in Public Policymaking
Lavis, J. N., Ross, S. E., & Hurley, J. E. (2002) · The Milbank Quarterly · doi:10.1111/1468-0009.00005 · Cited by 402
Self-citation
Cited by
Poirier, M. J. P., Grépin, K. A., & Grignon, M. (2020) · Social Indicators Research · doi:10.1007/s11205-019-02187-9 · Cited by 183
“2005, 2006)—was used following established norms within the health policy literature (Ako-Arrey et al. 2016; Boyko et al. 2012; Ellen et al. 2018; Moat et al. 2013).”
MethodMorgan, R. L., Kelley, L., Guyatt, G. H., Johnson, A., & Lavis, J. N. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.023 · Cited by 44
Self-citationDo policy-makers find commissioned rapid reviews useful?
Moore, G., Redman, S., Rudge, S., & Haynes, A. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0293-1 · Cited by 41
Does knowledge brokering improve the quality of rapid review proposals? A before and after study
Moore, G., Redman, S., D’Este, C., Makkar, S., & Turner, T. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0411-0 · Cited by 28
Metadata
- Authors
- MOAT, K. A., LAVIS, J. N., & ABELSON, J.
- Venue
- The Milbank Quarterly
- Publisher
- Wiley
- Published
- 2013-09
- Volume
- 91
- Issue
- 3
- Pages
- 604-648
- ISSN
- 0887-378X (ISSN-L)
- 1468-0009
- OpenAlex
- W2113908365
- Cited by
- 141
- References
- 14
- FWCI
- 16.04
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Contexts and Issues Influence the Use of Policy‐Relevant Research Syntheses: A Critical Interpretive Synthesis. https://app.cochat.ai/papers/10.1111/1468-0009.12026
- The paper
- MOAT, K. A., LAVIS, J. N., & ABELSON, J. (2013). How Contexts and Issues Influence the Use of Policy‐Relevant Research Syntheses: A Critical Interpretive Synthesis. The Milbank Quarterly. https://doi.org/10.1111/1468-0009.12026
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.