Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Systematic reviews provide a transparent and robust summary of existing research. However, health system managers, national and local policy makers and healthcare professionals can face several obstacles when attempting to utilise this evidence. These include constraints operating within the health system, dealing with a large volume of research evidence and difficulties in adapting evidence from systematic reviews so that it is locally relevant. In an attempt to increase the use of systematic review evidence in decision-making a number of interventions have been developed. These include summaries of systematic review evidence that are designed to improve the accessibility of the findings of systematic reviews (often referred to as information products) and changes to organisational structures, such as employing specialist groups to synthesise the evidence to inform local decision-making. OBJECTIVES: To identify and assess the effects of information products based on the findings of systematic review evidence and organisational supports and processes designed to support the uptake of systematic review evidence by health system managers, policy makers and healthcare professionals. SEARCH METHODS: We searched The Cochrane Library, MEDLINE, EMBASE, CINAHL, Web of Science, and Health Economic Evaluations Database. We also handsearched two journals (Implementation Science and Evidence and Policy), Cochrane Colloquium abstracts, websites of key organisations and reference lists of studies considered for inclusion. Searches were run from 1992 to March 2011 on all databases, an update search to March 2012 was run on MEDLINE only. SELECTION CRITERIA: Randomised controlled trials (RCTs), interrupted time-series (ITS) and controlled before-after studies (CBA) of interventions designed to aid the use of systematic reviews in healthcare decision-making were considered. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted the data and assessed the study quality. We extracted the median value across similar outcomes for each study and reported the range of values for each median value. We calculated the median of the two middlemost values if an even number of outcomes were reported. MAIN RESULTS: We included eight studies evaluating the effectiveness of different interventions designed to support the uptake of systematic review evidence. The overall quality of the evidence was very low to moderate.Two cluster RCTs evaluated the effectiveness of multifaceted interventions, which contained access to systematic reviews relevant to reproductive health, to change obstetric care; the high baseline performance in some of the key clinical indicators limited the findings of these studies. There were no statistically significant effects on clinical practice for all but one of the clinical indicators in selected obstetric units in Thailand (median effect size 4.2%, range -11.2% to 18.2%) and none in Mexico (median effect size 3.5%, range 0.1% to 19.0%). In the second cluster RCT there were no statistically significant differences in selected obstetric units in the UK (median effect RR 0.92; range RR 0.57 to RR 1.10). One RCT evaluated the perceived understanding and ease of use of summary of findings tables in Cochrane Reviews. The median effect of the differences in responses for the acceptability of including summary of findings tables in Cochrane Reviews versus not including them was 16%, range 1% to 28%. One RCT evaluated the effect of an analgesic league table, derived from systematic review evidence, and there was no statistically significant effect on self-reported pain. Only one RCT evaluated an organisational intervention (which included a knowledge broker, access to a repository of systematic reviews and provision of tailored messages), and reported no statistically significant difference in evidence informed programme planning.Three interrupted time series studies evaluated the dissemination of printed bulletins based on evidence from systematic reviews. A statistically significant reduction in the rates of surgery for glue ear in children under 10 years (mean annual decline of -10.1%; 95% CI -7.9 to -12.3) and in children under 15 years (quarterly reduction -0.044; 95% CI -0.080 to -0.011) was reported. The distribution to general practitioners of a bulletin on the treatment of depression was associated with a statistically significant lower prescribing rate each quarter than that predicted by the rates of prescribing observed before the distribution of the bulletin (8.2%; P = 0.005). AUTHORS' CONCLUSIONS: Mass mailing a printed bulletin which summarises systematic review evidence may improve evidence-based practice when there is a single clear message, if the change is relatively simple to accomplish, and there is a growing awareness by users of the evidence that a change in practice is required. If the intention is to develop awareness and knowledge of systematic review evidence, and the
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions
Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00006 · Cited by 2,184
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Printed educational materials: effects on professional practice and health care outcomes
Farmer, A. P., Légaré, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J., & Wolf, F. M. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub2 · Cited by 249
Moseley, A. M., Elkins, M. R., Herbert, R. D., Maher, C. G., & Sherrington, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.018 · Cited by 202
Interventions for preventing obesity in children
Campbell, K., Waters, E., O'Meara, S., Kelly, S., & Summerbell, C. (2002) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001871 · Cited by 183
The reporting quality of meta-analyses improves: a random sampling study
Wen, J., Ren, Y., Wang, L., Li, Y., Liu, Y., Zhou, M., Liu, P., Ye, L., Li, Y., & Tian, W. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.008 · Cited by 84
Naughton, C., Feely, J., & Bennett, K. (2009) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01099.x · Cited by 49
Cited by
A systematic review of barriers to and facilitators of the use of evidence by policymakers
Oliver, K., Innvar, S., Lorenc, T., Woodman, J., & Thomas, J. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-2 · Cited by 1,346
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883
Getting the Word Out: New Approaches for Disseminating Public Health Science
Brownson, R. C., Eyler, A. A., Harris, J. K., Moore, J. B., & Tabak, R. G. (2018) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000673 · Cited by 445
Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., Herrera, C. A., Rada, G., Peñaloza, B., Dudley, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011086.pub2 · Cited by 252
Czosnek, L., Lederman, O., Cormie, P., Zopf, E., Stubbs, B., & Rosenbaum, S. (2019) · Mental Health and Physical Activity · doi:10.1016/j.mhpa.2018.11.001 · Cited by 94
The AIMD Writing/Working Group, Bragge, P., Grimshaw, J. M., Lokker, C., & Colquhoun, H. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0314-8 · Cited by 80
Vargas, E., Becerril-Montekio, V., Gonzalez-Block, M. Á., Akweongo, P., Hazel, C. N. A., Cuembelo, M. D. F., Limbani, F., Bernardo, W., & Muñoz, F. (2016) · Health Research Policy and Systems · doi:10.1186/s12961-015-0072-1 · Cited by 76
Wagner, G., Nussbaumer-Streit, B., Greimel, J., Ciapponi, A., & Gartlehner, G. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0406-5 · Cited by 55
“Background Systematic reviews have become an important source of information for decisionmakers because they provide scientifically rigorous, independent, and accurate syntheses of scientific evidence [1].”
BackgroundQuality and clarity in systematic review abstracts: an empirical study
Tsou, A. Y., & Treadwell, J. R. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1221 · Cited by 23
Metadata
- Authors
- Murthy, L., Shepperd, S., Clarke, M. J., Garner, S. E., Lavis, J. N., Perrier, L., Roberts, N. W., & Straus, S. E.
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2012-09-12
- Volume
- 2012
- Issue
- 9
- Pages
- CD009401-CD009401
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- OpenAlex
- W2097315214
- Cited by
- 155
- References
- 10
- FWCI
- 4.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.