How to build up the actionable knowledge base: the role of ‘best fit’ framework synthesis for studies of improvement in healthcare
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Increasing recognition of the role and value of theory in improvement work in healthcare offers the prospect of capitalising upon, and consolidating, actionable lessons from synthesis of improvement projects and initiatives. We propose that informed use of theory can (i) provide a mechanism by which to collect and organise data from a body of improvement work, (ii) offer a framework for analysis and identification of lessons learnt and (iii) facilitate an evaluation of the feasibility, effectiveness and acceptability of improvement programmes. Improvement practitioners can benefit from using an underpinning external structure as a lens by which to examine the specific achievements of their own projects alongside comparable initiatives led by others. We demonstrate the utility of a method known as ‘best fit framework synthesis’ (BFFS) in offering a ubiquitous and versatile means by which to collect, analyse and evaluate improvement work in healthcare. First reported in 2011, BFFS represents a pragmatic, flexible approach to integrating theory with findings from practice. A deductive phase, where a review team seeks to accommodate a substantial part of the data, is followed by an inductive phase, in which the team explores data not accommodated by the framework. We explore the potential for BFFS within improvement work by drawing upon the evidence synthesis methodology literature and practical examples of improvement work reported in BMJ Quality and Safety (2011–2015). We suggest four variants of BFFS that may have particular value in synthesising a body of improvement work. We conclude that BFFS, alongside other approaches that seek to optimise the contribution of theory to improvement work, represents one important enabling mechanism by which to establish the rigour and scientific credentials of the emerging discipline of ‘improvement science’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative research and evaluation methods
Patton, M. Q. (1980) · Cited by 35,734
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964
Qualitative data analysis for applied policy research
Ritchie, J., & Spencer, L. (2010) · Analyzing qualitative data · doi:10.4324/9780203413081_chapter_9 · Cited by 4,800
Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001862 · Cited by 1,871
Framework Analysis: A Qualitative Methodology for Applied Policy Research
Strivastava, A., & Thomson, S. B. (2009) · Cited by 1,062
Popay, J., Rogers, A., & Williams, G. (1998) · Qualitative Health Research · doi:10.1177/104973239800800305 · Cited by 987
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943
Framework Analysis: A Qualitative Methodology for Applied Policy ResearchPreprint
Srivastava, A., & Thomson, S. B. (2009) · SSRN Electronic Journal · Cited by 825
Damschroder, L. J., & Lowery, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-51 · Cited by 734
Demystifying theory and its use in improvement
Davidoff, F., Dixon-Woods, M., Leviton, L., & Michie, S. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003627 · Cited by 714
Evidence-Based Quality Improvement: The State Of The Science
Shojania, K. G., & Grimshaw, J. M. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.138 · Cited by 691
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649
Self-citationDixon-Woods, M., McNicol, S., & Martin, G. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000760 · Cited by 601
Kaplan, H. C., Provost, L. P., Froehle, C. M., & Margolis, P. A. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000010 · Cited by 572
Using framework-based synthesis for conducting reviews of qualitative studies
Dixon-Woods, M. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-39 · Cited by 487
Carroll, C., Booth, A., & Cooper, K. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-29 · Cited by 461
Self-citationAmmenwerth, E., Iller, C., & Mahler, C. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-3 · Cited by 459
Using qualitative research synthesis to build an actionable knowledge base
Denyer, D., & Tranfield, D. (2006) · Management Decision · doi:10.1108/00251740610650201 · Cited by 426
Using logic models to capture complexity in systematic reviews: Logic Models in Systematic Reviews
Anderson, L. M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., Francis, D., & Tugwell, P. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.32 · Cited by 372
ABC of Behaviour Change Theories
Michie, S., West, R., Campbell, R., Brown, J., & Gainforth, H. L. (2014) · Cited by 359
Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action
Rycroft‐Malone, J., & Bucknall, T. K. (2010) · Cited by 358
Lawton, R., McEachan, R. R. C., Giles, S. J., Sirriyeh, R., Watt, I. S., & Wright, J. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000443 · Cited by 311
Carroll, C., Booth, A., & Lloyd-Jones, M. (2012) · Qualitative Health Research · doi:10.1177/1049732312452937 · Cited by 248
Self-citationUnderstanding what works—and why—in quality improvement: the need for theory-driven evaluation
Walshe, K. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm004 · Cited by 237
Carroll, C., & Booth, A. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1128 · Cited by 235
Self-citationVincent, C., Burnett, S., & Carthey, J. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-002757 · Cited by 217
Davidoff, F. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.014787 · Cited by 216
Complex interventions and their implications for systematic reviews: a pragmatic approach
Petticrew, M., Anderson, L., Elder, R., Grimshaw, J., Hopkins, D., Hahn, R., Krause, L., Kristjansson, E., Mercer, S., Sipe, T., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.004 · Cited by 206
Promotion of improvement as a science
Marshall, M., Pronovost, P., & Dixon-Woods, M. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61850-9 · Cited by 189
Foy, R., Ovretveit, J., Shekelle, P. G., Pronovost, P. J., Taylor, S. L., Dy, S., Hempel, S., McDonald, K. M., Rubenstein, L. V., & Wachter, R. M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.047993 · Cited by 148
Reading, writing and systematic review
Sandelowski, M. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04813.x · Cited by 137
Baxter, S. K., Killoran, A., Kelly, M. P., & Goyder, E. (2010) · Public Health · doi:10.1016/j.puhe.2010.01.002 · Cited by 132
Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-62 · Cited by 112
Hoffmann, M. (2013) · ISRN Neurology · doi:10.1155/2013/892459 · Cited by 90
Garside, R., Pearson, M., & Moxham, T. (2010) · Health Education Research · doi:10.1093/her/cyp060 · Cited by 60
Finding order in heterogeneity: types of quality-improvement intervention publications
Rubenstein, L. V., Hempel, S., Farmer, M. M., Asch, S. M., Yano, E. M., Dougherty, D., & Shekelle, P. W. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.028423 · Cited by 52
Testing the PRISMA-Equity 2012 Reporting Guideline: the Perspectives of Systematic Review Authors
Burford, B. J., Welch, V., Waters, E., Tugwell, P., Moher, D., O’Neill, J., Koehlmoos, T., & Petticrew, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075122 · Cited by 38
Lesselroth, B. J., Yang, J., McConnachie, J., Brenk, T., & Winterbottom, L. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.042689 · Cited by 37
A framework for classifying patient safety practices: results from an expert consensus process
Dy, S. M., Taylor, S. L., Carr, L. H., Foy, R., Pronovost, P. J., Øvretveit, J., Wachter, R. M., Rubenstein, L. V., Hempel, S., McDonald, K. M., et al. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.049296 · Cited by 33
Carroll, C., Rick, J., Leaviss, J., Fishwick, D., & Booth, A. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-1095 · Cited by 30
Self-citationHow reliable is your hospital? A qualitative framework for analysing reliability levels
Ikkersheim, D., & Berg, M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.045187 · Cited by 12
Cited by
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754
“Framework synthesis [63] To produce a new framework based on a priori and new themes.”
MethodHoughton, C., Meskell, P., Delaney, H., Smalle, M., Glenton, C., Booth, A., Chan, X. H. S., Devane, D., & Biesty, L. M. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013582 · Cited by 732
Self-citationFlemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389
Self-citationWaddell, A., Lennox, A., Spassova, G., & Bragge, P. (2021) · Implementation Science · doi:10.1186/s13012-021-01142-y · Cited by 298
Booth, A., Noyes, J., Flemming, K., Gerhardus, A., Wahlster, P., van der Wilt, G. J., Mozygemba, K., Refolo, P., Sacchini, D., Tummers, M., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.03.003 · Cited by 198
“For synthesis and analysis, we used a variant of the best fit framework synthesis approach [20].”
MethodSelf-citation
Metadata
- Authors
- Booth, A., & Carroll, C.
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2015-08-25
- Volume
- 24
- Issue
- 11
- Pages
- 700-708
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- OpenAlex
- W1943602870
- Cited by
- 264
- References
- 43
- FWCI
- 18.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.