The role of the Quality and Outcomes Framework in the care of long-term conditions: a systematic review
Open accessThe DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
Background: Improving care for people with long-term conditions is central to NHS policy. It has been suggested that the Quality and Outcomes Framework (QOF), a primary care pay-for-performance scheme that rewards practices for delivering effective interventions in long-term conditions, does not encourage high-quality care for this group of patients. Aim: To examine the evidence that the QOF has improved quality of care for patients with long-term conditions. Design and setting: This was a systematic review of research on the effectiveness of the QOF in the UK. Method: The authors searched electronic databases for peer-reviewed empirical quantitative research studying the effect of the QOF on a broad range of processes and outcomes of care, including coordination and integration of care, holistic and personalised care, self-care, patient experience, physiological and biochemical outcomes, health service utilisation, and mortality. Because the studies were heterogeneous, a narrative synthesis was carried out. Results: The authors identified three systematic reviews and five primary research studies that met the inclusion criteria. The QOF was associated with a modest slowing of both the increase in emergency admissions and the increase in consultations in severe mental illness (SMI), and modest improvements in diabetes care. The nature of the evidence means that the authors cannot be sure that any of these associations is causal. No clear effect on mortality was found. The authors found no evidence that the QOF influences integration or coordination of care, holistic care, self-care, or patient experience. Conclusion: The NHS should consider more broadly what constitutes high-quality primary care for people with long-term conditions, and consider other ways of motivating primary care to deliver it.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, there is limited evidence of applying the QOF as a ‘lever’ for change.37”
From Dementia prevention and the GP’s role: a qualitative interview study (2024) · cites this paper as [37]
In the citing paper
“In the UK, DSME is recommended for people with type 2 diabetes (T2DM),14 and primary care services (GP practices) are financially incentivised to refer patients to available programmes.15”
From Health care professionals’ views towards self-management and self-management education for people with type 2 diabetes (2019) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Ford, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405 · cited 1×
“Also, it is recognised that the effectiveness of interventions demonstrated in randomised controlled trials, which include highly selected study participants, is often diluted in routine clinical practice.(46) Perhaps non-incentivised activities are more important in determining mortality in the patient population.”
BackgroundMethods for Evaluating Changes in Health Care Policy: The Difference-in-Differences Approach
Dimick, J. B., & Ryan, A. M. (2014) · JAMA · doi:10.1001/jama.2014.16153 · Cited by 1,193
Marmot, M., & Bell, R. (2012) · Public Health · doi:10.1016/j.puhe.2012.05.014 · Cited by 1,060
(2010) · Nursing Standard · doi:10.7748/ns2010.10.25.6.30.p4603 · Cited by 1,043
Effects of Pay for Performance on the Quality of Primary Care in England
Campbell, S. M., Reeves, D., Kontopantelis, E., Sibbald, B., & Roland, M. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0807651 · Cited by 696
Serumaga, B., Ross-Degnan, D., Avery, A. J., Elliott, R. A., Majumdar, S. R., Zhang, F., & Soumerai, S. B. (2011) · BMJ · doi:10.1136/bmj.d108 · Cited by 284 · cited 1×
“few limits on outcomes, study outcomes were solely derived from either QOF indicators themselves or prescribing data, with two exceptions: one study examined adherence to British Thoracic Society spirometry standards(36) and the other cardiovascular events in patients with hypertension.(32) The authors found five prim…”
MethodDoran, T., Fullwood, C., Kontopantelis, E., & Reeves, D. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61123-x · Cited by 263
Self-citationDoran, T., Kontopantelis, E., Valderas, J. M., Campbell, S., Roland, M., Salisbury, C., & Reeves, D. (2011) · BMJ · doi:10.1136/bmj.d3590 · Cited by 258
Self-citationQuality and Outcomes Framework: what have we learnt?:
Roland, M., & Guthrie, B. (2016) · BMJ · doi:10.1136/bmj.i4060 · Cited by 215
Ryan, A. M., Krinsky, S., Kontopantelis, E., & Doran, T. (2016) · The Lancet · doi:10.1016/s0140-6736(16)00276-2 · Cited by 185
Self-citationCalvert, M., Shankar, A., McManus, R. J., Lester, H., & Freemantle, N. (2009) · BMJ · doi:10.1136/bmj.b1870 · Cited by 156
Houle, S. K. D., McAlister, F. A., Jackevicius, C. A., Chuck, A. W., & Tsuyuki, R. T. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-12-201212180-00009 · Cited by 149 · cited 1×
“The second systematic review concluded that the effect of pay-for-performance remained uncertain.(16) The third systematic review concluded that there was limited evidence of the effects of financial incentives.”
BackgroundHarrison, M. J., Dusheiko, M., Sutton, M., Gravelle, H., Doran, T., & Roland, M. (2014) · BMJ · doi:10.1136/bmj.g6423 · Cited by 141 · cited 1×
“The study examining emergency admissions before and after the introduction of the QOF found that the trend of increasing emergency hospital admission rates (which increased overall by 34% between 2004 and 2010) was modestly lower for conditions incentivised in the QOF compared with conditions that were not incentivise…”
ResultSelf-citationMillett, C., Gray, J., Saxena, S., Netuveli, G., Khunti, K., & Majeed, A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040191 · Cited by 138
Quality of clinical primary care and targeted incentive payments: an observational study.
Steel, N., Maisey, S., Clark, A., Fleetcroft, R., & Howe, A. C. (2007) · PubMed · Cited by 133
Pharmaceutical policies: effects of financial incentives for prescribers
Rashidian, A., Omidvari, A.-H., Vali, Y., Sturm, H., & Oxman, A. D. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006731.pub2 · Cited by 130
Kontopantelis, E., Reeves, D., Valderas, J. M., Campbell, S., & Doran, T. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001033 · Cited by 125 · cited 2×
“The study examining effects on a composite indicator of process and outcomes in type 2 diabetes found a modest improvement of 14% over and above the underlying trend in the first year after the introduction of the QOF, declining to 8% in the third year.(42) Table 1 summarises the results of the studies.”
BackgroundSelf-citationSuccesses and Failures of Pay for Performance in the United Kingdom
Roland, M., & Campbell, S. (2014) · New England Journal of Medicine · doi:10.1056/nejmhpr1316051 · Cited by 121 · cited 1×
“It has been suggested that practices prioritise QOF-related activities at the expense of other aspects of care, because of their reliance on QOF income.(6,7) A decade after the introduction of the QOF, NHS strategy, set out in the 2014 Five Year Forward View,(8) is now focused on other challenges.”
BackgroundPredicting and preventing avoidable hospital admissions: a review
Purdy, S., & Huntley, A. L. (2013) · The Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2013.415 · Cited by 119
Langdown, C., & Peckham, S. (2014) · Journal of Public Health · doi:10.1093/pubmed/fdt077 · Cited by 100 · cited 1×
“The first systematic review concluded that the QOF had had a limited impact on health outcomes.(15) The second systematic review concluded that the effect of pay-for-performance remained uncertain.”
BackgroundSelf-citationMillett, C., Gray, J., Saxena, S., Netuveli, G., & Majeed, A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.061556 · Cited by 99
The Challenges of Measuring, Improving, and Reporting Quality in Primary Care
Young, R. A., Roberts, R. G., & Holden, R. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2014 · Cited by 96 · cited 1×
“Perhaps this is because defining and measuring quality of general practice is complex.(44) The lack of effect of the QOF on mortality is surprising, given that the indicators are based on high-quality evidence of effectiveness of interventions.”
BackgroundTackling the crisis in general practice
Roland, M. O., & Everington, S. (2016) · BMJ · doi:10.1136/bmj.i942 · Cited by 95 · cited 1×
“Losing this is likely to have detrimental effects on patient care and further worsen recruitment and retention in primary care, which is once again in a precarious position.(55) Alternative methods of rewarding good practice are being considered for new models of primary care.”
BackgroundKontopantelis, E., Springate, D., Reeves, D., Ashcroft, D. M., Valderas, J. M., & Doran, T. (2014) · BMJ · doi:10.1136/bmj.g330 · Cited by 88 · cited 1×
“There is some limited evidence to suggest that performance did not fall following the withdrawal of certain individual indicators from the scheme.(54) Abolishing the QOF may also allow practices to prioritise other activities, which could lead to better care.”
BackgroundSelf-citationGulliford, M. C., Ashworth, M., Robotham, D., & Mohiddin, A. (2007) · Diabetic Medicine · doi:10.1111/j.1464-5491.2007.02090.x · Cited by 83
Developing Quality and Outcomes Framework (QOF) indicators and the concept of 'QOFability'.
Lester, H. E., & Campbell, S. (2010) · PubMed · Cited by 78
Kontopantelis, E., Olier, I., Planner, C., Reeves, D., Ashcroft, D. M., Gask, L., Doran, T., & Reilly, S. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008650 · Cited by 77 · cited 1×
“The study examining consultation rates found a trend of increasing rates overall during the period, with a small step change in 2004; the rate of increase was greater in people with SMI than overall.(40) The faceto-face consultation rate in SMI increased from about nine to 11 per patient per year from 2000 to 2011, an…”
BackgroundSelf-citationMcGovern, M. P., Boroujerdi, M. A., Taylor, M., Williams, D. J., Hannaford, P. C., Lefèvre, K., & Simpson, C. R. (2007) · Family Practice · doi:10.1093/fampra/cmm073 · Cited by 68
Coleman, T., Lewis, S., Hubbard, R., & Smith, C. (2007) · Addiction · doi:10.1111/j.1360-0443.2007.01766.x · Cited by 66
Reducing emergency admissions through community based interventions
Wallace, E., Smith, S. M., Fahey, T. P., & Roland, M. O. (2016) · BMJ · doi:10.1136/bmj.h6817 · Cited by 64 · cited 1×
“In any case, among interventions to prevent emergency admissions, pay-forperformance is unlikely to be one of the most effective.(48,49) It could be argued that some QOF indicators — in palliative care, cancer, SMI, dementia, and rheumatoid arthritis — incentivise multidisciplinary meetings, reviews, and care plans, c…”
BackgroundEthnic Disparities in Coronary Heart Disease Management and Pay for Performance in the UK
Millett, C. J., Gray, J., Wall, M., & Majeed, A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0832-5 · Cited by 60
Kontopantelis, E., Doran, T., Gravelle, H. S. E., Goudie, R., Siciliani, L., & Sutton, M. (2011) · Health Services Research · doi:10.1111/j.1475-6773.2011.01362.x · Cited by 54
Self-citationVamos, E. P., Pape, U. J., Bottle, A., Hamilton, F. L., Ćurčin, V., Ng, A., Molokhia, M., Car, J., Majeed, A., & Millett, C. J. (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.101187 · Cited by 53
Effect of the UK Incentive-Based Contract on the Management of Patients With Stroke in Primary Care
Simpson, C. R., Hannaford, P. C., Lefevre, K., & Williams, D. J. (2006) · Stroke · doi:10.1161/01.str.0000236067.37267.88 · Cited by 51
Millett, C. J., Bottle, A., Ng, A., Ćurčin, V., Molokhia, M., Saxena, S. K., & Majeed, A. (2009) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2009.090171 · Cited by 50
McGovern, M. P., Williams, D. J., Hannaford, P. C., Taylor, M. W., Lefèvre, K., Boroujerdi, M. A., & Simpson, C. R. (2008) · Diabetic Medicine · doi:10.1111/j.1464-5491.2008.02544.x · Cited by 48
Alshamsan, R., Lee, J. T., Majeed, A., Netuveli, G., & Millett, C. J. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1335 · Cited by 48
NICE and the Quality and Outcomes Framework (QOF) 2009-2011.
Sutcliffe, D., Lester, H. E., Hutton, J., & Stokes, T. (2012) · PubMed · Cited by 47
MacBride‐Stewart, S., Elton, R. A., & Walley, T. (2008) · Family Practice · doi:10.1093/fampra/cmm074 · Cited by 39
Strong, M., South, G., & Carlisle, R. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-108 · Cited by 29
Simpson, C. R., Hannaford, P. C., Ritchie, L. D., Sheikh, A., & Williams, D. J. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x583407 · Cited by 27
Physical health indicators in major mental illness: analysis of QOF data across UK general practice
Martin, J. L., Lowrie, R., McConnachie, A., McLean, G., Mair, F. S., Mercer, S. W., & Smıth, D. J. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x681829 · Cited by 20 · cited 1×
“Moreover, the QOF does not incentivise practices to improve care for patients with the most complex needs in primary care, because these are more likely to be excepted from the scheme.(51) Raising thresholds for achievement may be counterproductive — there is evidence that it leads to increased exception reporting, ra…”
BackgroundGallagher, N., Cardwell, C. R., Hughes, C., & O’Reilly, D. (2014) · Diabetic Medicine · doi:10.1111/dme.12575 · Cited by 17 · cited 3×
“Because of the design of the studies, it is not possible to be sure that any of the positive effects seen are causally related to the QOF.”
ResultInfluentialPayment for Performance and the QOF: are we doing the right thing?
Kramer, G. (2012) · British Journal of General Practice · doi:10.3399/bjgp12x630151 · Cited by 12 · cited 1×
“It has been suggested that practices prioritise QOF-related activities at the expense of other aspects of care, because of their reliance on QOF income.(6,7) A decade after the introduction of the QOF, NHS strategy, set out in the 2014 Five Year Forward View,(8) is now focused on other challenges.”
BackgroundQuality and Outcomes Framework: smoke and mirrors?
Ashworth, M. J., & Kordowicz, M. (2010) · PubMed · Cited by 11
General practitioner recruitment and retention: An evidence synthesis
Peckham, S., Marchand, C., & Peckham, A. (2016) · Kent Academic Repository (University of Kent) · Cited by 8
Self-citation
Cited by
The Lancet Commission on diabetes: using data to transform diabetes care and patient lives
Chan, J. C. N., Lim, L.-L., Wareham, N. J., Shaw, J. E., Orchard, T. J., Zhang, P., Lau, E. S. H., Eliasson, B., Kong, A. P. S., Ezzati, M., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)32374-6 · Cited by 793
The Handbook of Behavior Change
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 407
Changing Behavior Using the Theory of Planned Behavior
Ajzen, I., & Schmidt, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.002 · Cited by 266
Performance-based financing in low-income and middle-income countries: isn’t it time for a rethink?
Paul, E., Albert, L., Bisala, B. N., Bodson, O., Bonnet, E., Bossyns, P., Colombo, S., De Brouwere, V., Dumont, A., Eclou, D. S., et al. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000664 · Cited by 170
Changing Behavior Using the Model of Action Phases
Keller, L., Gollwitzer, P. M., & Sheeran, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.006 · Cited by 147
Metadata
- Authors
- Forbes, L. J., Marchand, C., Doran, T., & Peckham, S.
- Affiliations
- University of Kent (GB)
- University of York (GB)
- Venue
- British Journal of General Practice
- Published
- 2017-09-25
- Volume
- 67
- Issue
- 664
- Pages
- e775-e784
- ISSN
- 0960-1643 (ISSN-L)
- 1478-5242
- PMC
- PMC5647921
- OpenAlex
- W2759404731
- Cited by
- 187
- References
- 49
- Citations by year
- 2026: 12 · 2025: 22 · 2024: 18 · 2023: 7 · 2022: 18 · 2021: 20 · 2020: 65 · 2019: 15 · 2018: 8 · 2017: 2
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- British Journal of General Practice (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Kent Academic Repository (University of Kent) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Health Sciences › Medicine › Family Practice › Primary Care and Health Outcomes
- Health Sciences › Health Professions › General Health Professions › Health Services Management and Policy
- Health Sciences › Medicine › Epidemiology › Chronic Disease Management Strategies
- Keywords
- Quality and Outcomes Framework, performance-based pay, chronic disease, primary care quality, severe mental illness, diabetes management, emergency admissions, care coordination, patient experience, self-care, health care utilization, mortality, NHS policy
- MeSH terms
- Chronic Disease, Delivery of Health Care, United Kingdom, Humans, Long-Term Care, Primary Health Care, Quality of Health Care, State Medicine, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
