Effect of financial incentives on incentivised and non-incentivised clinical activities: longitudinal analysis of data from the UK Quality and Outcomes Framework
Open accessAbstract
OBJECTIVE: To investigate whether the incentive scheme for UK general practitioners led them to neglect activities not included in the scheme. DESIGN: Longitudinal analysis of achievement rates for 42 activities (23 included in incentive scheme, 19 not included) selected from 428 identified indicators of quality of care. SETTING: 148 general practices in England (653 500 patients). MAIN OUTCOME MEASURES: Achievement rates projected from trends in the pre-incentive period (2000-1 to 2002-3) and actual rates in the first three years of the scheme (2004-5 to 2006-7). RESULTS: Achievement rates improved for most indicators in the pre-incentive period. There were significant increases in the rate of improvement in the first year of the incentive scheme (2004-5) for 22 of the 23 incentivised indicators. Achievement for these indicators reached a plateau after 2004-5, but quality of care in 2006-7 remained higher than that predicted by pre-incentive trends for 14 incentivised indicators. There was no overall effect on the rate of improvement for non-incentivised indicators in the first year of the scheme, but by 2006-7 achievement rates were significantly below those predicted by pre-incentive trends. CONCLUSIONS: There were substantial improvements in quality for all indicators between 2001 and 2007. Improvements associated with financial incentives seem to have been achieved at the expense of small detrimental effects on aspects of care that were not incentivised.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Similar strategies to reduce the mortality gap have been employed in other countries, including the USA, Canada, Australia and throughout Europe.
“Similar strategies have been employed in other countries, including the USA,18,19 Canada,20,21 Australia22–24 and throughout Europe.25,26”
From Mortality gap for people with bipolar disorder and schizophrenia: UK-based cohort study 2000–2014 (2017) · cites this paper as [24]
The Introduction (page not available) describes the UK Quality and Outcomes Framework, so the paper provides an example of a quality-improvement strategy used in Europe. It does not establish that similar strategies were employed throughout Europe, or that the UK scheme was intended to reduce a mortality gap. (LLM, conf=0.79)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137 · see citing works
Scottish Intercollegiate Guidelines Network
Twaddle, S., & Qureshi, S. (2005) · Evidence-based Healthcare and Public Health · doi:10.1016/j.ehbc.2005.09.008 · Cited by 4,079 · see citing works
(1958) · Journal of the American Pharmaceutical Association (Scientific ed ) · doi:10.1002/jps.3030470133 · Cited by 2,491 · see citing works
National service framework for coronary heart disease
Lloyd‐Mostyn, R. H. (2000) · BMJ · doi:10.1136/bmj.321.7261.634 · Cited by 833 · see citing works
Does Pay-for-Performance Improve the Quality of Health Care?
Petersen, L. A., Woodard, L., Urech, T. H., Daw, C., & Chitwood, S. S. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-4-200608150-00006 · Cited by 698 · see citing works
Linking physicians’ pay to the quality of care--a major experiment in the United Kingdom
Roland, M. (2004) · New England Journal of Medicine · doi:10.1056/nejmhpr041294 · Cited by 689 · see citing works
Self-citationNational Service Framework for Mental Health
Thornicroft, G. (2000) · Psychiatric Bulletin · doi:10.1192/pb.24.6.203 · Cited by 639 · see citing works
A meta-analysis of interventions to improve care for chronic illnesses.
Tsai, A. C., Morton, S. C., Mangione, C. M., & Keeler, E. B. (2005) · PubMed · Cited by 482 · see citing works
Quality of Primary Care in England with the Introduction of Pay for Performance
Campbell, S., Reeves, D., Kontopantelis, E., Middleton, E., Sibbald, B., & Roland, M. O. (2007) · New England Journal of Medicine · doi:10.1056/nejmsr065990 · Cited by 426 · see citing works
Self-citationDoran, T., Fullwood, C., Kontopantelis, E., & Reeves, D. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61123-x · Cited by 263 · see citing works
Self-citationWill Pay-For-Performance And Quality Reporting Affect Health Care Disparities?
Casalino, L. P., Elster, A. B., Eisenberg, A., Lewis, E. L., Montgomery, J. M., & Ramos, D. (2007) · Health Affairs · doi:10.1377/hlthaff.26.3.w405 · Cited by 260 · see citing works
Melkman, J. (1961) · Gazette (Leiden Netherlands) · doi:10.1177/001654926100700118 · Cited by 233 · see citing works
McDonald, R., Harrison, S. A., Checkland, K., Campbell, S., & Roland, M. O. (2007) · BMJ · doi:10.1136/bmj.39238.890810.be · Cited by 195 · see citing works
Self-citationExclusion of Patients from Pay-for-Performance Targets by English Physicians
Doran, T., Fullwood, C., Reeves, D., Gravelle, H. S. E., & Roland, M. O. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0800310 · Cited by 166 · see citing works
Self-citationMillett, C. J., Gray, J., Saxena, S. K., Netuveli, G., Khunti, K. K., & Majeed, A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040191 · Cited by 135 · see citing works
Checkland, K., Harrison, S. A., McDonald, R., Grant, S., Campbell, S., & Guthrie, B. (2008) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2008.01081.x · Cited by 127 · see citing works
Self-citationA National Service Framework for diabetes
Davies, M. J. (2001) · The British Journal of Diabetes · doi:10.1177/14746514010010021101 · Cited by 119 · see citing works
Quality of clinical primary care and targeted incentive payments: an observational study.
Steel, N., Maisey, S., Clark, A., Fleetcroft, R., & Howe, A. C. (2007) · PubMed Central · Cited by 117 · see citing works
British national Formulary 1981
Wright, N. (1981) · Journal of Hospital Infection · doi:10.1016/0195-6701(81)90036-0 · Cited by 104 · see citing works
Campbell, S., Roland, M. O., Shekelle, P., Cantrill, J. A., Buetow, S., & Cragg, D. K. (1999) · BMJ Quality & Safety · doi:10.1136/qshc.8.1.6 · Cited by 80 · see citing works
Self-citationVaghela, P. D., Ashworth, M. J., Schofield, P., & Gulliford, M. C. (2008) · Diabetes Care · doi:10.2337/dc08-1999 · Cited by 65 · see citing works
McElduff, P. (2004) · BMJ Quality & Safety · doi:10.1136/qhc.13.3.191 · Cited by 63 · see citing works
Does Pay-for-Performance Improve the Quality of Health Care?
Petersen, L. A. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-7-200704030-00016 · Cited by 51 · see citing works
The quality and outcomes framework of the GMS contract: a quiet evolution for 2006.
Lester, H. E., Sharp, D. J., Hobbs, R. F., & Lakhani, M. K. (2006) · Europe PMC (PubMed Central) · Cited by 24 · see citing works
"The cawing of the crow...Cassandra-like, prognosticating woe".
Heath, I. (2004) · PubMed · Cited by 10 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Roland M. Linking physician pay to quality of care: a major experiment in the UK. N Engl J Med 2004;351:1448-54.
- Doran T, Fullwood K, Kontopantelis E, Reeves D. The effect of financial incentives on inequalities in the delivery of primary care in England. Lancet 2008;372:728-36.
- Marshall M, Campbell S, Hacker J, Roland M, eds. Quality indicators for general practice: a practical guide to clinical quality indicators for primary care professionals and managers . Royal Society of Medicine Press, 2002.
Cited by
Sorted by citations
Kontopantelis, E., Doran, T., Springate, D. A., Buchan, I., & Reeves, D. (2015) · BMJ · doi:10.1136/bmj.h2750 · Cited by 1,001 · see citing works
Self-citationMortality gap for people with bipolar disorder and schizophrenia: UK-based cohort study 2000–2014
Hayes, J. F., Marston, L., Walters, K., King, M. B., & Osborn, D. P. J. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.117.202606 · Cited by 451 · see citing works
Quality and Outcomes Framework: what have we learnt?:
Roland, M., & Guthrie, B. (2016) · BMJ · doi:10.1136/bmj.i4060 · Cited by 215 · see citing works
Self-citationSuicide Risk in Primary Care Patients With Major Physical Diseases: A Case-Control Study
Webb, R. T. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1561 · Cited by 211 · see citing works
Forbes, L. J., Marchand, C., Doran, T., & Peckham, S. (2017) · British Journal of General Practice · doi:10.3399/bjgp17x693077 · Cited by 187 · see citing works
Self-citationKennedy, A., Rogers, A., Chew-Graham, C., Blakeman, T., Bowen, R., Gardner, C., Lee, V., Morris, R., & Protheroe, J. (2014) · Implementation Science · doi:10.1186/s13012-014-0129-5 · Cited by 104 · see citing works
Kennedy, A., Rogers, A., Bowen, R., Lee, V., Blakeman, T., Gardner, C., Morris, R., Protheroe, J., & Chew-Graham, C. (2014) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.11.008 · Cited by 97 · see citing works
McLintock, K., Russell, A. M., Alderson, S. L., West, R., House, A., Westerman, K., & Foy, R. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005178 · Cited by 44 · see citing works
- Authors
- Doran, T., Kontopantelis, E., Valderas, J. M., Campbell, S., Roland, M., Salisbury, C., & Reeves, D.
- Affiliations
- University of Manchester (GB)
- University of Oxford (GB)
- University of Cambridge (GB)
- University of Bristol (GB)
- Corresponding author
- Doran, T.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2011-06-28
- Volume
- 342
- Issue
- jun28 1
- Pages
- d3590-d3590
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC3125475
- OpenAlex
- W2141725152
- Cited by
- 258
- References
- 26
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 9 · 2023: 9 · 2022: 6 · 2021: 10 · 2020: 14 · 2019: 18 · 2018: 18 · 2017: 33 · 2016: 25 · 2015: 27 · 2014: 22 · 2013: 26 · 2012: 22
- FWCI
- 44.60
- Type
- journal article
- Language
- en
- Update notices
- correction (2013-10-02)
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion)
- Explore Bristol Research (submittedVersion, public-domain)
- Figshare (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Open Research Exeter (University of Exeter) (submittedVersion, cc-by-nc)
- Funders
- National Institute for Health and Care Research
- Topics
- Health Sciences › Health Professions › General Health Professions › Primary Care and Health Outcomes
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Healthcare Policy and Management
- Health Sciences › Health Professions › General Health Professions › Health Services Management and Policy
- Keywords
- financial incentives, Quality and Outcomes Framework, general practitioners, quality of care, quality indicators, primary care, unintended consequences, healthcare quality improvement, general practice
- MeSH terms
- Financing, Government, United Kingdom, Motivation, Quality of Health Care, Outcome Assessment, Health Care, General Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review