The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Pay-for-Performance in the United Kingdom: Impact of the Quality and Outcomes Framework--A Systematic Review
Open accessAbstract
PURPOSE: Primary care practices in the United Kingdom have received substantial financial rewards for achieving standards set out in the Quality and Outcomes Framework since April 2004. This article reviews the growing evidence for the impact of the framework on the quality of primary medical care. METHODS: Five hundred seventy-five articles were identified by searching the MEDLINE, EMBASE, and PsycINFO databases, and from the reference lists of published reviews and articles. One hundred twenty-four relevant articles were assessed using a modified Downs and Black rating scale for 110 observational studies and a Critical Appraisal Skills Programme rating scale for 14 qualitative studies. Ninety-four studies were included in the review. RESULTS: Quality of care for incentivized conditions during the first year of the framework improved at a faster rate than the preintervention trend and subsequently returned to prior rates of improvement. There were modest cost-effective reductions in mortality and hospital admissions in some domains. Differences in performance narrowed in deprived areas compared with nondeprived areas. Achievement for conditions outside the framework was lower initially and has worsened in relative terms since inception. Some doctors reported improved data recording and teamwork, and nurses enhanced specialist skills. Both groups believed that the person-centeredness of consultations and continuity were negatively affected. Patients' satisfaction with continuity declined, with little change in other domains of patient experience. CONCLUSIONS: Observed improvements in quality of care for chronic diseases in the framework were modest, and the impact on costs, professional behavior, and patient experience remains uncertain. Further research is needed into how to improve quality across different domains, while minimizing costs and any unintended adverse effects of payment for performance schemes. Health care organizations should remain cautious about the benefits of similar schemes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
Evaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102
Contribution of Primary Care to Health Systems and Health
STARFIELD, B., SHI, L., & MACINKO, J. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00409.x · Cited by 5,507
Evaluating the Quality of Medical Care
Donabedian, A. (1966) · The Milbank Memorial Fund Quarterly · doi:10.2307/3348969 · Cited by 4,312
Crossing the Quality Chasm: A New Health System for the 21st Century
Bloom, B. S. (2002) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.287.5.646-a · Cited by 3,726
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Campbell, S. M., Roland, M. O., & Buetow, S. A. (2000) · Social Science & Medicine · doi:10.1016/s0277-9536(00)00057-5 · Cited by 1,170
ARIELY, D., GNEEZY, U., LOEWENSTEIN, G., & MAZAR, N. (2009) · Review of Economic Studies · doi:10.1111/j.1467-937x.2009.00534.x · Cited by 797
Does Pay-for-Performance Improve the Quality of Health Care?
Petersen, L. A., Woodard, L. D., Urech, T., Daw, C., & Sookanan, S. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-4-200608150-00006 · Cited by 699
Linking physicians’ pay to the quality of care--a major experiment in the United Kingdom
Roland, M. (2004) · New England Journal of Medicine · doi:10.1056/nejmhpr041294 · Cited by 689
The effect of financial incentives on the quality of health care provided by primary care physicians
Scott, A., Sivey, P., Ait Ouakrim, D., Willenberg, L., Naccarella, L., Furler, J., & Young, D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008451.pub2 · Cited by 568
Systematic review: Effects, design choices, and context of pay-for-performance in health care
Van Herck, P., De Smedt, D., Annemans, L., Remmen, R., Rosenthal, M. B., & Sermeus, W. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-247 · Cited by 523
Maxwell, R. J. (1984) · BMJ · doi:10.1136/bmj.288.6428.1470 · Cited by 513
Giedión, Ú., & Díaz, Y. (2011) · Brookings Institution eBooks · doi:10.5040/9780815755258.ch02 · Cited by 357
Mant, J., & Hicks, N. (1995) · BMJ · doi:10.1136/bmj.311.7008.793 · Cited by 303
Doran, T., Fullwood, C., Kontopantelis, E., & Reeves, D. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61123-x · Cited by 263
Doran, T., Kontopantelis, E., Valderas, J. M., Campbell, S., Roland, M., Salisbury, C., & Reeves, D. (2011) · BMJ · doi:10.1136/bmj.d3590 · Cited by 258
Pay for Performance in Primary Care in England and California: Comparison of Unintended Consequences
McDonald, R., & Roland, M. (2009) · The Annals of Family Medicine · doi:10.1370/afm.946 · Cited by 201
Exclusion of Patients from Pay-for-Performance Targets by English Physicians
Doran, T., Fullwood, C., Reeves, D., Gravelle, H., & Roland, M. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0800310 · Cited by 166
The Experience of Pay for Performance in English Family Practice: A Qualitative Study
Campbell, S. M., McDonald, R., & Lester, H. (2008) · The Annals of Family Medicine · doi:10.1370/afm.844 · Cited by 161
Lester, H. E., Schmittdiel, J. A., Selby, J. V., Fireman, B. H., Campbell, S., Lee, J., Whippy, A., & Madvig, P. (2010) · BMJ · doi:10.1136/bmj.c1898 · Cited by 156
The Effect of Explicit Financial Incentives on Physician Behavior
Armour, B. S., Pitts, M. M., Maclean, R., Cangialose, C. B., Kishel, M., Imai, H., & Etchason, J. (2001) · Archives of Internal Medicine · doi:10.1001/archinte.161.10.1261 · Cited by 145
Checkland, K., Harrison, S. A., McDonald, R., Grant, S., Campbell, S., & Guthrie, B. (2008) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2008.01081.x · Cited by 131
Economic incentives and physicians’ delivery of preventive care
Town, R., Kane, R. L., Johnson, P., & Butler, M. E. (2005) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.10.013 · Cited by 128
Effects of payment for performance in primary care: Qualitative interview study
Maisey, S., Steel, N., Marsh, R., Gillam, S., Fleetcroft, R., & Howe, A. C. (2008) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2008.007118 · Cited by 124
Self-citationNew contract for general practitioners
Shekelle, P. (2003) · BMJ · doi:10.1136/bmj.326.7387.457 · Cited by 112
It's about more than money: financial incentives and internal motivation
Marshall, M. (2005) · BMJ Quality & Safety · doi:10.1136/qshc.2004.013193 · Cited by 104
The effect of financial incentives on the quality of health care provided by primary care physicians
Scott, A., Peter, S., Ouakrim, D. A., Willenberg, L., Naccerella, L., Furler, J., & Young, D. Y. L. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008451 · Cited by 100
Value for money and the Quality and Outcomes Framework in primary care in the UK NHS
Walker, S., Mason, A., Claxton, K., Cookson, R., Fenwick, E. A. L., Fleetcroft, R., & Sculpher, M. J. (2010) · British Journal of General Practice · doi:10.3399/bjgp10x501859 · Cited by 94
Dusheiko, M., Gravelle, H. S. E., Martin, S., Rice, N., & Smith, P. (2011) · Journal of Health Economics · doi:10.1016/j.jhealeco.2011.08.001 · Cited by 88
Campbell, S., Kontopantelis, E., Reeves, D., Valderas, J. M., Gaehl, E., Small, N., & Roland, M. O. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1145 · Cited by 72
Apekey, T. A., McSorley, G., Tilling, M., & Siriwardena, A. N. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01447.x · Cited by 66
Self-citationThe Quality and Outcomes Framework 2009/2010
Champion, G. (2009) · Practice Nursing · doi:10.12968/pnur.2009.20.4.41202 · Cited by 65
Factors influencing variation in prescribing of antidepressants by general practices in Scotland
Morrison, J., Anderson, M.-J., Sutton, M., Munoz-Arroyo, R., McDonald, S., Maxwell, M., Power, A., Smith, M. S., & Wilson, P. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x395076 · Cited by 56
Ethnic Disparities in Coronary Heart Disease Management and Pay for Performance in the UK
Millett, C. J., Gray, J., Wall, M., & Majeed, A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0832-5 · Cited by 55
Grant, S., Huby, G. Ø., Watkins, F., Checkland, K., McDonald, R., Davies, H. T. O., & Guthrie, B. (2009) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2008.01129.x · Cited by 53
Gravelle, H. S. E., Sutton, M., & Ma, A. H. Y. (2007) · RePEc: Research Papers in Economics · Cited by 49
Shohet, C., Yelloly, J. M., Bingham, P., & Lyratzopoulos, G. (2007) · Seizure · doi:10.1016/j.seizure.2007.02.005 · Cited by 46
Cupples, M., Byrne, M. C., Smith, S. M., Leathem, C. S., & Murphy, A. W. (2008) · Heart · doi:10.1136/hrt.2008.145912 · Cited by 43
How to identify when a performance indicator has run its course
Reeves, D., Doran, T., Valderas, J. M., Kontopantelis, E., Trueman, P., Sutton, M., Campbell, S., & Lester, H. E. (2010) · BMJ · doi:10.1136/bmj.c1717 · Cited by 40
The UK pay-for-performance programme in primary care: estimation of population mortality reduction
Fleetcroft, R., Bhurke, S., Howe, A. C., Cookson, R., Swift, L., & Steel, N. (2010) · British Journal of General Practice · doi:10.3399/bjgp10x515359 · Cited by 39
Self-citationThe Quality and Outcomes Framework: QOF - Transforming General Practice
Gillam, S., & Siriwardena, A. N. (2010) · Figshare · Cited by 35
Self-citationMacBride‐Stewart, S., Elton, R. A., & Walley, T. (2008) · Family Practice · doi:10.1093/fampra/cmm074 · Cited by 34
Checkland, K., & Harrison, S. A. (2010) · PubMed · Cited by 30
Should the Quality and Outcomes Framework be abolished? No
Siriwardena, A. N. (2010) · BMJ · doi:10.1136/bmj.c2794 · Cited by 21
Self-citationLester, H., & Roland, M. O. (2007) · BMJ · doi:10.1136/bmj.39385.406192.ad · Cited by 19
Alabbadi, I., Crealey, G., Turner, K. A., et al. (2009) · Pharmacy World & Science · doi:10.1007/s11096-009-9339-3 · Cited by 6
Learning from the QOF: a review of existing research
Steel, N., & Willems, S. J. T. (2018) · CRC Press eBooks · doi:10.1201/9781315377483-4 · Cited by 3
Self-citationThe Quality and Outcomes Framework: triumph of evidence or tragedy for personal care?
Gillam, S., & Siriwardena, A. N. (2018) · CRC Press eBooks · doi:10.1201/9781315377483-12 · Cited by 1
Self-citation
Cited by
Cardiovascular Disease and Diabetes: Policies for Better Health and Quality of Care
OECD (2015) · OECD Health Policy Studies · doi:10.1787/9789264233010-en · Cited by 1,359
Mendelson, A., Kondo, K., Damberg, C., Low, A., Motúapuaka, M., Freeman, M., O'Neil, M., Relevo, R., & Kansagara, D. (2017) · Annals of Internal Medicine · doi:10.7326/m16-1881 · Cited by 371
Chauhan, B. F., Jeyaraman, M., Mann, A. S., Lys, J., Skidmore, B., Sibley, K. M., Abou-Setta, A., & Zarychanksi, R. (2017) · Implementation Science · doi:10.1186/s13012-016-0538-8 · Cited by 210
Increased Risk of Acute Cardiovascular Events After Partner Bereavement: A Matched Cohort Study
Carey, I. M., Shah, S. M., DeWilde, S., Harris, T., Victor, C. R., & Cook, D. G. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.14558 · Cited by 158
McLintock, K., Russell, A. M., Alderson, S. L., West, R., House, A., Westerman, K., & Foy, R. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005178 · Cited by 44
Metadata
- Authors
- Gillam, S. J., Siriwardena, A. N., & Steel, N.
- Venue
- The Annals of Family Medicine
- Publisher
- Annals of Family Medicine
- Published
- 2012-09-01
- Volume
- 10
- Issue
- 5
- Pages
- 461-468
- ISSN
- 1544-1709 (ISSN-L)
- 1544-1717
- OpenAlex
- W2123192775
- Cited by
- 304
- References
- 52
- FWCI
- 6.88
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.