Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Audit and feedback to physicians is commonly used alone or as part of multifaceted interventions. While it can play an important role in quality improvement, the optimal design of audit and feedback is unknown. This study explores how feedback can be improved to increase acceptability and usability in primary care. The trial seeks to determine whether a theory-informed worksheet appended to feedback reports can help family physicians improve quality of care for their patients with diabetes and/or ischemic heart disease. METHODS: Two-arm cluster trial was conducted with participating primary care practices allocated using minimization to simple feedback or enhanced feedback group. The simple feedback group receives performance feedback reports every six months for two years regarding the proportion of their patients with diabetes and/or ischemic heart disease who are meeting quality targets. The enhanced feedback group receives these same reports as well as a theory-informed worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Participants are family physicians from across Ontario who use electronic medical records; data for rostered patients are used to produce the feedback reports and for analysis. OUTCOMES: The primary disease outcomes are the blood pressure (BP), and low-density lipoprotein cholesterol (LDL) levels. The primary process measure is a composite score indicating the number of recommended activities (e.g., tests and prescriptions) conducted by the family physicians for their patients with diabetes and/or ischemic heart disease within the appropriate timeframe. Secondary outcomes are the proportion of patients whose results meet targets for glucose, LDL, and BP as well as the percent of patients receiving relevant prescriptions. A qualitative process evaluation using semi-structured interviews will explore perceived barriers to behaviour change in response to feedback reports and preferences with regard to feedback design. ANALYSIS: Intention-to-treat approach will be used to analyze the trial. Analysis will be performed on patient-level variables using generalized estimating equation models to adjust for covariates and account for the clustered nature of the data. The trial is powered to show small, but clinically important differences of 7 mmHG in systolic BP and 0.32 mmol/L in LDL. TRIAL REGISTRATION: ClinicalTrials.gov NCT00996645.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Building a practically useful theory of goal setting and task motivation: A 35-year odyssey.
Locke, E. A., & Latham, G. P. (2002) · American Psychologist · doi:10.1037/0003-066x.57.9.705 · Cited by 7,766
Gibbs, G. (2007) · doi:10.4135/9781849208574 · Cited by 4,299
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Law, M. R., Morris, J. K., & Wald, N. J. (2009) · BMJ · doi:10.1136/bmj.b1665 · Cited by 2,775
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Davis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe, K. E., & Perrier, L. (2006) · JAMA · doi:10.1001/jama.296.9.1094 · Cited by 2,375
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912 · cited 1×
“The Cochrane review of audit and feedback [8] concluded that it is effective, but the authors noted great variability in the design and the effectiveness of feedback interventions.”
Critically appraising qualitative research
Kuper, A., Lingard, L., & Levinson, W. (2008) · BMJ · doi:10.1136/bmj.a1035 · Cited by 784
The method of minimization for allocation to clinical trials
Scott, N. W., McPherson, G. C., Ramsay, C. R., & Campbell, M. K. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00242-8 · Cited by 651 · cited 1×
“Although minimization has been criticised for increasing the risk for selection bias [40], the benefits of achieving balance at baseline through the use of minimization outweighs the minor risks involved (especially for small trials) and therefore has been widely recommended [41,42].”
Research works printed but not linked: 42
- Haffner SM, Lehto S, Ronnemaa T, Pyorala K, Laakso M: Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998, 339 (4): 229-234. 10.1056/NEJM199807233390404. · DOI · Paper page
- Burge FI, Bower K, Putnam W, Cox JL: Quality indicators for cardiovascular primary care. Can J Cardiol. 2007, 23 (5): 383-388. · DOI
- Narayan KM, Benjamin E, Gregg EW, Norris SL, Engelgau MM: Diabetes translation research: where are we and where do we want to be?. Ann Intern Med. 2004, 140 (11): 958-963. · DOI · Paper page
- Davis D, Davis N: Educational Interventions. Knowledge Translation in Health Care - Moving from Evidence to Practice. Edited by: Straus S, Tetroe J, Graham ID. 2009, UK: Wiley-Blackwell, 116.
- Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296 (4): 427-440. 10.1001/jama.296.4.427. · DOI · Paper page
- Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995, 153 (10): 1423-1431.
- Kluger AN, DeNisi A: The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychol Bull. 1996, 119 (2): 254-284. 10.1037/0033-2909.119.2.254. · DOI · Paper page
- Carver CS, Scheier MF: Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982, 92 (1): 111-135. 10.1037/0033-2909.92.1.111. · doi:10.1037/0033-2909.92.1.111 · Paper page
- Gollwitzer PM: Implementation Intentions. Am Psychol. 1999, 54 (7): 493-503. 10.1037/0003-066X.54.7.493. · DOI · Paper page
- Locke EA: A theory of goal setting & task performance. 1990, Englewood Cliffs, N.J.: Prentice Hall
- Bandura A: Self-efficacy. Encyclopedia of human behavior. Edited by: Ramachandran VS. 1994, Toronto: Academic Press, 71-81.
- Ajzen I, Manstead ASR: Changing health-related behaviors: An approach based on the theory of planned behavior. The scope of social psychology: Theory and applications. Edited by: van den Bos K, Hewstone M, de Wit J, Schut H, Stroebe M. 2007, New York: Psychology Press, 43-63.
- Gollwitzer PM, Fujita K, Oettingen G: Planning and the Implementation of Goals. Handbook of self-regulation: research, theory, and applications. Edited by: Baumeister RF, Vohs KD. 2004, New York: Guilford Press, 211-228.
- Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14. · DOI · Paper page
- Tu K, Klein-Geltink J, Mitiku TF, Mihai C, Martin J: De-identification of primary care electronic medical records free-text data in Ontario, Canada. BMC Med Inform Decis Mak. 2010, 10: 35-10.1186/1472-6947-10-35. · DOI
- Tu K, Manuel D, Lam K, Kavanagh D, Mitiku TF, Guo H: Diabetics can be identified in an electronic medical record using laboratory tests and prescriptions. J Clin Epidemiol. 2010,
- Ivers NM, Pylypenko B, Tu K: Identifying Ischemic Heart Disease in an Electronic Medical Record. Journal of Primary Care and Community Health,
- Jackson GL, Weinberger M: A decade with the chronic care model: some progress and opportunity for more. Med Care. 2009, 47 (9): 929-931. 10.1097/MLR.0b013e3181b63537. · DOI
- Luszczynska A, Haynes C: Changing nutrition, physical activity and body weight among student nurses and midwives: effects of a planning intervention and self-efficacy beliefs. J Health Psychol. 2009, 14 (8): 1075-1084. 10.1177/1359105309342290. · DOI · Paper page
- Shershneva MB, Wang MF, Lindeman GC, Savoy JN, Olson CA: Commitment to Practice Change: An Evaluator's Perspective. Eval Health Prof. 2010, 33 (3): 256-75. 10.1177/0163278710363960. · DOI
- Wakefield JG: Commitment to change: exploring its role in changing physician behavior through continuing education. J Contin Educ Health Prof. 2004, 24 (4): 197-204. 10.1002/chp.1340240403. · DOI
- Mazmanian PE, Johnson RE, Zhang A, Boothby J, Yeatts EJ: Effects of a signature on rates of change: a randomized controlled trial involving continuing education and the commitment-to-change model. Acad Med. 2001, 76 (6): 642-646. 10.1097/00001888-200106000-00018. · DOI
- Overton GK, MacVicar R: Requesting a commitment to change: conditions that produce behavioral or attitudinal commitment. J Contin Educ Health Prof. 2008, 28 (2): 60-66. 10.1002/chp.158. · DOI
- Hewitt CE, Torgerson DJ: Is restricted randomisation necessary?. BMJ. 2006, 332 (7556): 1506-1508. 10.1136/bmj.332.7556.1506. · DOI · Paper page
- Bhattacharyya OK, Estey EA, Cheng AY, Canadian Diabetes Association 2008: Update on the Canadian Diabetes Association 2008 clinical practice guidelines. Can Fam Physician. 2009, 55 (1): 39-43.
- Genest J, McPherson R, Frohlich J, Anderson T, Campbell N, Carpentier A, Couture P, Dufour R, Fodor G, Francis GA, Grover S, Gupta M, Hegele RA, Lau DC, Leiter L, Lewis GF, Lonn E, Mancini GB, Ng D, Pearson GJ, Sniderman A, Stone JA, Ur E: 2009 Canadian Cardiovascular Society/Canadian guidelines for the diagnosis and treatment of dyslipidemia and prevention of cardiovascular disease in the adult - 2009 recommendations. Can J Cardiol. 2009, 25 (10): 567-579. · DOI · Paper page
- Cooper A, Skinner J, Nherera L, Feder G, Ritchie G, Kathoria M, Turnbull N, Shaw G, MacDermott K, Minhas R, Packham C, Squires H, Thomson D, Timmis A, Walsh J, Williams H, White A: Clinical Guidelines and Evidence Review for Post Myocardial Infarction: Secondary prevention in primary and secondary care for patients following a myocardial infarction. Anonymous London: National Collaborating Centre for Primary Care and Royal College of General Practitioners. 2007, [Anonymous]
- Holbrook A, Thabane L, Keshavjee K, Dolovich L, Bernstein B, Chan D, Troyan S, Foster G, Gerstein H, COMPETE II Investigators: Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. CMAJ. 2009, 181 (1-2): 37-44. · DOI · Paper page
- Canadian Hypertension Education Program, Campbell N, Kwong MM: 2010 Canadian Hypertension Education Program recommendations: An annual update. Can Fam Physician. 2010, 56 (7): 649-653.
- Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. 2000, New York: Oxford University Press
- Kizer JR, Madias C, Wilner B, Vaughan CJ, Mushlin AI, Trushin P, Gotto AM, Pasternak RC: Relation of different measures of low-density lipoprotein cholesterol to risk of coronary artery disease and death in a meta-regression analysis of large-scale trials of statin therapy. Am J Cardiol. 2010, 105 (9): 1289-1296. 10.1016/j.amjcard.2009.12.051. · DOI · Paper page
- Levy P, Williams J: The Social Context of Performance Appraisal: A Review and Framework for the Future. Journal of Management. 2004, 30 (6): 881-905. · DOI · Paper page
- Rowan MS, Hogg W, Martin C, Vilis E: Family physicians' reactions to performance assessment feedback. Can Fam Physician. 2006, 52 (12): 1570-1571.
- McAlearney AS, Chisolm DJ, Schweikhart S, Medow MA, Kelleher K: The story behind the story: physician skepticism about relying on clinical information technologies to reduce medical errors. Int J Med Inform. 2007, 76 (11-12): 836-842. 10.1016/j.ijmedinf.2006.09.021. · DOI
- Sandelowski M: Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. Res Nurs Health. 2000, 23 (3): 246-255. 10.1002/1098-240X(200006)23:3<246::AID-NUR9>3.0.CO;2-H. · DOI · Paper page
- Doroodchi H, Abdolrasulnia M, Foster JA, Foster E, Turakhia MP, Skelding KA, Sagar K, Casebeer LL: Knowledge and attitudes of primary care physicians in the management of patients at risk for cardiovascular events. BMC Fam Pract. 2008, 9: 42-10.1186/1471-2296-9-42. · DOI · Paper page
- Berthold HK, Gouni-Berthold I, Bestehorn KP, Bohm M, Krone W: Physician gender is associated with the quality of type 2 diabetes care. J Intern Med. 2008, 264 (4): 340-50. 10.1111/j.1365-2796.2008.01967.x. · DOI · Paper page
- Kuzel AJ: Sampling in Qualitative Inquiry. Doing Qualitative Research. Research Methods for Primary Care. Edited by: Crabtree B, Miller W. 1992, California: Sage Publications, 3: 41.
- Pope C, Ziebland S, Mays N: Qualitative research in health care. Analysing qualitative data. BMJ. 2000, 320 (7227): 114-116. 10.1136/bmj.320.7227.114. · DOI · Paper page
- Jones NE, Suurdt J, Ouelette-Kuntz H, Heyland DK: Implementation of the Canadian Clinical Practice Guidelines for Nutrition Support: a multiple case study of barriers and enablers. Nutr Clin Pract. 2007, 22 (4): 449-457. 10.1177/0115426507022004449. · DOI · Paper page
- Wolf ZR: Exploring the audit trail for qualitative investigations. Nurse Educ. 2003, 28 (4): 175-178. 10.1097/00006223-200307000-00008. · DOI · Paper page
- Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070. · DOI · Paper page
Cited by
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationMichie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680
Self-citationFrancis, J. J., O’Connor, D., & Curran, J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-35 · Cited by 484
“There were four systematic reviews in which the theoretical domains were investigated as mediators of behaviour change [17-20], two randomised studies [21,22], and one protocol for a process evaluation study to explain trial effects in the context of a randomised trial [23].”
Self-citationIvers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-14 · Cited by 400
Self-citationIvers, N. M., Grimshaw, J. M., Jamtvedt, G., Flottorp, S., O’Brien, M. A., French, S. D., Young, J., & Odgaard-Jensen, J. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-2913-y · Cited by 382
Self-citation
Metadata
- Authors
- Ivers, N. M., Tu, K., Francis, J., Barnsley, J., Shah, B., Upshur, R., Kiss, A., Grimshaw, J. M., & Zwarenstein, M.
- Venue
- Implementation Science
- Published
- 2010-12
- Volume
- 5
- Issue
- 1
- Pages
- 98-98
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2140798854
- Cited by
- 27
- References
- 21
- FWCI
- 2.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. https://app.cochat.ai/papers/10.1186/1748-5908-5-98
- The paper
- Ivers, N. M., Tu, K., Francis, J., Barnsley, J., Shah, B., Upshur, R., Kiss, A., Grimshaw, J. M., & Zwarenstein, M. (2010). Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implementation Science. https://doi.org/10.1186/1748-5908-5-98
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.