CoChat

Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care

Open access
Ivers, Noah M, Tu, Karen, Francis, Jill, Barnsley, Jan, Shah, Baiju, Upshur, Ross, Kiss, Alex, Grimshaw, Jeremy M, Zwarenstein, Merrick · 2010 · Implementation Science
Cited by 27

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Audit and feedback to physicians is commonly used alone or as part of multifaceted interventions. While it can play an important role in quality improvement, the optimal design of audit and feedback is unknown. This study explores how feedback can be improved to increase acceptability and usability in primary care. The trial seeks to determine whether a theory-informed worksheet appended to feedback reports can help family physicians improve quality of care for their patients with diabetes and/or ischemic heart disease. METHODS: Two-arm cluster trial was conducted with participating primary care practices allocated using minimization to simple feedback or enhanced feedback group. The simple feedback group receives performance feedback reports every six months for two years regarding the proportion of their patients with diabetes and/or ischemic heart disease who are meeting quality targets. The enhanced feedback group receives these same reports as well as a theory-informed worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Participants are family physicians from across Ontario who use electronic medical records; data for rostered patients are used to produce the feedback reports and for analysis. OUTCOMES: The primary disease outcomes are the blood pressure (BP), and low-density lipoprotein cholesterol (LDL) levels. The primary process measure is a composite score indicating the number of recommended activities (e.g., tests and prescriptions) conducted by the family physicians for their patients with diabetes and/or ischemic heart disease within the appropriate timeframe. Secondary outcomes are the proportion of patients whose results meet targets for glucose, LDL, and BP as well as the percent of patients receiving relevant prescriptions. A qualitative process evaluation using semi-structured interviews will explore perceived barriers to behaviour change in response to feedback reports and preferences with regard to feedback design. ANALYSIS: Intention-to-treat approach will be used to analyze the trial. Analysis will be performed on patient-level variables using generalized estimating equation models to adjust for covariates and account for the clustered nature of the data. The trial is powered to show small, but clinically important differences of 7 mmHG in systolic BP and 0.32 mmol/L in LDL. TRIAL REGISTRATION: ClinicalTrials.gov NCT00996645.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1748-5908-5-98

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 42

  1. Haffner SM, Lehto S, Ronnemaa T, Pyorala K, Laakso M: Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998, 339 (4): 229-234. 10.1056/NEJM199807233390404. · DOI · Paper page
  2. Burge FI, Bower K, Putnam W, Cox JL: Quality indicators for cardiovascular primary care. Can J Cardiol. 2007, 23 (5): 383-388. · DOI
  3. Narayan KM, Benjamin E, Gregg EW, Norris SL, Engelgau MM: Diabetes translation research: where are we and where do we want to be?. Ann Intern Med. 2004, 140 (11): 958-963. · DOI · Paper page
  4. Davis D, Davis N: Educational Interventions. Knowledge Translation in Health Care - Moving from Evidence to Practice. Edited by: Straus S, Tetroe J, Graham ID. 2009, UK: Wiley-Blackwell, 116.
  5. Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296 (4): 427-440. 10.1001/jama.296.4.427. · DOI · Paper page
  6. Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995, 153 (10): 1423-1431.
  7. Kluger AN, DeNisi A: The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychol Bull. 1996, 119 (2): 254-284. 10.1037/0033-2909.119.2.254. · DOI · Paper page
  8. Carver CS, Scheier MF: Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982, 92 (1): 111-135. 10.1037/0033-2909.92.1.111. · doi:10.1037/0033-2909.92.1.111 · Paper page
  9. Gollwitzer PM: Implementation Intentions. Am Psychol. 1999, 54 (7): 493-503. 10.1037/0003-066X.54.7.493. · DOI · Paper page
  10. Locke EA: A theory of goal setting & task performance. 1990, Englewood Cliffs, N.J.: Prentice Hall
  11. Bandura A: Self-efficacy. Encyclopedia of human behavior. Edited by: Ramachandran VS. 1994, Toronto: Academic Press, 71-81.
  12. Ajzen I, Manstead ASR: Changing health-related behaviors: An approach based on the theory of planned behavior. The scope of social psychology: Theory and applications. Edited by: van den Bos K, Hewstone M, de Wit J, Schut H, Stroebe M. 2007, New York: Psychology Press, 43-63.
  13. Gollwitzer PM, Fujita K, Oettingen G: Planning and the Implementation of Goals. Handbook of self-regulation: research, theory, and applications. Edited by: Baumeister RF, Vohs KD. 2004, New York: Guilford Press, 211-228.
  14. Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14. · DOI · Paper page
  15. Tu K, Klein-Geltink J, Mitiku TF, Mihai C, Martin J: De-identification of primary care electronic medical records free-text data in Ontario, Canada. BMC Med Inform Decis Mak. 2010, 10: 35-10.1186/1472-6947-10-35. · DOI
  16. Tu K, Manuel D, Lam K, Kavanagh D, Mitiku TF, Guo H: Diabetics can be identified in an electronic medical record using laboratory tests and prescriptions. J Clin Epidemiol. 2010,
  17. Ivers NM, Pylypenko B, Tu K: Identifying Ischemic Heart Disease in an Electronic Medical Record. Journal of Primary Care and Community Health,
  18. Jackson GL, Weinberger M: A decade with the chronic care model: some progress and opportunity for more. Med Care. 2009, 47 (9): 929-931. 10.1097/MLR.0b013e3181b63537. · DOI
  19. Luszczynska A, Haynes C: Changing nutrition, physical activity and body weight among student nurses and midwives: effects of a planning intervention and self-efficacy beliefs. J Health Psychol. 2009, 14 (8): 1075-1084. 10.1177/1359105309342290. · DOI · Paper page
  20. Shershneva MB, Wang MF, Lindeman GC, Savoy JN, Olson CA: Commitment to Practice Change: An Evaluator's Perspective. Eval Health Prof. 2010, 33 (3): 256-75. 10.1177/0163278710363960. · DOI
  21. Wakefield JG: Commitment to change: exploring its role in changing physician behavior through continuing education. J Contin Educ Health Prof. 2004, 24 (4): 197-204. 10.1002/chp.1340240403. · DOI
  22. Mazmanian PE, Johnson RE, Zhang A, Boothby J, Yeatts EJ: Effects of a signature on rates of change: a randomized controlled trial involving continuing education and the commitment-to-change model. Acad Med. 2001, 76 (6): 642-646. 10.1097/00001888-200106000-00018. · DOI
  23. Overton GK, MacVicar R: Requesting a commitment to change: conditions that produce behavioral or attitudinal commitment. J Contin Educ Health Prof. 2008, 28 (2): 60-66. 10.1002/chp.158. · DOI
  24. Hewitt CE, Torgerson DJ: Is restricted randomisation necessary?. BMJ. 2006, 332 (7556): 1506-1508. 10.1136/bmj.332.7556.1506. · DOI · Paper page
  25. Bhattacharyya OK, Estey EA, Cheng AY, Canadian Diabetes Association 2008: Update on the Canadian Diabetes Association 2008 clinical practice guidelines. Can Fam Physician. 2009, 55 (1): 39-43.
  26. Genest J, McPherson R, Frohlich J, Anderson T, Campbell N, Carpentier A, Couture P, Dufour R, Fodor G, Francis GA, Grover S, Gupta M, Hegele RA, Lau DC, Leiter L, Lewis GF, Lonn E, Mancini GB, Ng D, Pearson GJ, Sniderman A, Stone JA, Ur E: 2009 Canadian Cardiovascular Society/Canadian guidelines for the diagnosis and treatment of dyslipidemia and prevention of cardiovascular disease in the adult - 2009 recommendations. Can J Cardiol. 2009, 25 (10): 567-579. · DOI · Paper page
  27. Cooper A, Skinner J, Nherera L, Feder G, Ritchie G, Kathoria M, Turnbull N, Shaw G, MacDermott K, Minhas R, Packham C, Squires H, Thomson D, Timmis A, Walsh J, Williams H, White A: Clinical Guidelines and Evidence Review for Post Myocardial Infarction: Secondary prevention in primary and secondary care for patients following a myocardial infarction. Anonymous London: National Collaborating Centre for Primary Care and Royal College of General Practitioners. 2007, [Anonymous]
  28. Holbrook A, Thabane L, Keshavjee K, Dolovich L, Bernstein B, Chan D, Troyan S, Foster G, Gerstein H, COMPETE II Investigators: Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. CMAJ. 2009, 181 (1-2): 37-44. · DOI · Paper page
  29. Canadian Hypertension Education Program, Campbell N, Kwong MM: 2010 Canadian Hypertension Education Program recommendations: An annual update. Can Fam Physician. 2010, 56 (7): 649-653.
  30. Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. 2000, New York: Oxford University Press
  31. Kizer JR, Madias C, Wilner B, Vaughan CJ, Mushlin AI, Trushin P, Gotto AM, Pasternak RC: Relation of different measures of low-density lipoprotein cholesterol to risk of coronary artery disease and death in a meta-regression analysis of large-scale trials of statin therapy. Am J Cardiol. 2010, 105 (9): 1289-1296. 10.1016/j.amjcard.2009.12.051. · DOI · Paper page
  32. Levy P, Williams J: The Social Context of Performance Appraisal: A Review and Framework for the Future. Journal of Management. 2004, 30 (6): 881-905. · DOI · Paper page
  33. Rowan MS, Hogg W, Martin C, Vilis E: Family physicians' reactions to performance assessment feedback. Can Fam Physician. 2006, 52 (12): 1570-1571.
  34. McAlearney AS, Chisolm DJ, Schweikhart S, Medow MA, Kelleher K: The story behind the story: physician skepticism about relying on clinical information technologies to reduce medical errors. Int J Med Inform. 2007, 76 (11-12): 836-842. 10.1016/j.ijmedinf.2006.09.021. · DOI
  35. Sandelowski M: Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. Res Nurs Health. 2000, 23 (3): 246-255. 10.1002/1098-240X(200006)23:3<246::AID-NUR9>3.0.CO;2-H. · DOI · Paper page
  36. Doroodchi H, Abdolrasulnia M, Foster JA, Foster E, Turakhia MP, Skelding KA, Sagar K, Casebeer LL: Knowledge and attitudes of primary care physicians in the management of patients at risk for cardiovascular events. BMC Fam Pract. 2008, 9: 42-10.1186/1471-2296-9-42. · DOI · Paper page
  37. Berthold HK, Gouni-Berthold I, Bestehorn KP, Bohm M, Krone W: Physician gender is associated with the quality of type 2 diabetes care. J Intern Med. 2008, 264 (4): 340-50. 10.1111/j.1365-2796.2008.01967.x. · DOI · Paper page
  38. Kuzel AJ: Sampling in Qualitative Inquiry. Doing Qualitative Research. Research Methods for Primary Care. Edited by: Crabtree B, Miller W. 1992, California: Sage Publications, 3: 41.
  39. Pope C, Ziebland S, Mays N: Qualitative research in health care. Analysing qualitative data. BMJ. 2000, 320 (7227): 114-116. 10.1136/bmj.320.7227.114. · DOI · Paper page
  40. Jones NE, Suurdt J, Ouelette-Kuntz H, Heyland DK: Implementation of the Canadian Clinical Practice Guidelines for Nutrition Support: a multiple case study of barriers and enablers. Nutr Clin Pract. 2007, 22 (4): 449-457. 10.1177/0115426507022004449. · DOI · Paper page
  41. Wolf ZR: Exploring the audit trail for qualitative investigations. Nurse Educ. 2003, 28 (4): 175-178. 10.1097/00006223-200307000-00008. · DOI · Paper page
  42. Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070. · DOI · Paper page

Cited by

See all 27

Metadata

Authors
Ivers, N. M., Tu, K., Francis, J., Barnsley, J., Shah, B., Upshur, R., Kiss, A., Grimshaw, J. M., & Zwarenstein, M.
Venue
Implementation Science
Published
2010-12
Volume
5
Issue
1
Pages
98-98
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2140798854
Cited by
27
References
21
FWCI
2.79
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. https://app.cochat.ai/papers/10.1186/1748-5908-5-98
The paper
Ivers, N. M., Tu, K., Francis, J., Barnsley, J., Shah, B., Upshur, R., Kiss, A., Grimshaw, J. M., & Zwarenstein, M. (2010). Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implementation Science. https://doi.org/10.1186/1748-5908-5-98

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.