A systematic review of the use of theory in randomized controlled trials of audit and feedback
Open accessThe DOI matches its Crossref record; 78 of the 80 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Audit and feedback is one of the most widely used and promising interventions in implementation research, yet also one of the most variably effective. Understanding this variability has been limited in part by lack of attention to the theoretical and conceptual basis underlying audit and feedback. Examining the extent of theory use in studies of audit and feedback will yield better understanding of the causal pathways of audit and feedback effectiveness and inform efforts to optimize this important intervention. METHODS: A total of 140 studies in the 2012 Cochrane update on audit and feedback interventions were independently reviewed by two investigators. Variables were extracted related to theory use in the study design, measurement, implementation or interpretation. Theory name, associated reference, and the location of theory use as reported in the study were extracted. Theories were organized by type (e.g., education, diffusion, organization, psychology), and theory utilization was classified into seven categories (justification, intervention design, pilot testing, evaluation, predictions, post hoc, other). RESULTS: A total of 20 studies (14%) reported use of theory in any aspect of the study design, measurement, implementation or interpretation. In only 13 studies (9%) was a theory reportedly used to inform development of the intervention. A total of 18 different theories across educational, psychological, organizational and diffusion of innovation perspectives were identified. Rogers' Diffusion of Innovations and Bandura's Social Cognitive Theory were the most widely used (3.6% and 3%, respectively). CONCLUSIONS: The explicit use of theory in studies of audit and feedback was rare. A range of theories was found, but not consistency of theory use. Advancing our understanding of audit and feedback will require more attention to theoretically informed studies and intervention design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, most A&F interventions tested in RCTs are designed without explicitly building on previous research or extant theory [5,6].”
From No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention (2014) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Yet few studies have methodically examined their use in practice or research [16].”
From Scoping review identifies significant number of knowledge translation theories, models, and frameworks with limited use (2018) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Adopting these guidelines would address many of the current problems that make it difficult to interpret and use findings from implementation research, such as inconsistent labelling, poor descriptions, and unclear justification for specific implementation strategies [9-11,13].”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [11]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“are rarely justified theoretically [10,11]”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“Almost all of the methods found (13/15) used theory at some point in the tasks for intervention design, yet evidence indicates theory is rarely used in the design of interventions, or at least rarely reported [39, 40].”
From Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review (2017) · cites this paper as [39]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“Inter-rater reliability was calculated for pre-consensus category assignment using the Kappa statistic to determine consistency across reviewers [14].”
MethodSelf-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
(1975) · PhilPapers (PhilPapers Foundation) · Cited by 36,737
Self-efficacy: the exercise of control
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1826 · Cited by 24,281
(1985) · Medical Entomology and Zoology · Cited by 19,180
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,207
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J., Gurdon, M., Jick, T., Petit, A., Stern, R., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,945
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1×
“This is despite Medical Research Council (MRC) guidelines recommending theory use for complex intervention design [58,59], and an increased prevalence of discourse on the imperative for theory in implementation studies [7,60].”
BackgroundSelf-citation‘Small Changes' to Diet and Physical Activity Behaviors for Weight Management
Hills, A. P., Byrne, N. M., Lindstrom, R., & Hill, J. O. (2013) · Obesity Facts · doi:10.1159/000345030 · Cited by 9,493
Research works printed but not linked: 4
- Coles C, Holm HA: Learning in medicine: towards a theory of medical education. Learning in Medicine: Towards a Theory of Medical Education. 1993, 189-209.
- Rogers E: M.(1983). Diffusion of Innovations. 1983, New York: The Free Press
- Prochaska JO, DiClemente CC:Towards a comprehensive model of change: Stages of change and addictive behaviour. Treating Addictive Behaviours. Edited by: Miller W, Heather N. 1998, New York: Plenum Press, 3-24. 2,
- de Almeida Neto AC, Benrimoj SI, Kavanagh DJ, Boakes RA: Novel educational training program for community pharmacists. Am J Pharm Educ. 2000, 64: 302-306.
Cited by
Atkins, L., Francis, J., Islam, R., O’Connor, D., Patey, A., Ivers, N., Foy, R., Duncan, E. M., Colquhoun, H., Grimshaw, J. M., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0605-9 · Cited by 3,819
“Despite this, systematic reviews of interventions designed to change professional practice have shown only small numbers of rigorous evaluations reporting the use of theory to assess implementation problems or guide intervention design [8, 13, 14].”
BackgroundSelf-citationImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
“Adopting these guidelines would address many of the current problems that make it difficult to interpret and use findings from implementation research, such as inconsistent labelling, poor descriptions, and unclear justification for specific implementation strategies [9-11,13].”
BackgroundA systematic review of the use of the Consolidated Framework for Implementation Research
Kirk, M. A., Kelley, C., Yankey, N., Birken, S. A., Abadie, B., & Damschroder, L. (2015) · Implementation Science · doi:10.1186/s13012-016-0437-z · Cited by 1,496
“theory/frameworks into empirical studies [29, 30].”
Interventions to improve the appropriate use of polypharmacy for older people
Patterson, S. M., Cadogan, C. A., Kerse, N., Cardwell, C. R., Bradley, M. C., Ryan, C., & Hughes, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008165.pub3 · Cited by 754
Boyce, M. B., Browne, J. P., & Greenhalgh, J. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-002524 · Cited by 505
Metadata
- Authors
- Colquhoun, H. L., Brehaut, J. C., Sales, A., Ivers, N., Grimshaw, J., Michie, S., Carroll, K., Chalifoux, M., & Eva, K. W.
- Affiliations
- Ottawa Hospital (CA)
- University of Michigan (US)
- Women's College Hospital (CA)
- University College London (GB)
- University of British Columbia (CA)
- Corresponding author
- Colquhoun, Heather L
- ORCID
- Venue
- Implementation Science
- Published
- 2013-06-10
- Volume
- 8
- Issue
- 1
- Pages
- 66-66
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3702512
- OpenAlex
- W2104326666
- Cited by
- 231
- References
- 80
- Citations by year
- 2026: 13 · 2025: 6 · 2024: 29 · 2023: 15 · 2022: 24 · 2021: 32 · 2020: 23 · 2019: 22 · 2018: 13 · 2017: 15 · 2016: 16 · 2015: 12 · 2014: 8 · 2013: 2
- FWCI
- 1.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- cIRcle (University of British Columbia) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- University of Ottawa
- University of Toronto
- Canadian Institutes of Health Research (KTE 111-413)
- Department of Family and Community Medicine, University of Toronto
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Keywords
- audit and feedback, theory application, implementation research, diffusion of innovations, social cognitive theory, intervention design, causal pathways
- MeSH terms
- Diffusion of Innovation, Feedback, Humans, Medical Audit, Research Design, Observer Variation, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of the use of theory in randomized controlled trials of audit and feedback. https://app.cochat.ai/papers/10.1186/1748-5908-8-66
- The paper
- Colquhoun, H. L., Brehaut, J. C., Sales, A., Ivers, N., Grimshaw, J., Michie, S., Carroll, K., Chalifoux, M., & Eva, K. W. (2013). A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implementation Science. https://doi.org/10.1186/1748-5908-8-66
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.