Evaluating the Message: The Relationship Between Compliance Rate and the Subject of a Practice Guideline
The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Abstract
To explore the relationship between providers' compliance and some key aspects of the clinical messages in practice guidelines, studies published in the English language medical literature between 1980 and 1991 were retrieved through MEDLINE and through relevant review articles in the field. All published studies providing compliance rates with practice guidelines and endorsed by official organizations were eligible for the study. The clinical content and the reported compliance rate were gathered for each recommendation in the 23 studies selected. The medical and surgical procedures addressed by 143 recommendations were identified according to specialty area, type of procedure (diagnostic, surgical, etc.) and were independently classified by the authors as being high or low on characteristics thought to influence diffusion:complexity, trialability and observability. The mean compliance rate with the 143 clinical recommendations was 54.5% (95% CI: 50.2%-58.9%), with those in the specialty areas of cardiology and oncology showing the highest compliance (mean 63.6% and 62.2%, respectively). Recommendations concerning procedures with high complexity had lower compliance rates than those low on complexity (41.9% vs. 55.9%; P = 0.05), and those judged to be high on trialability had higher compliance rates than those low on trialability (55.6% vs 36.8%; P = 0.03). Overall, all the characteristics of the clinical recommendations considered in the practice guidelines could account for no more than 47% of the observed variability in compliance rates. The target area of practice and the complexity and trialability of the recommended procedure appear to be useful, if partial, predictors of the level of compliance with a practice guideline.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interventions that were complex were often associated with lower adoption [3, 35, 39, 87, 88].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [88]
In the citing paper
“The complexity of clinical practice recommendations and the degree to which benefits can readily be observed may play an important role [21,38-40].”
From No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention (2014) · cites this paper as [38]
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Applied Regression Analysis and Other Multivariable Methods
Walker, E. (1989) · Technometrics · doi:10.1080/00401706.1989.10488486 · Cited by 8,538
Applied Nonparametric Statistics
Wozniak, P. J., & Daniel, W. W. (1991) · Technometrics · doi:10.2307/1268795 · Cited by 4,987
Do Practice Guidelines Guide Practice?
Lomas, J., Anderson, G. M., Domnick-Pierre, K., Vayda, E., Enkin, M. W., & Hannah, W. J. (1989) · New England Journal of Medicine · doi:10.1056/nejm198911093211906 · Cited by 1,234
Self-citationDoctors' decisions and the cost of medical care
Samet, J. H. (1987) · Social Science & Medicine · doi:10.1016/0277-9536(87)90029-3 · Cited by 326
Words Without Action? The Production, Dissemination, and Impact of Consensus Recommendations
Lomas, J. (1991) · Annual Review of Public Health · doi:10.1146/annurev.pu.12.050191.000353 · Cited by 303
Self-citationMcPhee, S. J., Richard, R. J., & Solkowitz, S. N. (1986) · Journal of General Internal Medicine · doi:10.1007/bf02596202 · Cited by 241
Lomas, J., Enkin, M., Anderson, G., Hannah, W. J., Vayda, E., & Singer, J. (1991) · PubMed · Cited by 223
Self-citationLomas, J., & Haynes, R. B. (1988) · PubMed · Cited by 222
Self-citationPreventive care: do we practice what we preach?
Lurie, N., Manning, W. G., Peterson, C., Goldberg, G. A., Phelps, C. A., & Lillard, L. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.7.801 · Cited by 219
Cited by
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
“Innovations that are perceived by key players as simple to use are more easily adopted (for strong direct evidence, see Denis et al. 2002; Grilli and Lomas 1994; Marshall 1990; Meyer and Goes 1988; Meyer, Johnson, and Ethington 1997; and Rogers 1995).”
BackgroundWhy Don't Physicians Follow Clinical Practice Guidelines?: A Framework for Improvement
Cabana, M. D., Rand, C. S., Powe, N. R., Wu, A. W., Wilson, M. H., Abboud, P.-A. C., & Rubin, H. R. (1999) · JAMA · doi:10.1001/jama.282.15.1458 · Cited by 6,677
“Trialability of a guideline and its complexity are also described as significant predictors of adoption.(105) Trialability is “the degree to which an innovation may be experimented with on a limited basis.”
BackgroundFrom best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Self-citation(2001) · PubMed · Cited by 1,709
Self-citation
Metadata
- Authors
- Grilli, R., & Lomas, J.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Grilli, Roberto
- Lomas, Jonathan
- ORCID
- Grilli, Roberto
- Venue
- Medical Care
- Published
- 1994-03
- Volume
- 32
- Issue
- 3
- Pages
- 202-213
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W1993763497
- Cited by
- 392
- References
- 36
- Citations by year
- 2025: 4 · 2024: 3 · 2023: 4 · 2022: 3 · 2021: 5 · 2020: 13 · 2019: 9 · 2018: 11 · 2017: 12 · 2016: 12 · 2015: 17 · 2014: 15 · 2013: 12 · 2012: 17
- FWCI
- 9.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Care (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- clinical guidelines, diffusion of innovations, complexity, trialability, observability, medical procedures
- MeSH terms
- Cardiology, Dentistry, Gynecology, Medical Oncology, Medicine, Obstetrics, Practice Patterns, Physicians', Preventive Medicine, Specialization, Practice Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the Message: The Relationship Between Compliance Rate and the Subject of a Practice Guideline. https://app.cochat.ai/papers/10.1097/00005650-199403000-00002
- The paper
- Grilli, R., & Lomas, J. (1994). Evaluating the Message: The Relationship Between Compliance Rate and the Subject of a Practice Guideline. Medical Care. https://doi.org/10.1097/00005650-199403000-00002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.