Measuring provider adherence to tobacco treatment guidelines: A comparison of electronic medical record review, patient survey, and provider survey
The DOI matches its Crossref record.
Abstract
An accurate method of measuring primary care providers' tobacco counseling actions is needed for monitoring adherence to clinical practice guidelines. We compared three methods of measuring providers' tobacco counseling practices: electronic medical record (EMR) review, patient survey, and provider survey. We mailed a survey to 1,613 smokers seen by 114 Boston-area primary care providers during a 2-month period to assess what tobacco counseling actions had occurred at the visit (N = 766; 47% response rate). Smokers' reports were compared with the EMR and with their providers' self-reported usual tobacco counseling practices, derived from a provider survey (N = 110; 96% response rate). Patients reported receiving each counseling action more frequently than providers documented it in the EMR. Agreement between the patient survey and the EMR was poor for all 5A steps (kappa statistic = 0.01-0.22). Providers reported that they often or always performed each 5A action at a higher rate than indicated by EMR or patient report. However, providers who said they often or always performed individual 5A steps did not have consistently higher mean rates of EMR documentation or patient report than those who said they performed the 5A's less frequently. Little agreement was found among the three methods of measuring primary care providers' tobacco counseling actions. Implementing an EMR does not necessarily improve providers' documentation of tobacco interventions, but EMR adaptations that would standardize provider documentation of tobacco counseling might make the EMR a more reliable tool for monitoring providers' delivery of tobacco treatment services.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 19
- Boyle, R, Solberg, L. I. Is making smoking status a vital sign sufficient to increase cessation support actions in clinical practice? Annals of Family Medicine, 2004; 2: 22–25
- Centers for Disease Control and Prevention. Tobacco use—United States, 1990–1999. Morbidity and Mortality Weekly Report, 1999; 48: 986–993
- Ellerbeck, E. F, Ahluwalia, J. S, Jolicoeur, D. G, Gladden, J, Mosier, M. C. Direct observation of smoking cessation practices in primary care practice. Journal of Family Practice, 2001; 50: 688–693
- Grant, D. Documentation for the sake of documentation. Circulation, 1999; 100: 1461 · doi:10.1161/01.cir.100.13.1461
- Lancaster, T, Stead, L, Silagy, C, Sowden, A. Effectiveness of interventions to help people stop smoking: Findings from the Cochrane Library. British Medical Journal, 2000; 321: 355–358 · DOI · Paper page
- McBride, P. E, Plane, M. B, Underbakke, G, Brown, R. L, Solberg, L. I. Smoking screening and management in primary care practices. Archives of Family Medicine, 1997; 6: 165–172 · DOI
- Milch, C. E, Edmundson, J. M, Beshansky, J. R, Griffith, J. L, Selker, H. P. Smoking cessation in primary care: A clinical effectiveness trial of two simple interventions. Preventive Medicine, 2003; 38: 284–294 · DOI
- Montano, D. E, Phillips, W. R. Cancer screening by primary care physicians: A comparison of rates obtained from physician self‐report, patient survey, and chart audit. American Journal of Public Health, 1995; 85: 795–800 · DOI · Paper page
- Nicholson, J. M, Hennrikus, D. J, Lando, H. A, McCarty, M. C, Vessey, J. Patient recall versus physician documentation in report of smoking cessation counseling performed in an inpatient setting. Tobacco Control, 2000; 9: 382–388 · DOI · Paper page
- Pbert, L, Adams, A, Quirk, M, Hebert, J. R, Ockene, J. K, Luippold, R. S. Patient exit interview as an assessment of physician‐delivered smoking intervention: A validation study. Health Psychology, 1999; 18: 183–188 · DOI · Paper page
- Piper, M. E, Fiore, M. C, Smith, S. S, Jorenby, D. E, Wilson, J. R, Zehner, M. E, Baker, T. B. Use of the vital sign stamp as a systematic screening tool to promote smoking cessation. Mayo Clinic Proceedings, 2003; 78: 716–722 · DOI
- Schneider, E. C, Riehl, V, Courte‐Wienecke, S, Eddy, D. M, Sennett, C. Enhancing performance measurement: NCQA's road map for a health information framework. The Journal of the American Medical Association, 1999; 282: 1184–1190 · DOI · Paper page
- Soto, C. M, Kleinman, K. P, Simon, S. R. Quality and correlates of medical record documentation in the ambulatory care setting. Biomedical Central Health Services Research, 2002; 2: 22 · DOI · Paper page
- Spenser, E, Swanson, T, Hueston, W. J, Edberg, D. L. Tools to improve documentation of smoking status: Continuous quality improvement and electronic medical records. Archives of Family Medicine, 1999; 8: 18–22 · DOI
- Stange, K. C, Zyzanski, S. J, Smith, T. F, Kelly, R, Langa, D. M, Flocke, S. A, Jaen, C. R. How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patient visits. Medical Care, 1998; 36: 851–867 · DOI · Paper page
- Tang, P. C, LaRosa, M. P, Gorden, S. M. Use of computer‐based records, completeness of documentation, and appropriateness of documented clinical decisions. Journal of the American Medical Informatics Association, 1999; 6: 245–251 · DOI · Paper page
- Thorndike, A. N, Rigotti, N. A, Stafford, R. S, Singer, D. E. National patterns in the treatment of smokers by physicians. The Journal of the American Medical Association, 1998; 279: 604–608 · DOI · Paper page
- Ward, J, Sanson‐Fisher, R. Accuracy of patient recall of opportunistic smoking cessation advice in general practice. Tobacco Control, 1996; 5: 110–113 · DOI · Paper page
- Wilson, A, McDonald, P. Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. British Medical Journal, 1994; 309: 1483–1485 · DOI · Paper page
Cited by
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216
Chan, K. S., Fowles, J. B., & Weiner, J. P. (2010) · Medical Care Research and Review · doi:10.1177/1077558709359007 · Cited by 365
Wiggers, J., McElwaine, K., Freund, M., Campbell, L., Bowman, J., Wye, P., Wolfenden, L., Tremain, D., Barker, D., Slattery, C., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0636-2 · Cited by 37
Hung, D. Y., & Shelley, D. R. (2009) · Health Services Research · doi:10.1111/j.1475-6773.2008.00896.x · Cited by 31
Internet delivered support for tobacco control in dental practice: randomized controlled trial
Houston, T. K., Richman, J. S., Ray, M. N., Allison, J. J., Gilbert, G. H., Shewchuk, R. M., Kohler, C. L., Kiefe, C. I., & DPBRN Collaborative Group (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1095 · Cited by 27
Metadata
- Authors
- Conroy, M., Majchrzak, N., Silverman, C., Chang, Y., Regan, S., Schneider, L., & Rigotti, N.
- Venue
- Nicotine & Tobacco Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-04
- Volume
- 7
- Issue
- 2
- Pages
- 35-43
- ISSN
- 1462-2203 (ISSN-L)
- OpenAlex
- W2121061289
- Cited by
- 119
- References
- 0
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring provider adherence to tobacco treatment guidelines: A comparison of electronic medical record review, patient survey, and provider survey. https://app.cochat.ai/papers/10.1080/14622200500078089
- The paper
- Conroy, M., Majchrzak, N., Silverman, C., Chang, Y., Regan, S., Schneider, L., & Rigotti, N. (2005). Measuring provider adherence to tobacco treatment guidelines: A comparison of electronic medical record review, patient survey, and provider survey. Nicotine & Tobacco Research. https://doi.org/10.1080/14622200500078089
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.