Development of a Scale to Measure Practitioner Adherence to a Brief Intervention in the Emergency Department
Open accessAbstract
Brief intervention (BI) can reduce harmful and hazardous drinking among emergency department patients. However, no psychometrically-validated instrument for evaluating the extent to which practitioners correctly implement BIs in clinical practice (e.g., adherence) exists. We developed and subsequently examined the psychometric properties of a scale that measures practitioner adherence to a BI, namely the Brief Negotiation Interview (BNI). Ratings of 342 audiotaped BIs in the emergency department demonstrated that the BNI Adherence Scale (BAS) has: (1) excellent internal consistency and discriminant validity; (2) good to excellent inter-rater reliability, and (3) good construct validity, with an eight-item, two-factor structure accounting for 62% of the variance, but (4) no predictive validity in this study. The BAS provides practitioners with a brief, objective method to evaluate their BNI skills and give feedback to them about their performance.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The BI Assessment Scale has good psychometric properties including inter- and intra-rater reliability with Kappa and ICC values above 0.80 and a strong ability to differentiate standard PPKAY sessions with poorly performed PPKAY sessions.
“In prior work, our team adapted and validated the BI Assessment Scale [60] to the Tanzanian setting. It has good psychometric properties including inter- and intra-rater reliability with Kappa and ICC values above 0.80 and a strong ability to differentiate standard PPKAY sessions with poorly performed PPKAY sessions.”
Overall, 76% of the PPKAY interventions delivered had 19 or more of the 22 critical actions as recommended in the BI Assessment Scale.
“Overall, 76% of the PPKAY interventions delivered had 19 or more of the 22 critical actions as recommended in the BI Assessment Scale [37,60].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · see citing works
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349 · see citing works
Motivational interviewing: preparing people for change.
Miller, W. R., & Rollnick, S. (2002) · Cited by 7,002 · see citing works
(2001) · Cited by 5,455 · see citing works
Sobell, L. C., & Sobell, M. B. (1992) · Measuring Alcohol Consumption · doi:10.1007/978-1-4612-0357-5_3 · Cited by 4,110 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Toward a theory of motivational interviewing
Miller, W. R., & Rose, G. S. (2009) · American Psychologist · doi:10.1037/a0016830 · Cited by 1,603 · see citing works
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075 · see citing works
Timeline Follow-Back: A Technique for Assessing Self-Reported Alcohol Consumption
Sobell, L. C., & Sobell, M. B. (1992) · NSUWorks (Nova Southeastern University) · Cited by 779 · see citing works
Client commitment language during motivational interviewing predicts drug use outcomes.
Amrhein, P. C., Miller, W. R., Yahne, C. E., Palmer, M., & Fulcher, L. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.5.862 · Cited by 729 · see citing works
Is There Time for Management of Patients With Chronic Diseases in Primary Care?
Ostbye, T. (2005) · The Annals of Family Medicine · doi:10.1370/afm.310 · Cited by 698 · see citing works
Madras, B. K., Compton, W. M., Avula, D., Stegbauer, T., Stein, J. B., & Clark, H. W. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.08.003 · Cited by 663 · see citing works
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657 · see citing works
Fals-Stewart, W., O'Farrell, T., Freitas, T. T., McFarlin, S., & Rutigliano, P. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.1.134 · Cited by 644 · see citing works
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638 · see citing works
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628 · see citing works
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533 · see citing works
Carroll, K. M. (2000) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(99)00049-6 · Cited by 386 · see citing works
D’Onofrio, G., & Degutis, L. C. (2002) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2002.tb02304.x · Cited by 379 · see citing works
Self-citationEvaluation of model fit indices for latent variable models with categorical and continuous outcomes
Yu, C.-Y. (2002) · Medical Entomology and Zoology · Cited by 373 · see citing works
Factor Analysis: An Applied Approach
Jackson, J. E. (1985) · Technometrics · doi:10.1080/00401706.1985.10488039 · Cited by 372 · see citing works
Gentilello, L. M., Ebel, B. E., Wickizer, T. M., Salkever, D. S., & Rivara, F. P. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000157133.80396.1c · Cited by 293 · see citing works
Havard, A., Shakeshaft, A., & Sanson‐Fisher, R. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02072.x · Cited by 250 · see citing works
A Brief Intervention Reduces Hazardous and Harmful Drinking in Emergency Department Patients
D'Onofrio, G., Fiellin, D. A., Pantalon, M. V., Chawarski, M. C., Owens, P. H., Degutis, L. C., Busch, S. H., Bernstein, S. L., & O'Connor, P. G. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.02.006 · Cited by 207 · cited 4× · see citing works
“Training procedures are described in detail in D'Onofrio et al. (2005). Those trainedwere then tested in a role-play pilot case scoredwith the BAS.”
BackgroundMethodInfluentialSelf-citationBernstein, E., Edwards, E., Dorfman, D., Heeren, T., Bliss, C., & Bernstein, J. (2009) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2009.00490.x · Cited by 207 · see citing works
Community program therapist adherence and competence in motivational enhancement therapy
Martino, S., Ball, S. A., Nich, C., Frankforter, T. L., & Carroll, K. M. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.01.020 · Cited by 179 · see citing works
Self-citationNeumann, T., Neuner, B., Weiss-Gerlach, E., T??nnesen, H., Gentilello, L. M., Wernecke, K. D., Schmidt, K., Schr??der, T., Wauer, H., Heinz, A., et al. (2006) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/01.ta.0000196399.29893.52 · Cited by 159 · see citing works
US Emergency Department Visits for Alcohol-Related Diseases and Injuries Between 1992 and 2000
McDonald, A. J., Wang, N. E., & Camargo, C. A. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.5.531 · Cited by 139 · see citing works
Brief intervention for hazardous and harmful drinkers in the emergency department
D'Onofrio, G., Pantalon, M. V., Degutis, L. C., Fiellin, D. A., Busch, S. H., Chawarski, M. C., Owens, P. H., & O'Connor, P. G. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2007.11.028 · Cited by 129 · see citing works
Self-citationD’Onofrio, G., Pantalon, M. V., Degutis, L. C., Fiellin, D. A., & O’Connor, P. G. (2005) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.10.021 · Cited by 111 · see citing works
Self-citationD’Onofrio, G., & Degutis, L. C. (2010) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2010.00824.x · Cited by 107 · see citing works
Self-citationCost and cost-effectiveness of three strategies for training clinicians in motivational interviewing
Olmstead, T. A., Carroll, K. M., Canning‐Ball, M., & Martino, S. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.12.015 · Cited by 66 · see citing works
Self-citationTetrault, J. M., Green, M. L., Martino, S., Thung, S., Degutis, L. C., Ryan, S. A., Martel, S. H., Pantalon, M. V., Bernstein, S. L., O’Connor, P. G., et al. (2012) · Substance Abuse · doi:10.1080/08897077.2011.640220 · Cited by 49 · see citing works
Self-citationEquipping Residents to Address Alcohol and Drug Abuse: The National SBIRT Residency Training Project
Pringle, J. L., Kowalchuk, A. A., Meyers, J., & Seale, J. P. (2012) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-11-00019.1 · Cited by 48 · see citing works
Treatment process, alliance and outcome in brief versus extended treatments for marijuana dependence
Gibbons, C. J., Nich, C., Steinberg, K. L., Roffman, R. A., Corvino, J., Babor, T. F., & Carroll, K. M. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03047.x · Cited by 32 · see citing works
Ana, E. J. S., Carroll, K. M., Anez, L. M., Paris, M., Ball, S. A., Nich, C., Frankforter, T. L., Suarez‐Morales, L., Szapocznik, J., & Martino, S. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2009.03.006 · Cited by 32 · see citing works
Self-citationRyan, S. A., Martel, S. H., Pantalon, M. V., Martino, S., Tetrault, J. M., Thung, S., Bernstein, S. L., Auinger, P., Green, M. L., Fiellin, D. A., et al. (2012) · Substance Abuse · doi:10.1080/08897077.2011.640182 · Cited by 29 · see citing works
Self-citationEmergency Medicine Public Health Research Funded by Federal Agencies: Progress and Priorities
D’Onofrio, G., Goldstein, A. B., Denisco, R. A., Hingson, R., Heffelfinger, J. D., & Post, L. A. (2009) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2009.00555.x · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Emergency Department–Initiated Buprenorphine/Naloxone Treatment for Opioid Dependence
D’Onofrio, G., O’Connor, P. G., Pantalon, M. V., Chawarski, M. C., Busch, S. H., Owens, P. H., Bernstein, S. L., & Fiellin, D. A. (2015) · JAMA · doi:10.1001/jama.2015.3474 · Cited by 913 · see citing works
Self-citationImplementation of integrated stepped care for unhealthy alcohol use in HIV clinics
Edelman, E. J., Hansen, N. B., Cutter, C. J., Danton, C., Fiellin, L. E., O’Connor, P. G., Williams, E. C., Maisto, S. A., BRYANT, K. J., & Fiellin, D. A. (2016) · Addiction Science & Clinical Practice · doi:10.1186/s13722-015-0048-z · Cited by 52 · see citing works
Self-citationHahn, J. A., Fatch, R., Emenyonu, N. I., Sanyu, N., Katusiime, A., Levine, B., John Boscardin, W., Chander, G., Hutton, H., Camlin, C. S., et al. (2023) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2023.109783 · Cited by 22 · see citing works
Diestelkamp, S., Arnaud, N., Sack, P., Wartberg, L., Daubmann, A., & Thomasius, R. (2014) · BMC Emergency Medicine · doi:10.1186/1471-227x-14-13 · Cited by 24 · see citing works
Reho, K., Agley, J. D., DeSalle, M., & Gassman, R. A. (2016) · The Journal of Primary Prevention · doi:10.1007/s10935-016-0431-x · Cited by 18 · see citing works
DiClemente, C. C., Crouch, T. B., Norwood, A. E. Q., Delahanty, J. C., & Welsh, C. (2014) · Psychology of Addictive Behaviors · doi:10.1037/adb0000022 · Cited by 17 · see citing works
Development of the SBIRT checklist for observation in real‐time (SCORe)
Vendetti, J. A., McRee, B. G., & Del Boca, F. K. (2017) · Addiction · doi:10.1111/add.13657 · Cited by 15 · see citing works
Duong, D. K., O’Sullivan, P., Satre, D. D., Soskin, P. N., & Satterfield, J. M. (2016) · Teaching and Learning in Medicine · doi:10.1080/10401334.2016.1164049 · Cited by 15 · see citing works
Biroscak, B. J., Pantalon, M. V., Dziura, J. D., Hersey, D., & Vaca, F. E. (2019) · Substance Abuse · doi:10.1080/08897077.2018.1550465 · Cited by 15 · see citing works
Self-citationStaton, C. A., Friedman, K., Phillips, A. J., Minnig, M. C., Sakita, F. M., Ngowi, K. M., Suffoletto, B., Hirshon, J. M., Swahn, M., Mmbaga, B. T., et al. (2023) · PLOS ONE · doi:10.1371/journal.pone.0288458 · Cited by 14 · see citing works
Pantalon, M. V., Sledge, W. H., Bauer, S. F., BRODSKY, B., GIANNANDREA, S., Kay, J., Lazar, S. G., Mellman, L. A., Offenkrantz, W. C., Oldham, J. M., et al. (2013) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000428556.48588.22 · Cited by 14 · see citing works
Self-citationShared decision‐making in the BREATHE asthma intervention trial: A research protocol
George, M., Pantalon, M. V., Sommers, M. S., Glanz, K., Jia, H., Chung, A., Norful, A. A., Poghosyan, L., Coleman, D., & Bruzzese, J. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13916 · Cited by 12 · see citing works
Self-citationIntegration of substance use treatment and medical care: A special issue of JSAT
Walley, A. Y., Tetrault, J. M., & Friedmann, P. D. (2012) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.09.002 · Cited by 10 · see citing works
Egizio, L. L., Smith, D. C., Bennett, K., Campbell, C., & Windsor, L. C. (2018) · Clinical Social Work Journal · doi:10.1007/s10615-018-0686-1 · Cited by 8 · see citing works
Development and refinement of the open dialog adherence protocol in complex mental health care
Lotmore, M., Ziedonis, D., Monjaras, M. A., Hopfenbeck, M., Razzaque, R., Wilson, E., & Pilling, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1041375 · Cited by 9 · see citing works
Smith, D. C., Egizio, L. L., Bennett, K., Windsor, L. C., & Clary, K. L. (2018) · Journal of Social Work Education · doi:10.1080/10437797.2018.1434438 · Cited by 8 · see citing works
Pantalon, M. V., Dziura, J., Li, F.-Y., Owens, P. H., O'Connor, P. G., & D'Onofrio, G. (2017) · Substance Abuse · doi:10.1080/08897077.2017.1294548 · Cited by 7 · see citing works
Self-citationRyan, S. A., Pantalon, M. V., Camenga, D. R., Martel, S. H., & D’Onofrio, G. (2018) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2018.04.004 · Cited by 7 · see citing works
Self-citationPringle, J. L., Seale, J. P., Shellenberger, S., Grasso, K., Kowalchuk, A. A., Laufman, L. E., Bray, J. H., & Aldridge, A. (2016) · Substance Abuse · doi:10.1080/08897077.2016.1152343 · Cited by 7 · see citing works
Staton, C. A., Zimmerman, A., Pesambili, M., Phillips, A. J., Tupetz, A., Perez de Souza, J. V., Boshe, J., Pantalon, M. H., Swahn, M., Mmbaga, B. T., et al. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0004200 · Cited by 4 · see citing works
Self-citationReadiness to Change and to Accept Help and Drinking Outcomes in Young Adults of Mexican Origin
Nayak, M. B., Bond, J. C., Ye, Y., CHERPITEL, C. J. S., Woolard, R. H., Bernstein, E., Bernstein, J., Villalobos, S., & Ramos, R. L. (2015) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2015.76.602 · Cited by 3 · see citing works
Vaca, F. E., Dziura, J. D., Abujarad, F., Pantalon, M. V., Hsiao, A., Field, C. A., & D’Onofrio, G. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2020.106128 · Cited by 2 · see citing works
Self-citationBernstein, J., Bernstein, E., Hudson, D., Belanoff, C. M., Cabral, H., CHERPITEL, C. J. S., Bond, J. C., Ye, Y., Woolard, R. H., Villalobos, S., et al. (2016) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2015.1095667 · Cited by 1 · see citing works
Savino, R. F., Bowen, E. A., Irish, A., & Johnson, A. K. (2021) · Advances in Social Work · doi:10.18060/24293 · Cited by 1 · see citing works
Lauckner, C., Walthers, J., Stuck, J., BRYANT, K. J., Edelman, E. J., Fiellin, D. A., Hansen, N. B., Kahler, C. W., Magill, M., Mastroleo, N. R., et al. (2022) · AIDS and Behavior · doi:10.1007/s10461-021-03553-w · Cited by 1 · see citing works
Self-citationCrosby, H. (2018) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
A Brief Negotiation Interview Adherence Scale for Smoking Cessation: A psychometric evaluation
Pantalon, M. V., Dziura, J. D., Li, F., D’Onofrio, G., Weiss, J., & Bernstein, S. L. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108398
Self-citationFoll, B. L. (2018) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.725450642.793553870
Berger, L., Topitzes, J., & Paolo, M. R. D. (2024) · Substance Use & Addiction Journal · doi:10.1177/29767342231214407
George, M., Khurana, R., Diggs, K. A., Barsanti, F. A., Mohammad, A., Jia, H., Kattan, M., Pantalon, M., & Bruzzese, J. (2026) · Pediatric Allergy Immunology and Pulmonology · doi:10.1177/2151321x261497821
Self-citation
- Authors
- Pantalon, M. V., Martino, S., Dziura, J., Li, F.-Y., Owens, P. H., Fiellin, D. A., O'Connor, P. G., & D'Onofrio, G.
- Affiliations
- Yale University (US)
- Corresponding author
- Pantalon, Michael V.
- Venue
- Journal of Substance Abuse Treatment
- Publisher
- Elsevier BV
- Published
- 2012-12
- Volume
- 43
- Issue
- 4
- Pages
- 382-388
- ISSN
- 0740-5472 (ISSN-L)
- PMC
- PMC3661016
- OpenAlex
- W2162476628
- Cited by
- 30
- References
- 39
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 2 · 2020: 1 · 2019: 1 · 2018: 6 · 2017: 2 · 2016: 5 · 2015: 2 · 2014: 2 · 2013: 1 · 2012: 1
- FWCI
- 1.44
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of Substance Abuse Treatment (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Alcohol Abuse and Alcoholism (R01 AA 12417-01A1, R01AA014963, R01AA012417, R01 AA14963-05)
- National Institute on Drug Abuse (P50DA009241, R01DA027194, U10DA015831, R25DA026636, R01DA023230, K23DA015144)
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Education › Health Education and Validation
- Keywords
- brief intervention, scale development, psychometric validation, emergency department, hazardous drinking, alcohol abuse, inter-rater reliability, construct validity, performance feedback
- MeSH terms
- Adult, Alcohol Drinking, Clinical Competence, Emergency Service, Hospital, Follow-Up Studies, Humans, Interview, Psychological, Psychometrics, Psychotherapy, Brief, Reproducibility of Results, Observer Variation, Practice Guidelines as Topic, Alcohol-Related Disorders, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review