An Interventionist Adherence Scale for a Specialized Brief Negotiation Interview Focused on Treatment Engagement for Opioid use Disorders
Open accessAbstract
Background: No psychometrically validated instrument for evaluating the extent to which interventionists correctly implement brief interventions designed to motivate treatment engagement for opioid use disorders has been reported in the literature. The objective of this study was to develop and examine the psychometric properties of the Brief Negotiation Interview (BNI) Adherence Scale for Opioid Use Disorders (BAS-O). Methods: In the context of a randomized controlled trial evaluating the efficacy of 3 models of emergency department care for opioid use disorders, the authors developed and subsequently examined the psychometric properties of the BAS-O, a 38-item scale that required raters to answer whether or not (“Yes” or “No”) each of the critical actions of the BNI was correctly implemented by the research interventionist. BAS-O items pertained to the BNI's 4 steps: (1) Raise the Subject, (2) Provide Feedback, (3) Enhance Motivation, and (4) Negotiate and Advise. A total of 215 audio-recorded BNI and 88 control encounters were rated by 3 trained raters who were independent of the study team and blind to study hypotheses, treatment, and assignment. Results: The results indicated the BAS-O has fair to excellent psychometric properties, in terms of good internal consistency, excellent interrater reliability, discriminant validity, and construct validity, and fair predictive validity. A 13-item, 2-factor solution accounted for nearly 80% of the variance, where factor 1 addressed “Autonomy and Planning” (7 items) and factor 2 addressed “Motivation and Problems” (6 items). However, predictive validity was found for only one of the BAS-O factor items (i.e., Telling patients that treatment will address a range of issues related to their opioid use disorder). Conclusions: This study suggests that the BAS-O is a psychometrically valid measure of adherence to the specialized BNI for motivating treatment engagement in patients with opioid use disorders, thus providing a brief (13-item), objective method of evaluating BNI skill performance.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
One observed change in perceived feasibility was the disappearance of "lack of training" as a reported barrier post-intervention, which may indicate that participants no longer viewed inadequate preparation as an obstacle to SBIRT delivery.
“One observed change in perceived feasibility was the disappearance of “lack of training” as a reported barrier post-intervention, which may indicate that participants no longer viewed inadequate preparation as an obstacle to SBIRT delivery [31].”
From Screening, brief intervention, and referral to treatment training for Nigerian primary care physicians: A pilot evaluation of knowledge, attitudes, self-efficacy, and barriers to implementation (2025) · cites this paper as [31]
The Methods > Procedures passage reports that interventionists received two-hour training, and the Discussion says they could learn to deliver the brief negotiation interview with sufficient adherence. Neither passage reports pre- and post-intervention perceptions of SBIRT delivery or whether “lack of training” disappeared as a reported barrier. Searches for that barrier and for changes in perceived feasibility found no such result in our copy; page numbers were not provided. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · see citing works
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069 · see citing works
(1998) · PubMed · Cited by 10,216 · see citing works
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349 · see citing works
Motivational interviewing: preparing people for change.
Miller, W. R., & Rollnick, S. (2002) · Cited by 7,002 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Motivational Interviewing: Preparing People for Change, 2nd ed.
Miller, W., & Rollnick, S. (2003) · Journal For Healthcare Quality · doi:10.1097/01445442-200305000-00013 · Cited by 2,634 · see citing works
Toward a theory of motivational interviewing
Miller, W. R., & Rose, G. S. (2009) · American Psychologist · doi:10.1037/a0016830 · Cited by 1,603 · see citing works
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075 · see citing works
Emergency Department–Initiated Buprenorphine/Naloxone Treatment for Opioid Dependence
D’Onofrio, G., O’Connor, P. G., Pantalon, M. V., Chawarski, M. C., Busch, S. H., Owens, P. H., Bernstein, S. L., & Fiellin, D. A. (2015) · JAMA · doi:10.1001/jama.2015.3474 · Cited by 913 · see citing works
Self-citationIs There Time for Management of Patients With Chronic Diseases in Primary Care?
Ostbye, T. (2005) · The Annals of Family Medicine · doi:10.1370/afm.310 · Cited by 698 · see citing works
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657 · see citing works
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638 · see citing works
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628 · see citing works
Motivational Interviewing: Preparing People for Change
Dabbo, S., & Dabbo, N. (2010) · University of Toronto Medical Journal · doi:10.5015/utmj.v87i2.1178 · Cited by 533 · see citing works
Carroll, K. M. (2000) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(99)00049-6 · Cited by 386 · see citing works
D’Onofrio, G., & Degutis, L. C. (2002) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2002.tb02304.x · Cited by 379 · see citing works
Self-citationEvaluation of model fit indices for latent variable models with categorical and continuous outcomes
Yu, C.-Y. (2002) · Medical Entomology and Zoology · Cited by 373 · see citing works
Gentilello, L. M., Ebel, B. E., Wickizer, T. M., Salkever, D. S., & Rivara, F. P. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000157133.80396.1c · Cited by 293 · see citing works
Lane, C., Huws-Thomas, M. V., Hood, K., Rollnick, S., Edwards, K., & Robling, M. R. (2004) · Patient Education and Counseling · doi:10.1016/j.pec.2004.01.003 · Cited by 250 · see citing works
Havard, A., Shakeshaft, A., & Sanson‐Fisher, R. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02072.x · Cited by 250 · cited 1× · see citing works
“We hypothesized that the BAS-O items would (1) have good internal consistency, (2) show good rating agreement among independent raters, (3) converge to form independent factors corresponding to the key components of the BNI, (4) discriminate between recordings of BNI versus control encounters, and (5) be positively as…”
A Brief Intervention Reduces Hazardous and Harmful Drinking in Emergency Department Patients
D'Onofrio, G., Fiellin, D. A., Pantalon, M. V., Chawarski, M. C., Owens, P. H., Degutis, L. C., Busch, S. H., Bernstein, S. L., & O'Connor, P. G. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.02.006 · Cited by 207 · see citing works
Self-citationCommunity program therapist adherence and competence in motivational enhancement therapy
Martino, S., Ball, S. A., Nich, C., Frankforter, T. L., & Carroll, K. M. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.01.020 · Cited by 179 · see citing works
D'Onofrio, G., & Degutis, L. C. (2002) · Academic Emergency Medicine · doi:10.1197/aemj.9.6.627 · Cited by 178 · see citing works
Self-citationNeumann, T., Neuner, B., Weiss-Gerlach, E., T??nnesen, H., Gentilello, L. M., Wernecke, K. D., Schmidt, K., Schr??der, T., Wauer, H., Heinz, A., et al. (2006) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/01.ta.0000196399.29893.52 · Cited by 159 · see citing works
US Emergency Department Visits for Alcohol-Related Diseases and Injuries Between 1992 and 2000
McDonald, A. J., Wang, N. E., & Camargo, C. A. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.5.531 · Cited by 139 · see citing works
Brief intervention for hazardous and harmful drinkers in the emergency department
D'Onofrio, G., Pantalon, M. V., Degutis, L. C., Fiellin, D. A., Busch, S. H., Chawarski, M. C., Owens, P. H., & O'Connor, P. G. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2007.11.028 · Cited by 129 · see citing works
Self-citationD’Onofrio, G., Pantalon, M. V., Degutis, L. C., Fiellin, D. A., & O’Connor, P. G. (2005) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.10.021 · Cited by 111 · see citing works
Self-citationFactor Analysis: An Applied Approach.
Harshman, R. A., Cureton, E. E., & D’Agostino, R. B. (1986) · Journal of the American Statistical Association · doi:10.2307/2289034 · Cited by 54 · see citing works
Tetrault, J. M., Green, M. L., Martino, S., Thung, S., Degutis, L. C., Ryan, S. A., Martel, S. H., Pantalon, M. V., Bernstein, S. L., O’Connor, P. G., et al. (2012) · Substance Abuse · doi:10.1080/08897077.2011.640220 · Cited by 49 · see citing works
Self-citationAna, E. J. S., Carroll, K. M., Anez, L. M., Paris, M., Ball, S. A., Nich, C., Frankforter, T. L., Suarez‐Morales, L., Szapocznik, J., & Martino, S. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2009.03.006 · Cited by 32 · see citing works
Pantalon, M. V., Martino, S., Dziura, J., Li, F.-Y., Owens, P. H., Fiellin, D. A., O'Connor, P. G., & D'Onofrio, G. (2012) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.08.011 · Cited by 30 · see citing works
Self-citationRyan, S. A., Martel, S. H., Pantalon, M. V., Martino, S., Tetrault, J. M., Thung, S., Bernstein, S. L., Auinger, P., Green, M. L., Fiellin, D. A., et al. (2012) · Substance Abuse · doi:10.1080/08897077.2011.640182 · Cited by 29 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Anaba, H., Thrul, J., Oborevwori, E., Oluwayomi, O., & Alexander, G. C. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0005597
- Authors
- Pantalon, M. V., Dziura, J., Li, F.-Y., Owens, P. H., O'Connor, P. G., & D'Onofrio, G.
- Affiliations
- Yale University (US)
- Yale University School of Public Health, New Haven, Connecticut, USA
- Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
- Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
- Corresponding author
- Pantalon, Michael V.
- ORCID
- Dziura, James
- Venue
- Substance Abuse
- Publisher
- SAGE Publications
- Published
- 2017-04
- Volume
- 38
- Issue
- 2
- Pages
- 191-199
- ISSN
- 0889-7077 (ISSN-L)
- 1547-0164
- PMC
- PMC7222694
- OpenAlex
- W2590670781
- Semantic Scholar
- 3eed4713a556d8c8ec12adf8042aafa2cd85e366
- Cited by
- 7
- References
- 35
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 1 · 2021: 3 · 2019: 1
- FWCI
- 0.26
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Substance Abuse (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01DA025991)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- opioid use disorder, treatment engagement, scale development, psychometric validation, emergency department care, motivational interviewing, inter-rater reliability, motivation
- MeSH terms
- Emergency Service, Hospital, Humans, Interview, Psychological, Health Knowledge, Attitudes, Practice, Opioid-Related Disorders, Patient Acceptance of Health Care, Psychometrics, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
