Twenty‐five strategies for improving the design, implementation and analysis of health services research related to alcohol and other drug abuse treatment
The DOI matches its Crossref record.
Abstract
While some aspects of addiction can be studied in laboratory or controlled settings, the study of long‐term recovery management and the health services that support it requires going out into the community and dealing with populations and systems that are much more diverse and less under our control. This in turn raises many methodological challenges for the health service researchers studying alcohol and other drug abuse treatment. This paper identifies some of these challenges related to the design, measurement, implementation and effectiveness of health services research. It then recommends 25 strategies (and key primers) for addressing them: (1) identifying in advance all stakeholders and issues; (2) developing conceptual models of intervention and context; (3) identifying the population to whom the conclusions will be generalized; (4) matching the research design to the question; (5) conducting randomized experiments only when appropriate and necessary; (6) balancing methodological and treatment concerns; (7) prioritizing analysis plans and increasing design sensitivity, (8) combining qualitative and quantitative methods; (9) identifying the four basic types of measures needed; (10) identifying and using standardized measures; (11) carefully balancing measurement selection and modification; (12) developing and evaluating modified and new measures when necessary; (13) identifying and tracking major clinical subgroups; (14) measuring and analyzing the actual pattern of services received; (15) incorporating implementation checks into the design; (16) incorporating baseline measures into the intervention; (17) monitoring implementation and dosage as a form of quality assurance; (18) developing procedures early to facilitate tracking and follow‐up of study participants; (19) using more appropriate representations of the actual experiment; (20) using appropriate and sensitive standard deviation terms; (21) partialing out variance due to design or known sources prior to estimating experimental effect sizes; (22) using dimensional, interval and ratio measures to increase sensitivity to change; (23) using path or structural equation models; (24) integrating qualitative and quantitative analysis into reporting; and (25) using quasi‐experiments, economic or organizational studies to answer other likely policy questions. Most of these strategies have been tried and tested in this and other areas, but are not widely used. Improving the state of the art of health services research and bridging the gap between research and practice do not depend upon using the most advanced methods, but rather upon using the most appropriate methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
The Cannabis Youth Treatment (CYT) Study: Main findings from two randomized trials
Dennis, M., Godley, S. H., Diamond, G., Tims, F. M., Babor, T., Donaldson, J., Liddle, H., Titus, J. C., Kaminer, Y., Webb, C., et al. (2004) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2003.09.005 · Cited by 777
Self-citationCircles of Recovery: Self-Help Organizations for Addictions
Humphreys, K. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511543883 · Cited by 278
The Cannabis Youth Treatment (CYT) experiment: rationale, study design and analysis plans
Dennis, M., Titus, J. C., Diamond, G., Donaldson, J., Godley, S. H., Tims, F. M., Webb, C., Kaminer, Y., Babor, T., Roebuck, M. C., et al. (2002) · Addiction · doi:10.1046/j.1360-0443.97.s01.2.x · Cited by 270
Self-citationGordon, M. S., Kinlock, T. W., Schwartz, R. P., & O’Grady, K. E. (2008) · Addiction · doi:10.1111/j.1360-0443.2008.002238.x · Cited by 176
Scott, C. K., & Dennis, M. L. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02525.x · Cited by 123
Self-citation
Metadata
- Authors
- Dennis, M. L., Perl, H. I., Huebner, R. B., & McLellan, A. T.
- Venue
- Addiction
- Publisher
- Wiley
- Published
- 2000-11
- Volume
- 95
- Issue
- 11s3
- Pages
- 281-308
- ISSN
- 0965-2140 (ISSN-L)
- 1360-0443
- OpenAlex
- W1978587358
- Cited by
- 56
- References
- 0
- FWCI
- 5.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Twenty‐five strategies for improving the design, implementation and analysis of health services research related to alcohol and other drug abuse treatment. https://app.cochat.ai/papers/10.1046/j.1360-0443.95.11s3.2.x
- The paper
- Dennis, M. L., Perl, H. I., Huebner, R. B., & McLellan, A. T. (2000). Twenty‐five strategies for improving the design, implementation and analysis of health services research related to alcohol and other drug abuse treatment. Addiction. https://doi.org/10.1046/j.1360-0443.95.11s3.2.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.