[Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE?
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The possibility that research assessments themselves have the potential to positively influence drinking behaviour has long been recognized. The earliest research data were retrospective accounts of how helpful research assessments were found to be in treatment cohort studies [1,2]. The first trials investigated this issue among dependent drinkers within treatment settings and found them unimportant (e.g. [3]). Nonetheless, the phenomenon continued to attract attention within the research community, and subsequent non-randomized treatment trials identified assessment effects which appeared substantial and important to further study [4,5]. Qualitative process studies within large multi-centre treatment trials provided data attesting to the influence of research assessments, indicating that it was an important component of the treatment experience with impact on actual behaviour change [6]. This research interest led to a more recent randomized trial of assessment in the context of treatment which detected smaller effects, providing greater certainty about the nature of the phenomenon and the magnitude of effects that may be expected [7]. Research assessment effects on alcohol consumption have also been studied within the context of brief intervention trials. Marginal influence of hazardous and harmful drinking is at issue in these studies rather than the resolution of complex and long-standing problems. The interventions themselves are generally capable of exerting small to medium effects, somewhat in contrast to the large effects evaluated in treatment studies with smaller sample sizes [8]. The potential for assessment reactivity to bias estimates of brief intervention effectiveness is greater by virtue of relative size. Assessment effects lead to underestimates of the true effects of interventions through contamination [9]. The possibility of converting to convert insights gained from the study of this phenomenon into instruments of behaviour change in non-treatment populations has also aroused much interest. The study by Walters and colleagues [10] adds to a succession of randomized manipulations of assessment effects in recent years which have identified this double-edged promise [9,11,12]. A novel feature of this study is evaluation of the combined impact of multiple assessments. These produce larger effects on some outcome measures than have been identified previously. Careful attention to the data from these studies, however, reveals these effects are found inconsistently across outcome measures. It is also noteworthy that they have been identified in college student populations and their generalizability must be called into question when one considers the lack of any such finding in the well-conducted emergency department study by Daeppen and colleagues [13]. Possible problems with self-report are acknowledged widely, yet little-studied so far. Although the validity of self-report data in treatment settings has been studied and found to be acceptable [14], it is not a safe inference to apply these data to brief intervention contexts without dedicated study. It could be that the effects themselves are fragile or that relevant concepts and study methods are at an early stage of evolution. The way in which this issue has attracted attention in the alcohol field contrasts strikingly with the literatures on similar effects on other behaviours. There somewhat isolated individual studies are much more common, yet there are clear similarities in the small effects identified on subsequent subjective questionnaire responses (e.g. [15]). There is also evidence of effects on direct behavioural outcomes such as blood donation [16] and the uptake of screening [17], and again an inconsistency in these effects, with other studies finding no effects on similar outcomes [18]. While these effects have been labelled generally as ‘assessment reactivity’ within the alcohol field, they are described differently elsewhere. There are likely to be many component effects and many ways to conceptualize them. Conceptual work and empirical studies which are both methodologically and intervention orientated need to recognize and take advantage of the changing landscape of brief interventions in the alcohol field. Brief interventions are becoming briefer as time pressures become more pronounced and information technologies become more prominent. While they can clearly be effective, brief interventions achieve less reduction in drinking than occurs in non-intervention control groups in the same studies, even though the extent of reduction in the latter is highly heterogeneous [19]. More sophisticated experimental methods will continue to yield advances which cannot be attained in other ways. Qualitative studies are also recognized increasingly as valuable and complementary to the conduct of trials, and secondary research on existing studies has the capacity to produce findings which primary research cannot do so straightforwardly. V
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moyer, A., Finney, J. W., Swearingen, C. E., & Vergun, P. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00018.x · Cited by 1,092
Orford, J., Hodgson, R., Copello, A., John, B., Smith, M., Black, R., Fryer, K., Handforth, L., Alwyn, T., Kerr, C., et al. (2006) · Addiction · doi:10.1111/j.1360-0443.2005.01291.x · Cited by 153
Jenkins, R. J., McAlaney, J., & McCambridge, J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.016 · Cited by 103
Self-citationReactivity to alcohol assessment measures: an experimental test
Walters, S. T., Vader, A. M., Harris, T. R., & Jouriles, E. N. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02632.x · Cited by 90
Cited by
McCambridge, J., & Kypri, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023748 · Cited by 242
“from potential for wide dissemination [24].”
Self-citationMcCambridge, J., Kypri, K., & Elbourne, D. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.09.004 · Cited by 138
Self-citationBERNSTEIN, J. A., BERNSTEIN, E., & HEEREN, T. C. (2010) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2010.00174.x · Cited by 68
Sommers, M. S., Lyons, M. S., Fargo, J. D., Sommers, B. D., McDonald, C. C., Shope, J. T., & Fleming, M. F. (2013) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.12142 · Cited by 59
McCambridge, J., Kypri, K., & McElduff, P. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.11.017 · Cited by 54
Self-citation
Metadata
- Authors
- McCAMBRIDGE, J.
- Venue
- Addiction
- Publisher
- Wiley
- Published
- 2009-07-13
- Volume
- 104
- Issue
- 8
- Pages
- 1311-1312
- ISSN
- 0965-2140 (ISSN-L)
- 1360-0443
- OpenAlex
- W1595243604
- Cited by
- 52
- References
- 4
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: [Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE? https://app.cochat.ai/papers/10.1111/j.1360-0443.2009.02684.x
- The paper
- McCAMBRIDGE, J. (2009). [Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE? Addiction. https://doi.org/10.1111/j.1360-0443.2009.02684.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.