CoChat

[Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE?

McCAMBRIDGE, JIM · 2009 · Addiction
Cited by 52

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

The possibility that research assessments themselves have the potential to positively influence drinking behaviour has long been recognized. The earliest research data were retrospective accounts of how helpful research assessments were found to be in treatment cohort studies [1,2]. The first trials investigated this issue among dependent drinkers within treatment settings and found them unimportant (e.g. [3]). Nonetheless, the phenomenon continued to attract attention within the research community, and subsequent non-randomized treatment trials identified assessment effects which appeared substantial and important to further study [4,5]. Qualitative process studies within large multi-centre treatment trials provided data attesting to the influence of research assessments, indicating that it was an important component of the treatment experience with impact on actual behaviour change [6]. This research interest led to a more recent randomized trial of assessment in the context of treatment which detected smaller effects, providing greater certainty about the nature of the phenomenon and the magnitude of effects that may be expected [7]. Research assessment effects on alcohol consumption have also been studied within the context of brief intervention trials. Marginal influence of hazardous and harmful drinking is at issue in these studies rather than the resolution of complex and long-standing problems. The interventions themselves are generally capable of exerting small to medium effects, somewhat in contrast to the large effects evaluated in treatment studies with smaller sample sizes [8]. The potential for assessment reactivity to bias estimates of brief intervention effectiveness is greater by virtue of relative size. Assessment effects lead to underestimates of the true effects of interventions through contamination [9]. The possibility of converting to convert insights gained from the study of this phenomenon into instruments of behaviour change in non-treatment populations has also aroused much interest. The study by Walters and colleagues [10] adds to a succession of randomized manipulations of assessment effects in recent years which have identified this double-edged promise [9,11,12]. A novel feature of this study is evaluation of the combined impact of multiple assessments. These produce larger effects on some outcome measures than have been identified previously. Careful attention to the data from these studies, however, reveals these effects are found inconsistently across outcome measures. It is also noteworthy that they have been identified in college student populations and their generalizability must be called into question when one considers the lack of any such finding in the well-conducted emergency department study by Daeppen and colleagues [13]. Possible problems with self-report are acknowledged widely, yet little-studied so far. Although the validity of self-report data in treatment settings has been studied and found to be acceptable [14], it is not a safe inference to apply these data to brief intervention contexts without dedicated study. It could be that the effects themselves are fragile or that relevant concepts and study methods are at an early stage of evolution. The way in which this issue has attracted attention in the alcohol field contrasts strikingly with the literatures on similar effects on other behaviours. There somewhat isolated individual studies are much more common, yet there are clear similarities in the small effects identified on subsequent subjective questionnaire responses (e.g. [15]). There is also evidence of effects on direct behavioural outcomes such as blood donation [16] and the uptake of screening [17], and again an inconsistency in these effects, with other studies finding no effects on similar outcomes [18]. While these effects have been labelled generally as ‘assessment reactivity’ within the alcohol field, they are described differently elsewhere. There are likely to be many component effects and many ways to conceptualize them. Conceptual work and empirical studies which are both methodologically and intervention orientated need to recognize and take advantage of the changing landscape of brief interventions in the alcohol field. Brief interventions are becoming briefer as time pressures become more pronounced and information technologies become more prominent. While they can clearly be effective, brief interventions achieve less reduction in drinking than occurs in non-intervention control groups in the same studies, even though the extent of reduction in the latter is highly heterogeneous [19]. More sophisticated experimental methods will continue to yield advances which cannot be attained in other ways. Qualitative studies are also recognized increasingly as valuable and complementary to the conduct of trials, and secondary research on existing studies has the capacity to produce findings which primary research cannot do so straightforwardly. V

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/j.1360-0443.2009.02684.x

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Cited by

See all 52

Metadata

Authors
McCAMBRIDGE, J.
Venue
Addiction
Publisher
Wiley
Published
2009-07-13
Volume
104
Issue
8
Pages
1311-1312
ISSN
  • 0965-2140 (ISSN-L)
  • 1360-0443
OpenAlex
W1595243604
Cited by
52
References
4
FWCI
3.08
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: [Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE? https://app.cochat.ai/papers/10.1111/j.1360-0443.2009.02684.x
The paper
McCAMBRIDGE, J. (2009). [Commentary] RESEARCH ASSESSMENTS: INSTRUMENTS OF BIAS AND BRIEF INTERVENTIONS OF THE FUTURE? Addiction. https://doi.org/10.1111/j.1360-0443.2009.02684.x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.