CoChat

Therapist variation within randomised trials of psychotherapy: implications for precision, internal and external validity

Walwyn, Rebecca, Roberts, Chris · 2010 · Statistical Methods in Medical Research

The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.

Abstract

Nesting of patients within therapists in psychotherapy trials creates an additional level within the design. The multilevel nature of this design has implications for the precision, internal and external validity of estimates of the treatment effect. Prior to or during a trial, psychotherapies are allocated to therapists and therapists are assigned to patients such that the therapist becomes part of the causal pathway from the intervention to the patient. It is therefore important to consider not only the relationship between interventions and patients but also relationships between interventions and therapists and between therapists and patients. Research designs comparing the effects of therapeutic approaches, therapist characteristics and packages of the two can be unified by viewing therapists as an important source of variability within psychotherapy outcome studies. Methodological considerations arising from therapist variation will be discussed, drawing together and building upon the associated psychotherapy and statistical literatures. Parallels will also be made with related designs and methods of analysis.

Overview

Integrity signals

Registry

Crossref · 10.1177/0962280209105017

Cites

94 of 94 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 94 references

Research works printed but not linked: 14

  1. Luborsky L., 1952, Menninger Quarterly, 6, 1
  2. Parloff M., Waskow I., Wolfe B. Research on therapist variables in relation to process and outcome . In Garfield SL, Bergin AE, eds. Handbook of psychotherapy and behavior change. Wiley, New York; 1978 : 233-82.
  3. Beutler LE, Malik M., Alimohamed S. et al. Therapist variables. In Lambert MJ ed. Bergin and Garfield’s handbook of psychotherapy and behavior change. Wiley & Sons, New York; 2004: 227-306.
  4. Ricks DF, 1974, Supershrink: Methods of a therapist judged successful on the basis of adult outcome of adolescent patients
  5. Orlinsky D. , Howard K. Gender and psychotherapeutic outcome. In Brodsky AM, Hare-Muslin RT, eds. Women and psychotherapy. Guilford, New York; 1980: 3-34.
  6. 10.1037/0022-006X.59.1.20 · DOI
  7. MRC Health Services and Public Health Board., 2000, A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health
  8. 10.1037/1082-989X.5.4.425 · doi:10.1037/1082-989x.5.4.425 · Paper page
  9. Elashof, J.D., 2002, nQuery Advisor Version 5.0 User’s Guide
  10. Rasbash J., 2004, A user’s guide to MLwiN version 2.0
  11. White PD, 2007, BMC Neurology, 7
  12. Higgins JPT, 2006, Cochrane handbook for systematic reviews of interventions 4.2.6 [Updated September 2006]
  13. Brien CJ, 2006, Series B, 68, 571
  14. 10.1037/0022-006X.54.1.95 · doi:10.1037/0022-006x.54.1.95 · Paper page

Cited by

See all 93

Metadata

Authors
Walwyn, R., & Roberts, C.
Affiliations
  • King's College London (GB)
  • University of Manchester (GB)
Corresponding author
Roberts, Chris
Venue
Statistical Methods in Medical Research
Published
2009-07-16
Volume
19
Issue
3
Pages
291-315
ISSN
  • 0962-2802 (ISSN-L)
  • 1477-0334
OpenAlex
W2164241727
Cited by
93
References
90
Citations by year
2026: 1 · 2025: 1 · 2024: 6 · 2023: 6 · 2022: 9 · 2021: 2 · 2020: 7 · 2019: 4 · 2018: 7 · 2017: 4 · 2016: 9 · 2015: 6 · 2014: 9 · 2013: 2 · 2012: 10
FWCI
7.06
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Statistical Methods in Medical Research (publishedVersion)
  • PubMed (publishedVersion)
  • Research Portal (King's College London) (submittedVersion)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords
multi-level design, nested data, precision, internal validity, generalizability, treatment effect estimation, therapist characteristics, causal pathways, randomized controlled trials
MeSH terms
Mental Disorders, Psychotherapy, Reproducibility of Results, Models, Statistical, Randomized Controlled Trials as Topic, Treatment Outcome, Biostatistics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Therapist variation within randomised trials of psychotherapy: implications for precision, internal and external validity. https://app.cochat.ai/papers/10.1177/0962280209105017
The paper
Walwyn, R., & Roberts, C. (2010). Therapist variation within randomised trials of psychotherapy: implications for precision, internal and external validity. Statistical Methods in Medical Research. https://doi.org/10.1177/0962280209105017

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.