Psychological treatment outcomes in routine NHS services: What do we mean by treatment effectiveness?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Objectives. The question of how effective therapies are in routine practice is crucial. The answer depends on how we define effectiveness. Both the definition of who was treated and the index chosen to represent outcome can affect estimates dramatically. Design. We used data from the Clinical Outcomes in Routine Evaluation (CORE) Primary Care National Practice‐Based Evidence database‐2005 on the Clinical Outcomes in Routine Evaluation‐Outcome Measure (CORE‐OM) from 33,587 patients and examined rates of improvement in psychological therapies in UK National Health Service (NHS) primary care services using various definitions of effectiveness. Methods. We constructed successively more restrictive sub‐samples of patients, including practice‐based analogues of several types of intent‐to‐treat (ITT) groups and completer groups. We focussed on patients scoring above clinical cut‐off at intake, but we also considered samples that included sub‐clinical patients. We assessed two types of recovery rates, improvement rates, mean pre–post change, and pre–post effect sizes for each sub‐sample. Results. There was wide variation in the overall effectiveness of treatments as a function of which subset of data was considered and which specific criterion of recovery rate was adopted. Recovery rates and pre–post effect sizes ranged from 19% to 65% and 0.60 to 1.95, respectively. Conclusions. Because estimates of effectiveness could have significant policy implications, clarity on the meanings of the differing constructions is essential.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 5×
“The CORE System includes the self-report Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM; Barkham et al., 2001, Evans et al., 2002) to monitor patients at the beginning and end of treatment, along with therapist-completed forms, as described later.”
InfluentialSelf-citationThe Intention-to-Treat Principle: How to Assess the True Effect of Choosing a Medical Treatment
Detry, M. A., & Lewis, R. J. (2014) · JAMA · doi:10.1001/jama.2014.7523 · Cited by 634
Improving access to psychological therapy: initial evaluation of two UK demonstration sites
Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.010 · Cited by 599 · cited 2×
“As a comparison and following the adoption of a caseness criterion as a standard index of recovery in the UK’s Improving Access to Psychological Therapies initiative (see Clark et al., 2009), we calculated recovery rates using this simple caseness criterion.”
Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Benson, L., Connell, J., Audin, K., & McGrath, G. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.2.184 · Cited by 532 · cited 5×
“The 34-item scale has a reported internal consistency of .94 (Barkham et al., 2001) and a 1-month test–retest correlation of .88 (Barkham, Mullin, Leach, Stiles, & Lucock, 2007).”
InfluentialSelf-citationEarly sudden gains in psychotherapy under routine clinic conditions: Practice-based evidence.
Stiles, W. B., Leach, C., Barkham, M., Lucock, M., Iveson, S., Shapiro, D. A., Iveson, M., & Hardy, G. E. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.1.14 · Cited by 220 · cited 3×
“Repeated measurement makes it possible to plot the shape of change (see Barkham, Stiles, & Shapiro, 1993; Barkham et al., 2001; Lutz et al., 2005; Stiles et al., 2003; Stulz et al., 2007) but also carries with it inevitable trade-offs regarding over-familiarity (if the same measure is used) and…”
Self-citationConnell, J., Barkham, M., Stiles, W. B., Twigg, E., Singleton, N., Evans, O., & Miles, J. N. V. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.017657 · Cited by 201 · cited 2×
“Reliable and clinically significant improvement (RCSI) Following Jacobson and Truax (1991), we held that patients had achieved RCSI if they entered the study in a dysfunctional state and left in a non-clinical state, having changed to a degree not attributable to measurement error.”
Self-citationShapes of early change in psychotherapy under routine outpatient conditions
Stulz, N., Lutz, W., Leach, C., Lucock, M., & Barkham, M. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.864 · Cited by 122 · cited 2×
“…makes it possible to plot the shape of change (see Barkham, Stiles, & Shapiro, 1993; Barkham et al., 2001; Lutz et al., 2005; Stiles et al., 2003; Stulz et al., 2007) but also carries with it inevitable trade-offs regarding over-familiarity (if the same measure is used) and being fit for purpose…”
Self-citationSystematic review of practice‐based research on psychological therapies in routine clinic settings
Cahill, J., Barkham, M., & Stiles, W. B. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x470789 · Cited by 92
Self-citationClient initiated termination of therapy at NHS primary care counselling services
Connell, J., Grant, S., & Mullin, T. (2006) · Counselling and Psychotherapy Research · doi:10.1080/14733140600581507 · Cited by 49
Self-citation
Cited by
Morris, L., Mansell, W., & McEvoy, P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00099 · Cited by 65
“Although a substantial proportion of clients accessing primary care have problems with depression and/or anxiety, clients with a range of presenting problems are treated (Glover et al., 2010; Barkham et al., 2012) and PCT offers an understanding of psychopathology relevant to this range.”
BackgroundDuration of psychological therapy: Relation to recovery and improvement rates in UK routine practice
Stiles, W. B., Barkham, M., & Wheeler, S. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.145565 · Cited by 53
Self-citationCognitive Analytic Therapy for Bipolar Disorder: A Pilot Randomized Controlled Trial
Evans, M., Kellett, S., Heyland, S., Hall, J., & Majid, S. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2065 · Cited by 48
Morris, L., Mansell, W., Emsley, R., Bates, R., Comiskey, J., Pistorius, E., & McEvoy, P. (2016) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12070 · Cited by 14
An exploration of group cognitive analytic therapy for anxiety and depression
Martin, E., Byrne, G., Connon, G., & Power, L. (2021) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12299 · Cited by 11
Metadata
- Authors
- Barkham, M., Stiles, W. B., Connell, J., & Mellor‐Clark, J.
- Venue
- Psychology and Psychotherapy: Theory, Research and Practice
- Publisher
- Wiley
- Published
- 2011-04-28
- Volume
- 85
- Issue
- 1
- Pages
- 1-16
- ISSN
- 1476-0835 (ISSN-L)
- 2044-8341
- OpenAlex
- W1602373289
- Cited by
- 58
- References
- 9
- FWCI
- 5.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Psychological treatment outcomes in routine NHS services: What do we mean by treatment effectiveness? https://app.cochat.ai/papers/10.1111/j.2044-8341.2011.02019.x
- The paper
- Barkham, M., Stiles, W. B., Connell, J., & Mellor‐Clark, J. (2012). Psychological treatment outcomes in routine NHS services: What do we mean by treatment effectiveness? Psychology and Psychotherapy: Theory, Research and Practice. https://doi.org/10.1111/j.2044-8341.2011.02019.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.