Methods for Analyzing Psychotherapy Outcomes: A Review of Clinical Significance, Reliable Change, and Recommendations for Future Directions
The DOI matches its Crossref record; 58 of the 60 references it cites were found in a registry or an index.
Abstract
The purpose of this article is to provide a brief review of the history, development, and current status of the concepts of clinical significance (CS) and the reliable change index (RCI). I address issues regarding the development, criticisms, and applications of CS and RCI. I review the use of normative data, cutoff points, formula adjustments, and the comparative validity of various RCI methods. An examination of the convergence of multiple domains and multiple measures demonstrates ways to further develop the concepts of reliable change and CS. Finally, I make some recommendations and implications for future research and the development of assessment tools.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The threshold for significant improvement at p < .05 corresponds to a difference score of ±1.96 (difference scores of ±0.84 or ±1.28 indicate, with a confidence interval of 80% or 90%, respectively, that real, reliable, and significant change has also been verified; Wise, 2004).”
From THE EFFICACY OF A COMPASSION, ACCEPTANCE AND MINDFULNESS-BASED PILOT INTERVENTION FOR ADOLESCENTS’ TEST ANXIETY: A CASE STUDY USING THE ACADEMIC PROGRAM (2023) · cites this paper as Wise, 2004
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
SF-36 health survey: Manual and interpretation guide
Ware, J. (2003) · Medical Entomology and Zoology · Cited by 11,424
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · cited 13×
“Recall that Jacobson and Truax (1991) indicated that when two distributions”
BackgroundMethodInfluentialNorman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700 · cited 3×
“In this case, a normative shift from one group on the normative continuum to a less pathological normative group provides an alternative to the traditional CS method.”
BackgroundMethodSmith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294 · cited 9×
“Jacobson and colleagues (Jacobson, Follette, & Revenstorf, 1984; Jacobson & Revenstorf, 1988; Jacobson et al., 1999; Jacobson & Truax, 1991) have repeatedly contended that consumers and clinicians “expect to be as normal as their functional counterparts by the time therapy has ended” (Jacobson & Revenstorf, 1988, p. 1…”
BackgroundInfluentialSheehan, D. V. (1984) · Medical Entomology and Zoology · Cited by 883
Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.3.300 · Cited by 853 · cited 3×
“Jacobson and colleagues (Jacobson, Follette, & Revenstorf, 1984; Jacobson & Revenstorf, 1988; Jacobson et al., 1999; Jacobson & Truax, 1991) have repeatedly contended that consumers and clinicians “expect to be as normal as their functional counterparts by the time therapy has ended” (Jacobson & Revenstorf, 1988, p. 1…”
BackgroundThe psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783 · cited 2×
“In fact, literature reviews and meta-analytic studies of outpatients with depression report that few achieve complete remission and despite significant improvements, some data indicate that many of these patients remain more depressed at the end of therapy than the general population (e.g., Hansen, Lambert, & Forman,…”
Background
Research works printed but not linked: 8
- American Psychiatric Association. (2000). Diagnostic and statistical manual (4th ed.). Washington, DC: Author.
- Derogatis, L. R. (1983). SCL-90-R: Administration, scoring and procedures manual (2nd ed.). Towson, MD: Clinical Psychometric Research.
- Hsu L. M., 1989, Behavioral Assessment, 11, 459
- Jacobson N. S., 1986, Behavior Therapy, 15, 309
- 10.1037//0022-006x.52.4.497 · doi:10.1037//0022-006x.52.4.497 · Paper page
- Kendall P. C., 1988, Behavioral Assessment, 10, 147
- 10.1097/00005650-200305000-00004 · DOI
- Tingey, R. C. (1989). Assessing clinical significance: Extension in methods an application to the SCL-90-R. Dissertation Abstracts International, 50(04B), 1659.
Cited by
Wortmann, J. H., Jordan, A. H., Weathers, F. W., Resick, P. A., Dondanville, K. A., Hall-Clark, B., Foa, E. B., Young-McCaughan, S., Yarvis, J. S., Hembree, E. A., et al. (2016) · Psychological Assessment · doi:10.1037/pas0000260 · Cited by 913
“Additional limitations of this approach are reviewed elsewhere (e.g., Wise, 2004).”
BackgroundNorwood, C., Moghaddam, N. G., Malins, S., & Sabin‐Farrell, R. (2018) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2315 · Cited by 324
Moyle, W., Cooke, M., Beattie, E., Jones, C., Klein, B., Cook, G., & Gray, C. (2013) · Journal of Gerontological Nursing · doi:10.3928/00989134-20130313-03 · Cited by 314
Dose-effect relations and responsive regulation of treatment duration: The good enough level.
Barkham, M., Connell, J., Stiles, W. B., Miles, J. N. V., Margison, F., Evans, C., & Mellor-Clark, J. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.1.160 · Cited by 293
“These criteria have elicited discussion and controversy (e.g., Bauer, Lambert, & Neilsen, 2004; Kendall, MarrsGarcia, Nath, & Sheldrick, 1999; Ogles, Lunnen, & Bonesteel, 2001; Tingey, Lambert, Burlingame, & Hansen, 1996a, 1996b; Wampold & Jenson, 1986; Wise, 2004), but, for consistency with previous work, we adopted…”
Dovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0121651 · Cited by 272
“Based on classification guidelines by Wise [99], a participant was classified as responder when both the following criteria were met: (1) a reliable change index (RCI) of at least 1.28 (RCI was based on the method of [98]), and (2) an improvement of scores of at least 1 standard deviation [99].”
BackgroundMethodInfluential
Metadata
- Authors
- Wise, E. A.
- Corresponding author
- Wise, Edward A.
- Venue
- Journal of Personality Assessment
- Publisher
- Informa UK Limited
- Published
- 2004-02
- Volume
- 82
- Issue
- 1
- Pages
- 50-59
- ISSN
- 0022-3891 (ISSN-L)
- 1532-7752
- OpenAlex
- W2093739773
- Cited by
- 399
- References
- 60
- Citations by year
- 2026: 12 · 2025: 22 · 2024: 19 · 2023: 18 · 2022: 29 · 2021: 25 · 2020: 21 · 2019: 19 · 2018: 24 · 2017: 20 · 2016: 22 · 2015: 24 · 2014: 23 · 2013: 27 · 2012: 9
- FWCI
- 8.51
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Personality Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- clinical significance, reliable change index, psychotherapy outcome, outcome measurement, reference values, cut-off values, convergent validity, scale development
- MeSH terms
- Forecasting, Humans, Psychology, Psychotherapy, Reproducibility of Results, Outcome Assessment, Health Care, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methods for Analyzing Psychotherapy Outcomes: A Review of Clinical Significance, Reliable Change, and Recommendations for Future Directions. https://app.cochat.ai/papers/10.1207/s15327752jpa8201_10
- The paper
- Wise, E. A. (2004). Methods for Analyzing Psychotherapy Outcomes: A Review of Clinical Significance, Reliable Change, and Recommendations for Future Directions. Journal of Personality Assessment. https://doi.org/10.1207/s15327752jpa8201_10
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.