Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy.
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purpose of this study was to evaluate the effectiveness of a large public behavioral health (PBH) agency serving only clients at or below the federal poverty level that had implemented continuous outcome feedback as a quality improvement strategy. METHOD: The authors investigated the post treatment outcomes of 5,168 individuals seeking treatment for a broad range of diagnoses who completed at least 2 psychotherapy sessions. The Outcome Rating Scale (ORS; Duncan, 2011; Miller & Duncan, 2004) was used to measure outcomes. Clients had a mean age of 36.7 years and were predominantly female (60.7%) and White (67.8%), with 17.7% being Hispanic, 9.3% being African American, and 2.8% being Native American. Forty-six percent were diagnosed with depression, mood, and anxiety disorders; 18.8% were diagnosed with substance abuse disorders; and 14.4% were diagnosed with bipolar disorder and schizophrenia. A subset of clients with a primary diagnosis of a depressive disorder was compared to treatment efficacy benchmarks derived from clinical trials of major depression. Given that the PBH agency had also implemented an outcome management system, the total sample was also compared to benchmarks derived from clinical trials of continuous outcome feedback. RESULTS: Treatment effect sizes of psychotherapy delivered at the PBH agency were comparable to effect size estimates of clinical trials of depression and feedback. Observed effect sizes were smaller, however, when compared to feedback benchmarks that used the ORS. CONCLUSIONS: Services to the poor and disabled can be effective, and continuous outcome feedback may be a viable means both to improve outcomes and to narrow the gap between research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
Reiss, F. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.04.026 · Cited by 2,062
The psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
Socioeconomic status and adolescent mental disorders
McLaughlin, K. A., Costello, E. J., Leblanc, W., Sampson, N. A., & Kessler, R. C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300477 · Cited by 360
Enhancing psychotherapy outcomes via providing feedback on client progress: a replication
Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.324 · Cited by 306
The therapeutic effects of providing patient progress information to therapists and patients
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph027 · Cited by 230
Campbell, A., & Hemsley, S. (2009) · Clinical Psychologist · doi:10.1080/13284200802676391 · Cited by 225
Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.698918 · Cited by 137
Stiles, W. B., Barkham, M., Connell, J., & Mellor-Clark, J. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.298 · Cited by 98
Cited by
Leske, S., Harris, M. G., Charlson, F. J., Ferrari, A. J., Baxter, A. J., Logan, J. M., Toombs, M., & Whiteford, H. (2016) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416662150 · Cited by 65
Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N. (2022) · The Canadian Journal of Psychiatry · doi:10.1177/07067437211006873 · Cited by 52
Nordberg, S. S., McAleavey, A. A., Duszak, E., Locke, B. D., Hayes, J. A., & Castonguay, L. G. (2018) · Counselling Psychology Quarterly · doi:10.1080/09515070.2016.1202809 · Cited by 13
Metadata
- Authors
- Reese, R. J., Duncan, B. L., Bohanske, R. T., Owen, J. J., & Minami, T.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2014
- Volume
- 82
- Issue
- 4
- Pages
- 731-742
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2326613823
- Cited by
- 55
- References
- 11
- FWCI
- 10.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.