Methodological Challenges of Characterizing Usual Care Psychotherapeutic Practice
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
There is minimal existing research providing detailed, reliable data characterizing usual community-based psychotherapy practice, and, thus, limited established methods for such research. This article identifies methodological challenges of usual care descriptive research, including, (a) general design considerations, (b) measurement, (c) data analytic, and (d) ethical challenges. Case examples drawn from studies reported in this special issue are used to illustrate the implications, strengths, and weaknesses of different methodological decisions. Central themes include achieving an acceptable balance of scientific rigor, feasibility, and generalizable practice relevance, as well as working collaboratively with practice partners to select and implement study methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1×
“Despite decades of research identifying empirically supported psychotherapeutic treatment models (e.g., Chambless and Hollon 1998; Chambless et al. 1996; Eyberg et al. 2008; Kazdin and Weisz 1998, 2003), minimal research exists examining actual psychotherapeutic practice in community-based settings.”
BackgroundHox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Evidence-Based Psychosocial Treatments for Children and Adolescents With Disruptive Behavior
Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701820117 · Cited by 1,335
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 2×
“For example, for the content strategy ‘‘problem solving skills,’’ a low intensity observation would be a therapist asking a child to generate alternative responses to for a reported incident (e.g., a fight on the playground).”
BackgroundMethodPractice-based research--“Blue Highways” on the NIH roadmap
Westfall, J. M., Mold, J., & Fagnan, L. (2007) · JAMA · doi:10.1001/jama.297.4.403 · Cited by 1,209 · cited 2×
“However, despite national calls for more practicebased research (National Advisory Mental Health Council 1998; Westfall et al. 2007), methods for descriptive, practice-based studies of UC have not received as much attention.”
BackgroundWampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Cited by
Michelson, D., Davenport, C., Dretzke, J., Barlow, J., & Day, C. (2013) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-013-0128-0 · Cited by 292
Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0548-2 · Cited by 122
Ormhaug, S. M., Jensen, T. K., Wentzel-Larsen, T., & Shirk, S. R. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033884 · Cited by 113
Sackeim, H. A., Aaronson, S. T., Bunker, M. T., Conway, C. R., Demitrack, M. A., George, M. S., Prudic, J., Thase, M. E., & Rush, A. J. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.03.021 · Cited by 109
Brookman-Frazee, L. I., Taylor, R., & Garland, A. F. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-0976-0 · Cited by 103
Self-citationBaker-Ericzén, M. J., Jenkins, M. M., & Haine-Schlagel, R. (2013) · Journal of Child and Family Studies · doi:10.1007/s10826-012-9644-7 · Cited by 96
Hogue, A., Ozechowski, T. J., Robbins, M. S., & Waldron, H. B. (2013) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12023 · Cited by 62
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60
Reliability of Therapist Self-Report on Treatment Targets and Focus in Family-Based Intervention
Hogue, A., Dauber, S., Henderson, C. E., & Liddle, H. A. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0520-6 · Cited by 52
Predictors of Use of Evidence-Based Practices for Children and Adolescents in Usual Care
Higa-McMillan, C. K., Nakamura, B. J., Morris, A., Jackson, D. S., & Slavin, L. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0578-9 · Cited by 38
“A complimentary approach to understanding how to effectively implement new programs is the study of practices already in place in usual care settings (Garland et al. 2010a, b).”
BackgroundHogue, A., Dauber, S., & Henderson, C. E. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0442-8 · Cited by 25
Versorgung Zwangserkrankter mit kognitiver Verhaltenstherapie als Behandlungsmethode erster Wahl
Voderholzer, U., Schlegl, S., Diedrich, A., Külz, A. K., Thiel, N., Hertenstein, E., Schwartz, C., Rufer, M., Herbst, N., Nissen, C., et al. (2015) · Verhaltenstherapie · doi:10.1159/000438717 · Cited by 23
Hogue, A., & Dauber, S. (2013) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2012.12.001 · Cited by 23
Hogue, A., Dauber, S., Bobek, M., Jensen-Doss, A., & Henderson, C. E. (2019) · Implementation Science · doi:10.1186/s13012-019-0874-6 · Cited by 11
Metadata
- Authors
- Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2009-09-12
- Volume
- 37
- Issue
- 3
- Pages
- 208-220
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W2077604283
- Cited by
- 69
- References
- 21
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.