Methodological Challenges of Characterizing Usual Care Psychotherapeutic Practice
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
There is minimal existing research providing detailed, reliable data characterizing usual community-based psychotherapy practice, and, thus, limited established methods for such research. This article identifies methodological challenges of usual care descriptive research, including, (a) general design considerations, (b) measurement, (c) data analytic, and (d) ethical challenges. Case examples drawn from studies reported in this special issue are used to illustrate the implications, strengths, and weaknesses of different methodological decisions. Central themes include achieving an acceptable balance of scientific rigor, feasibility, and generalizable practice relevance, as well as working collaboratively with practice partners to select and implement study methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1×
“Despite decades of research identifying empirically supported psychotherapeutic treatment models (e.g., Chambless and Hollon 1998; Chambless et al. 1996; Eyberg et al. 2008; Kazdin and Weisz 1998, 2003), minimal research exists examining actual psychotherapeutic practice in community-based settings.”
BackgroundHox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Evidence-Based Psychosocial Treatments for Children and Adolescents With Disruptive Behavior
Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701820117 · Cited by 1,335
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 2×
“For example, for the content strategy ‘‘problem solving skills,’’ a low intensity observation would be a therapist asking a child to generate alternative responses to for a reported incident (e.g., a fight on the playground).”
BackgroundMethodPractice-based research--“Blue Highways” on the NIH roadmap
Westfall, J. M., Mold, J., & Fagnan, L. (2007) · JAMA · doi:10.1001/jama.297.4.403 · Cited by 1,209 · cited 2×
“However, despite national calls for more practicebased research (National Advisory Mental Health Council 1998; Westfall et al. 2007), methods for descriptive, practice-based studies of UC have not received as much attention.”
BackgroundWampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608
Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.671 · Cited by 560 · cited 1×
“Leading researchers have identified the dearth of knowledge about usual care (UC) psychotherapy practice as one of the most glaring gaps in current mental health care research (Bickman 2000; Weisz et al. 2006).”
BackgroundPerepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals
Addis, M. E., & Krasnow, A. D. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.331 · Cited by 509 · cited 1×
“Therapist self-report has been the most common method for assessing practice patterns and therapist attitudes/preferences in practice (Aarons 2004; Addis and Krasnow 2000; Baumann et al. 2006; Kazdin et al. 1990; Nelson et al. 2006; Sheehan et al. 2007; Weersing et al. 2002).”
MethodToward the delineation of therapeutic change principles.
Goldfried, M. R. (1980) · American Psychologist · doi:10.1037/0003-066x.35.11.991 · Cited by 451
GARLAND, A. F., HAWLEY, K. M., BROOKMAN-FRAZEE, L., & HURLBURT, M. S. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816765c2 · Cited by 389
Self-citationKazdin, A. E., Siegel, T. C., & Bass, D. (1990) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.21.3.189 · Cited by 251 · cited 4×
“A higher intensity observation would include, for example, generating alternative responses, plus more follow-through observed within the session, with the therapist guiding the child in evaluating various alternative responses and their consequences.”
BackgroundMethodInfluentialA vision of the next generation of behavioral therapies research in the addictions*
Carroll, K. M., & Rounsaville, B. J. (2007) · Addiction · doi:10.1111/j.1360-0443.2007.01798.x · Cited by 177
Zima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., Wallace, P., Rosenblatt, A., Landsverk, J., & Wells, K. B. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00005 · Cited by 117 · cited 4×
“The resulting patient sample was also representative of other public sector samples on gender distribution and most common child diagnoses (e.g., Zima et al. 2005).”
BackgroundMethodInfluentialSelf-citationVinnars, B., Barber, J. P., Norén, K., Gallop, R., & Weinryb, R. M. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.10.1933 · Cited by 112 · cited 1×
“The ‘‘Hawthorne effect’’ (Mayo 1933) has been well established in psychological and organizational research; observation of a phenomenon is, in itself, an intervention and can impact the phenomenon being observed (Mufson et al. 2004; Vinnars et al. 2005).”
BackgroundHogue, A., Liddle, H. A., Dauber, S., & Samuolis, J. (2004) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.41.2.83 · Cited by 54 · cited 4×
“Multiple methods were used to characterize service use, participants’ experiences in care, treatment processes, and multiple domains of outcomes.”
BackgroundMethodInfluential
Cited by
Michelson, D., Davenport, C., Dretzke, J., Barlow, J., & Day, C. (2013) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-013-0128-0 · Cited by 292
Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0548-2 · Cited by 122
Ormhaug, S. M., Jensen, T. K., Wentzel-Larsen, T., & Shirk, S. R. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033884 · Cited by 113
Sackeim, H. A., Aaronson, S. T., Bunker, M. T., Conway, C. R., Demitrack, M. A., George, M. S., Prudic, J., Thase, M. E., & Rush, A. J. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.03.021 · Cited by 109
Brookman-Frazee, L. I., Taylor, R., & Garland, A. F. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-0976-0 · Cited by 103
Self-citation
Metadata
- Authors
- Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2009-09-12
- Volume
- 37
- Issue
- 3
- Pages
- 208-220
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W2077604283
- Cited by
- 69
- References
- 21
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.