The meaningful assessment of therapy outcomes: Incorporating a qualitative study into a randomized controlled trial evaluating the treatment of adolescent depression.
The DOI matches its Crossref record; 45 of the 47 references it cites were found in a registry or an index.
Abstract
For many years, there have been heated debates about the best way to evaluate the efficacy and effectiveness of psychological therapies. On the one hand, there are those who argue that the randomized controlled trial (RCT) is the only reliable and scientifically credible way to assess psychological interventions. On the other hand, there are those who have argued that psychological therapies cannot be meaningfully assessed using a methodology developed to evaluate the impact of drug treatments, and that the findings of RCTs lack "external validity" and are difficult to translate into routine clinical practice. In this article, we advocate the use of mixed-method research designs for RCTs, combining the rigor of quantitative data about patterns of change with the phenomenological contextualized insights that can be derived from qualitative data. We argue that such an approach is especially important if we wish to understand more fully the impact of therapeutic interventions within complex clinical settings. To illustrate the value of a mixed-method approach, we describe a study currently underway in the United Kingdom, in which a qualitative study (IMPACT-My Experience [IMPACT-ME]) has been "nested" within an RCT (the Improving Mood With Psychoanalytic and Cognitive Behavioral Therapy [IMPACT] study) designed to evaluate the effectiveness of psychological therapies in the treatment of adolescent depression. We argue that such a mixed-methods approach can help us to evaluate the effectiveness of psychological therapies and support the real-world implementation of our findings within increasingly complex and multidisciplinary clinical contexts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, multiple alternative designs and methods can be useful in shedding light on mechanisms of change, such as single-case experimental studies [80] and qualitative work embedded in RCTs (e.g., [83]).”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [83]
Citations
Cites
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170
Interpretative Phenomenological Analysis: Theory, Method and Research
(2010) · QMiP Bulletin · doi:10.53841/bpsqmip.2010.1.10.44 · Cited by 8,189
SAGE Handbook of Mixed Methods in Social & Behavioral Research
Tashakkori, A., & Teddlie, C. (2010) · doi:10.4135/9781506335193 · Cited by 6,215
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964
Gibbs, G. (2007) · doi:10.4135/9781849208574 · Cited by 4,299
Strategies Of Qualitative Inquiry
Denzin, N. K., & Lincoln, Y. S. (2012) · Cited by 2,900
Mixed methods research designs in counseling psychology.
Hanson, W. E., Creswell, J. W., Clark, V. L. P., Petska, K. S., & Creswell, J. D. (2005) · Journal of Counseling Psychology · doi:10.1037/0022-0167.52.2.224 · Cited by 1,358
The British Child and Adolescent Mental Health Survey 1999: The Prevalence of DSM-IV Disorders
FORD, T., GOODMAN, R., & MELTZER, H. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200310000-00011 · Cited by 1,227
Foundations of mixed methods research
Tashakkori, A., & Newman, I. (2023) · International Encyclopedia of Education(Fourth Edition) · doi:10.1016/b978-0-12-818630-5.11036-x · Cited by 857
Cited by
Items 101–128 of 128
Doshi, A. S., Naz‐McLean, S., Balasa, R., Philbin, M. M., Doan, T. A., Oldenburg, C. E., & Perez‐Brumer, A. (2026) · Behavioral Medicine · doi:10.1080/08964289.2025.2535316 · Cited by 2
“50,52 While vaccines were not a component of the parent trial nor qualitative evaluation, T1 and T2 interviews coincided with key milestones of the COVID-19 vaccine rollout and pandemic.”
Luyten, P., Speybrouck, D., Martin, P., Claes, S. J., Midgley, N., Eeren, H. V., Busschbach, J. J. V., & Tang, E. (2026) · JMIR Research Protocols · doi:10.2196/80511 · Cited by 3
“Semi-structured interviews, based on an adapted version of the Experience of Therapy Interview [87], will be conducted with 16 patients who found blended psychotherapy to be either helpful or unhelpful.”
InfluentialSelf-citationMatemba, S. R. M., Cianelli, R., McCabe, B. E., & Chilemba, E. B. (2021) · Journal of HIV/AIDS & Social Services · doi:10.1080/15381501.2021.1900975 · Cited by 2
“…alone, as it was the case with the four other studies in this systematic review, falls short due to the lack of use of standardized and predetermined measures which promote reliability and validity, despite qualitative studies’ capacity to penetrate psychosocial issues (Midgley et al., 2014).”
ResultMethods used for evaluation of psychotherapy treatment
Sesar, K., & Dodaj, A. (2022) · Archives of Psychiatry and Psychotherapy · doi:10.12740/app/151881 · Cited by 2
Fiorini, G., Khoe, Z., Fonagy, P., & Midgley, N. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1389833 · Cited by 1
Self-citationLas entrevistas de investigación basadas en la ensoñación
Holmes, J. (2017) · The International Journal of Psychoanalysis (en español) · doi:10.1080/2057410x.2017.1575623
“…el estado de ánimo con terapias psicoanalíticas y cognitivas: mi experiencia' ('IMPACT-ME', la parte 'ME' se refiere al subestudio cualitativo conectado al estudio principal IMPACT) (Midgley et al., 2013), sus investigadores principales fueron el Dr. Nick Midgley y la Profesora Mary Target.”
BackgroundVolz, M., Ehrenthal, J. C., & Seiffge‐Krenke, I. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1939457 · Cited by 1
“However, long-term psychodynamic treatments are less often examined in traditional randomized controlled trials (Kazdin, 2000; Midgley et al., 2014; Woll & Schönbrodt, 2020).”
Background(2015) · Wiley eBooks · doi:10.1002/9781119154082.refs
Sidani, S., & Braden, C. J. (2021) · Wiley eBooks · doi:10.1002/9781119610113.ch14
Stratton, K., & Russell, J. (2015) · Journal of Child Psychotherapy · doi:10.1080/0075417x.2015.1092675
“ME study (Midgley et al., 2014), their analysis draws on interviews with therapists offering parent work within the IMPACT trial (Goodyer et al., 2011) and seeks to discover if, when and how these therapists bring the parents’ own childhoods into their work together.”
BackgroundEspada, A. Á. (2022) · Clínica e Investigación Relacional · doi:10.21110/19882939.2021.160215
Seiffge‐Krenke, I., & Volz, M. (2023) · Development and Psychopathology · doi:10.1017/s0954579422001341 · Cited by 1
Exploring the conduct and reporting of qualitative research in trials using mixed methods
Clement, C. (2023) · Cronfa (Swansea University) · doi:10.23889/suthesis.62588
Exploring Parental Perspectives on Dropout from Treatment for Adolescent Depression
Lord, H., O’Keeffe, S., Panagiotopoulou, E., & Midgley, N. (2023) · Journal of Infant Child and Adolescent Psychotherapy · doi:10.1080/15289168.2023.2191167
“Linked to the IMPACT trial was the qualitative sub-study, the IMPACT-My Experience study (IMPACT-ME; Midgley et al., 2014).”
MethodSelf-citationOutcomes that matter to depressed adolescents can be identified with large language modelsPreprint
Xin, A. W., Lossio-Ventura, J. A., Krause, K. R., Fiorini, G., Midgley, N., Pereira, F., & Nielson, D. M. (2024) · doi:10.31234/osf.io/t9fcp
Self-citationMidgley, N., Calderón, A., Cirasola, A., & Fiorini, G. (2025) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2025.03.001
Self-citationElsey, N., & Avdi, E. (2025) · Journal of Child Psychotherapy · doi:10.1080/0075417x.2025.2503368
“Alongside their recorded sessions, the young person and therapist completed IMPACT-ME (Midgley et al., 2014) interviews post-therapy.”
InfluentialCatty, J. (2025) · Journal of Child Psychotherapy · doi:10.1080/0075417x.2025.2509891
“…intervention, incorporating not only a range of measures of outcome and process but a separate sub-study using MRI to explore the effects of depression and treatment on adolescents and a qualitative sub-study, IMPACT-ME, examining patient, parent and therapist experiences (Midgley et al., 2014).”
Mixed Research Models for the Evaluation of Clinical Change in Psychotherapy
Roussos, A. (2025) · Springer eBooks · doi:10.1007/978-3-031-90782-1_16
Duarte, J. (2025) · Springer eBooks · doi:10.1007/978-3-031-90782-1_12 · Cited by 1
Makiyi, P., Udedi, M. M., Kumwenda, M., & January, J. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02873-5
“Exploring the lived experience of clients helps researchers to determine clients’ understanding of the illness, their insight, their health-seeking behaviours, and the pathway to care [11].”
Understanding Alliance Discrepancies in Youth Therapy: A Case Study of Rupture and Repair in CBT
Ren, Z., Lecchi, T., & Cirasola, A. (2025) · Psychotherapy Research · doi:10.1080/10503307.2025.2573745
“This study adopted a longitudinal, mixed-methods case study approach, examining a single case from the IMPACT-ME study (Midgley et al., 2014), the qualitative component of the IMPACT clinical trial, evaluating the effectiveness of three psychological treatments of depression for adolescents…”
Berg, M., Malmquist, A., Rozental, A., Topooco, N., & Andersson, G. (2020) · Figshare · doi:10.6084/m9.figshare.12941001
O’Keeffe, S., Weitkamp, K., Isaacs, D., Target, M., Eatough, V., & Midgley, N. (2020) · Figshare · doi:10.6084/m9.figshare.13279140
Self-citationThe experience of parent work in short-term psychoanalytic psychotherapy
Riley, E., & Avdi, E. (2026) · Journal of Child Psychotherapy · doi:10.1080/0075417x.2026.2621386 · Cited by 1
“This post-hoc analysis was conducted on data collected from the IMPACT-ME study; thus, these findings derive from an interview that was not specifically designed for the purposes of this study and are a small sample.”
InfluentialRong, X., Fu, W., Jin, Y., Yang, Y., Shen, W., Xu, Y., Qin, Y., Zhang, X., & Gu, Y. (2026) · Nursing Open · doi:10.1002/nop2.70741
“Integrating qualitative methods can provide deeper insights into PICU nurses' training experiences (Midgley et al. 2014; Plano Clark et al. 2013), informing future refinements and facilitating broader implementation.”
Li, E. T., Dudley, K., & Lecchi, T. (2026) · Counselling Psychology Quarterly · doi:10.1080/09515070.2026.2741574
Metadata
- Authors
- Midgley, N., Ansaldo, F., & Target, M.
- Affiliations
- University College London (GB)
- ORCID
- Midgley, Nick
- Venue
- Psychotherapy
- Published
- 2014
- Volume
- 51
- Issue
- 1
- Pages
- 128-137
- ISSN
- 0033-3204 (ISSN-L)
- 1939-1536
- OpenAlex
- W2116907639
- Cited by
- 128
- References
- 47
- Citations by year
- 2026: 5 · 2025: 15 · 2024: 14 · 2023: 12 · 2022: 9 · 2021: 13 · 2020: 18 · 2019: 11 · 2018: 7 · 2017: 9 · 2016: 6 · 2015: 7 · 2014: 2
- FWCI
- 5.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychotherapy (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- adolescent depression, mixed methods research design, impact studies, psychoanalytic psychotherapy, cognitive behavioral therapy, generalizability, clinical implementation, patient experience
- MeSH terms
- Adolescent, Combined Modality Therapy, Depressive Disorder, Female, United Kingdom, Humans, Long-Term Care, Longitudinal Studies, Male, Psychoanalytic Therapy, Psychotherapy, Brief, Cognitive Behavioral Therapy, Qualitative Research, Secondary Prevention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.