The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis
Open accessThe DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Even though the early alliance has been shown to robustly predict posttreatment outcomes, the question whether alliance leads to symptom reduction or symptom reduction leads to a better alliance remains unresolved. To better understand the relation between alliance and symptoms early in therapy, we meta-analyzed the lagged session-by-session within-patient effects of alliance and symptoms from Sessions 1 to 7. METHOD: We applied a 2-stage individual participant data meta-analytic approach. Based on the data sets of 17 primary studies from 9 countries that comprised 5,350 participants, we first calculated standardized session-by-session within-patient coefficients. Second, we meta-analyzed these coefficients by using random-effects models to calculate omnibus effects across the studies. RESULTS: In line with previous meta-analyses, we found that early alliance predicted posttreatment outcome. We identified significant reciprocal within-patient effects between alliance and symptoms within the first 7 sessions. Cross-level interactions indicated that higher alliances and lower symptoms positively impacted the relation between alliance and symptoms in the subsequent session. CONCLUSION: The findings provide empirical evidence that in the early phase of therapy, symptoms and alliance were reciprocally related to one other, often resulting in a positive upward spiral of higher alliance/lower symptoms that predicted higher alliances/lower symptoms in the subsequent sessions. Two-stage individual participant data meta-analyses have the potential to move the field forward by generating and interlinking well-replicable process-based knowledge. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Combination therapy outperforms monotherapy in many contexts, yet bupropion pairings show heterogeneous effects”
From Synaptic Plasticity—Intrinsic Excitability and Antidepressant Discovery (2026) · cites this paper as [356]
In the citing paper
“DXM with bupropion brings NMDA modulation, sigma-1 signaling, and monoaminergic support, offering a versatile backbone for augmentation [355,356].”
From Synaptic Plasticity—Intrinsic Excitability and Antidepressant Discovery (2026) · cites this paper as [356]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · cited 1×
“Heterogeneity was assessed using the Q and I2 statistics (Higgins & Thompson, 2002).”
MethodHierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · cited 1×
“We also examined the hypotheses that our search may be biased because we excluded unpublished studies with potentially low or nonsignificant results; we used funnel plots, rank correlation (Begg & Mazumdar, 1994), and regression tests (Egger, Smith, Schneider, & Minder, 1997).”
MethodBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238 · cited 1×
“The alliance is conceptualized as a primarily pan-theoretical construct (Bordin, 1979; Horvath, 2018).”
BackgroundA critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005 · cited 1×
“There are emerging alternate approaches for cross-lagged models (e.g., Asparouhov, Hamaker, & Muthén, 2018; Hamaker et al., 2015).”
MethodOutlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1×
“…diagnostics, one dataset (Tasca, Compare, Zarbo, & Brugnera, 2016) was deemed to be an extreme outlier in the session-bysession estimates (up to 8 SD from the mean omnibus tests; Viechtbauer & Cheung, 2010) and was therefore excluded from further analyses, resulting in a k 17 included data sets.3”
MethodAlliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072 · cited 4×
“We identified 500 articles (140 articles from Horvath et al., 2011; 201 additional articles from Flückiger et al., 2018, and 159 articles from the updated search).”
BackgroundSelf-citationThe disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056 · cited 1×
“…to WP effects is not warranted because WP effects may be independent of the respective BP effects and different therapeutic factors can play a role on these different levels (e.g., Beltz, Wright, Sprague, & Molenaar, 2016; Curran & Bauer, 2011; Hamaker, Kuiper, & Grasman, 2015; Molenaar, 2004).”
BackgroundMolenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 1×
“…to WP effects is not warranted because WP effects may be independent of the respective BP effects and different therapeutic factors can play a role on these different levels (e.g., Beltz, Wright, Sprague, & Molenaar, 2016; Curran & Bauer, 2011; Hamaker, Kuiper, & Grasman, 2015; Molenaar, 2004).”
BackgroundThe alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
Self-citationStewart, M. (2001) · BMJ · doi:10.1136/bmj.322.7284.444 · Cited by 1,111 · cited 1×
“Global mental health researchers may be encouraged by the present results to generate patient-centered public health awareness that highlights collaborative qualities between the health providers and their patients (e.g., Ogden, Barr, & Greenfield, 2017; Stewart, 2001).”
BackgroundNegotiating the Therapeutic Alliance: A Relational Treatment Guide
Safran, J. D., & Muran, J. C. (2000) · Cited by 1,088
Self-citationDynamic Structural Equation Models
Asparouhov, T., Hamaker, E. L., & Muthén, B. (2018) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2017.1406803 · Cited by 985
The Future of Intervention Science: Process-Based Therapy
Hofmann, S. G., & Hayes, S. C. (2019) · Clinical Psychological Science · doi:10.1177/2167702618772296 · Cited by 888 · cited 2×
“…of process-based psychotherapy across many theoretical considerations (e.g., Crits-Christoph, Gallop, Gaines, Rieger, & Connolly Gibbons, 2020; Hofmann & Hayes, 2019; Muran & Barber, 2010; Norcross & Goldfried, 2019; Norcross & Lambert, 2019; Wampold & Imel, 2015), particularly, early in…”
BackgroundPsychotherapy relationships that work II.
Norcross, J. C., & Lambert, M. J. (2011) · Psychotherapy · doi:10.1037/a0022180 · Cited by 797
Muthukrishna, M., & Henrich, J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0522-1 · Cited by 638
Wang, L. (., & Maxwell, S. E. (2015) · Psychological Methods · doi:10.1037/met0000030 · Cited by 637 · cited 1×
“To disentangle WP from BP variation, raw scores were person-mean centered based on the recent recommendations of Wang and Maxwell (2015) to obtain a parsimonious model applicable across the included longitudinal data sets.”
MethodA phase model of psychotherapy outcome: Causal mediation of change.
Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.678 · Cited by 576 · cited 1×
“…Gaines, Rieger, & Connolly Gibbons, 2020; Hofmann & Hayes, 2019; Muran & Barber, 2010; Norcross & Goldfried, 2019; Norcross & Lambert, 2019; Wampold & Imel, 2015), particularly, early in therapy (e.g., Beard & Delgadillo, 2019; Howard et al., 1993; Spencer et al., 2019; Wucherpfennig et al., 2017).”
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
Self-citationAlliance Rupture Repair: A Meta-Analysis
Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018) · Psychotherapy · doi:10.1037/pst0000185 · Cited by 450
Self-citation(1991) · Cited by 439
Ryan, R. M., Lynch, M. F., Vansteenkiste, M., & Deci, E. L. (2011) · The Counseling Psychologist · doi:10.1177/0011000009359313 · Cited by 429
Handbook of Psychotherapy Integration
(2015) · Oxford Clinical Psychology · doi:10.1093/med:psych/9780195165791.001.0001 · Cited by 415
Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D., & Wampold, B. E. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.07.002 · Cited by 397
Self-citationCollecting and delivering progress feedback: A meta-analysis of routine outcome monitoring.
Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018) · Psychotherapy · doi:10.1037/pst0000167 · Cited by 392
Tierney, J. F., Vale, C., Riley, R., Smith, C. T., Stewart, L., Clarke, M., & Rovers, M. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001855 · Cited by 361 · cited 1×
“This analysis followed a two-stage individual participant data meta-analysis approach (e.g., Stewart et al., 2012; Tierney et al., 2015).”
MethodDropout and therapeutic alliance: A meta-analysis of adult individual psychotherapy.
Sharf, J., Primavera, L. H., & Diener, M. J. (2010) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/a0021175 · Cited by 352
How to compare cross-lagged associations in a multilevel autoregressive model.
Schuurman, N. K., Ferrer, E., de Boer-Sonnenschein, M., & Hamaker, E. L. (2016) · Psychological Methods · doi:10.1037/met0000062 · Cited by 315
Ethics in Psychotherapy and Counseling: A Practical Guide
Pope, K. S., & Vasquez, M. J. T. (2011) · doi:10.1002/9781118001875 · Cited by 311
A Conceptual and Methodological Analysis of the Nonspecifics Argument.
DeRubeis, R. J., Brotman, M. A., & Gibbons, C. J. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi022 · Cited by 310 · cited 2×
“One major unresolved question is how symptoms and the alliance interact over the course of treatment, particularly in the critical early portion of therapy (e.g., DeRubeis et al., 2005).”
BackgroundZilcha-Mano, S. (2017) · American Psychologist · doi:10.1037/a0040435 · Cited by 303 · cited 5×
“However, it is less clear whether a stronger alliance relates to subsequent symptom reduction or vice versa (e.g., Barber, Connolly, Crits-Christoph, Gladis, & Siqueland, 2000; Wampold & Imel, 2015; Zilcha-Mano, 2017).”
BackgroundMethodSelf-citationBridging the Nomothetic and Idiographic Approaches to the Analysis of Clinical Data
Beltz, A. M., Wright, A. G. C., Sprague, B. N., & Molenaar, P. C. M. (2016) · Assessment · doi:10.1177/1073191116648209 · Cited by 293
Therapeutic alliance predicts symptomatic improvement session by session.
Falkenström, F., Granström, F., & Holmqvist, R. (2013) · Journal of Counseling Psychology · doi:10.1037/a0032258 · Cited by 291
Self-citationKlein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., Arnow, B., Blalock, J. A., Manber, R., Markowitz, J. C., et al. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.997 · Cited by 264 · cited 2×
“The BP effects addresses the question “Do patients with better early alliance ratings have better posttreatment outcomes than patients with lower early alliance ratings?” By contrast, within-patient (WP) effects provide information about the temporal relationship between alliance and outcomes within patients (e.g., Ba…”
BackgroundStewart, G. B., Altman, D. G., Askie, L. M., Duley, L., Simmonds, M. C., & Stewart, L. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046042 · Cited by 232 · cited 1×
“This analysis followed a two-stage individual participant data meta-analysis approach (e.g., Stewart et al., 2012; Tierney et al., 2015).”
MethodWeighting by Inverse Variance or by Sample Size in Random-Effects Meta-Analysis
Marín-Martínez, F., & Sánchez-Meca, J. (2010) · Educational and Psychological Measurement · doi:10.1177/0013164409344534 · Cited by 213 · cited 1×
“To meta-analyze the standardized beta-coefficients from the lagmodels (RQ 1, 2), each coefficient was weighted in inverse proportion to its variance (inverse-variance weighting; e.g., Borenstein et al., 2009; Marín-Martínez & Sánchez-Meca, 2010).”
MethodThe ups and downs of psychotherapy: Sudden gains and sudden losses identified with session reports
Lutz, W., Ehrlich, T., Rubel, J., Hallwachs, N., Röttger, M.-A., Jorasz, C., Mocanu, S., Vocks, S., Schulte, D., & Tschitsaz-Stucki, A. (2013) · Psychotherapy Research · doi:10.1080/10503307.2012.693837 · Cited by 189 · cited 1×
“…that early treatment response is predictive of posttreatment outcome (e.g., Delgadillo et al., 2014; Linardon, Brennan, & de la Piedad Garcia, 2016; Lutz et al., 2013, 2014; Lutz, Stulz, & Köck, 2009; Nazar et al., 2017; Rubel, Lutz, & Schulte, 2015; Shalom et al., 2018; Wucherpfennig, Rubel,…”
BackgroundSelf-citationCrits-Christoph, P., Gibbons, M. B. C., Crits-Christoph, K., Narducci, J., Schamberger, M., & Gallop, R. (2006) · Psychotherapy Research · doi:10.1080/10503300500268557 · Cited by 188
Self-citationLutz, W., Stulz, N., & Köck, K. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.01.019 · Cited by 186
Self-citationToward a working through of some core conflicts in psychotherapy research
Barber, J. P. (2009) · Psychotherapy Research · doi:10.1080/10503300802609680 · Cited by 183 · cited 2×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. alliance–outcome relation (e.g., Barber, 2009; Crits-Christoph, Connolly Gibbons, & Mukherjee, 2013; DeRubeis, Brotman, & Gibbons, 2005).”
BackgroundSelf-citationCultural difference and the therapeutic alliance: An evidence-based analysis.
Vasquez, M. J. T. (2007) · American Psychologist · doi:10.1037/0003-066x.62.8.878 · Cited by 182 · cited 1×
“Clearly, further research is necessary to better understand the potential generalizability of effects across (sub-) cultural contexts (e.g., Errázuriz & ZilchaMano, 2018; Flückiger, Del Re, et al., 2013; Kumar, Kuria, Othieno, & Falkenström, 2018; Vasquez, 2007).”
BackgroundStrunk, D. R., Brotman, M. A., & DeRubeis, R. J. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.03.011 · Cited by 169 · cited 3×
“Time-specific and outside-therapy confounds, for example, intersession processes, could have impact the results (see, e.g., Hartmann, Orlinsky, & Zeeck, 2011; Kaiser & Laireiter, 2019; Quirk, Smith, & Owen, 2018; Strunk et al., 2010).”
BackgroundSelf-citationDynamic models of individual change in psychotherapy process research.
Falkenström, F., Finkel, S., Sandell, R., Rubel, J. A., & Holmqvist, R. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000203 · Cited by 147 · cited 2×
“By focusing on WP associations, potentially confounding effects of more stable person-specific characteristics were controlled for, which may allow a firmer conclusion regarding the bidirectional or interactive nature of these variables (e.g., Falkenström et al., 2017).”
BackgroundMethodSelf-citationPsychotherapy Process-Outcome Research
Crits-Christoph, P. F., Gibbons, M. B. C., & Mukherjee, D. (2013) · Cited by 141
Self-citationResearch on the alliance: Knowledge in search of a theory
Horvath, A. O. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1373204 · Cited by 137 · cited 4×
“…meta-analytic synthesis of the overall association between the alliance assessed early in treatment and treatment outcome indicated that the early alliance predicted on average 5% of the variance in therapy outcomes including dropout rates (k 295; Flückiger, Del Re, Wampold, & Horvath, 2018).”
BackgroundSelf-citationFlückiger, C., Del Re, A. C., Wlodasch, D., Horvath, A. O., Solomonov, N., & Wampold, B. E. (2020) · Journal of Counseling Psychology · doi:10.1037/cou0000424 · Cited by 135
Self-citationHow collaboration in therapy becomes therapeutic: The therapeutic collaboration coding system
Ribeiro, E., Ribeiro, A. P., Gonçalves, M. M., Horvath, A. O., & Stiles, W. B. (2013) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/j.2044-8341.2012.02066.x · Cited by 126
Self-citationHawley, L. L., Ho, M.-H. R., Zuroff, D. C., & Blatt, S. J. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.5.930 · Cited by 125
Zilcha-Mano, S., Muran, J. C., Hungr, C., Eubanks, C. F., Safran, J. D., & Winston, A. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000058 · Cited by 124
Self-citationEarly changes, attrition, and dose–response in low intensity psychological interventions
Delgadillo, J., McMillan, D., Lucock, M., Leach, C., Ali, S., & Gilbody, S. (2014) · British Journal of Clinical Psychology · doi:10.1111/bjc.12031 · Cited by 122 · cited 1×
“Research across a variety of disorders and orientations has found that early treatment response is predictive of posttreatment outcome (e.g., Delgadillo et al., 2014; Linardon, Brennan, & de la Piedad Garcia, 2016; Lutz et al., 2013, 2014; Lutz, Stulz, & Köck, 2009; Nazar et al., 2017; Rubel, Lutz,…”
BackgroundLutz, W., Hofmann, S. G., Rubel, J., Boswell, J. F., Shear, M. K., Gorman, J. M., Woods, S. W., & Barlow, D. H. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035535 · Cited by 122 · cited 1×
“…that early treatment response is predictive of posttreatment outcome (e.g., Delgadillo et al., 2014; Linardon, Brennan, & de la Piedad Garcia, 2016; Lutz et al., 2013, 2014; Lutz, Stulz, & Köck, 2009; Nazar et al., 2017; Rubel, Lutz, & Schulte, 2015; Shalom et al., 2018; Wucherpfennig, Rubel,…”
BackgroundSelf-citationThe Therapeutic Alliance: An Evidence-Based Guide to Practice
Muran, J. C., & Barber, J. P. (2010) · Cited by 120
Self-citationFalkenström, F., Ekeblad, A., & Holmqvist, R. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000119 · Cited by 103
Self-citationEmotional experience and alliance contribute to therapeutic change in psychodynamic therapy.
Fisher, H., Atzil-Slonim, D., Bar-Kalifa, E., Rafaeli, E., & Peri, T. (2016) · Psychotherapy · doi:10.1037/pst0000041 · Cited by 82
Self-citationOn Standardizing Within-Person Effects: Potential Problems of Global Standardization
Wang, L., Zhang, Q., Maxwell, S. E., & Bergeman, C. S. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1532280 · Cited by 82
Lorenzo-Luaces, L., DeRubeis, R. J., & Webb, C. A. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035994 · Cited by 81
Self-citationBeard, J. I. L., & Delgadillo, J. (2019) · Depression and Anxiety · doi:10.1002/da.22931 · Cited by 81 · cited 3×
“…of therapy is critical to the success of therapy, a conjecture that is widely accepted across theoretical orientations (e.g., Barber et al., 2014; Beard & Delgadillo, 2019; Gmeinwieser, Hagmayer, Pieh, & Probst, 2019; Kivity, Levy, Kolly, & Kramer, 2020; Norcross & Goldfried, 2019; Spencer,…”
BackgroundResultInfluentialZilcha-Mano, S., & Errázuriz, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000192 · Cited by 76
Self-citationRubel, J. A., Rosenbaum, D., & Lutz, W. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.12.007 · Cited by 75
Self-citationReciprocal influence of alliance to the group and outcome in day treatment for eating disorders.
Tasca, G. A., & Lampard, A. M. (2012) · Journal of Counseling Psychology · doi:10.1037/a0029947 · Cited by 68
Self-citationXu, H., & Tracey, T. J. G. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000089 · Cited by 68 · cited 1×
“…studies used a multilevel framework, we a priori defined parsimonious multilevel models that can be applied within an open source software (for studies using a structural equation framework see, e.g., Falkenström, Finkel, Sandell, Rubel, & Holmqvist, 2017; Rubel et al., 2019; Xu & Tracey, 2015).”
MethodSelf-citationDeveloping a collaborative relationship with clients during the initial sessions of psychotherapy.
Spencer, J., Goode, J., Penix, E. A., Trusty, W. T., & Swift, J. K. (2019) · Psychotherapy · doi:10.1037/pst0000208 · Cited by 65 · cited 1×
“…Gaines, Rieger, & Connolly Gibbons, 2020; Hofmann & Hayes, 2019; Muran & Barber, 2010; Norcross & Goldfried, 2019; Norcross & Lambert, 2019; Wampold & Imel, 2015), particularly, early in therapy (e.g., Beard & Delgadillo, 2019; Howard et al., 1993; Spencer et al., 2019; Wucherpfennig et al., 2017).”
Alliance and outcome in varying imagery procedures for PTSD: A study of within-person processes.
Hoffart, A., Øktedalen, T., Langkaas, T. F., & Wampold, B. E. (2013) · Journal of Counseling Psychology · doi:10.1037/a0033604 · Cited by 61
Self-citationBarber, J. P., Zilcha-Mano, S., Gallop, R., Barrett, M., McCarthy, K. S., & Dinger, U. (2014) · Psychotherapy Research · doi:10.1080/10503307.2013.871080 · Cited by 57 · cited 1×
“…that the first phase of therapy is critical to the success of therapy, a conjecture that is widely accepted across theoretical orientations (e.g., Barber et al., 2014; Beard & Delgadillo, 2019; Gmeinwieser, Hagmayer, Pieh, & Probst, 2019; Kivity, Levy, Kolly, & Kramer, 2020; Norcross &…”
BackgroundSelf-citationFlückiger, C., Del Re, A. C., Horvath, A. O., Symonds, D., Ackert, M., & Wampold, B. E. (2013) · Journal of Counseling Psychology · doi:10.1037/a0033161 · Cited by 50
Self-citationThe Consequence of Ignoring a Level of Nesting in Multilevel Analysis: A Comment
Van Landeghem, G., De Fraine, B., & Van Damme, J. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4004_2 · Cited by 47
Wucherpfennig, F., Rubel, J. A., Hofmann, S. G., & Lutz, W. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000263 · Cited by 46 · cited 6×
“Thus, the results of this study (across RQs1, 2) support a positive upward spiral of higher alliance/lower symptoms that facilitates higher alliances and lower symptoms in the subsequent sessions early in therapy (Flückiger, Del Re, et al., 2013; Grawe, 2004; Wucherpfennig et al., 2017).”
BackgroundResultSelf-citationRubel, J. A., Zilcha‐Mano, S., Feils-Klaus, V., & Lutz, W. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000286 · Cited by 46
Self-citationHartmann, A., Orlinsky, D., & Zeeck, A. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20826 · Cited by 44
Shalom, J. G., Gilboa‐Schechtman, E., Atzil–Slonim, D., Bar‐Kalifa, E., Hasson‐Ohayon, I., van Oppen, P., van Balkom, A. J. L. M., & Aderka, I. M. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000344 · Cited by 44 · cited 1×
“…response is predictive of posttreatment outcome (e.g., Delgadillo et al., 2014; Linardon, Brennan, & de la Piedad Garcia, 2016; Lutz et al., 2013, 2014; Lutz, Stulz, & Köck, 2009; Nazar et al., 2017; Rubel, Lutz, & Schulte, 2015; Shalom et al., 2018; Wucherpfennig, Rubel, Hofmann, & Lutz, 2017).”
Self-citationRubel, J., Lutz, W., & Schulte, D. (2015) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1868 · Cited by 42
Self-citationSasso, K. E., Strunk, D. R., Braun, J. D., DeRubeis, R. J., & Brotman, M. A. (2016) · Psychotherapy Research · doi:10.1080/10503307.2015.1026423 · Cited by 41 · cited 1×
“…of alliance and its relation to early symptoms vary across researchers; for example, in cognitive–behavioral therapy (e.g., Coyne, Constantino, Westra, & Antony, 2019; Sasso et al., 2016; Strunk et al., 2010) as well as in psychodynamic-oriented therapies (e.g., Barber, 2009; Zilcha-Mano, 2017).”
BackgroundSelf-citationBrattland, H., Høiseth, J. R., Burkeland, O., Inderhaug, T. S., Binder, P. E., & Iversen, V. C. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1246768 · Cited by 39 · cited 1×
“Clearly, further research should focus on improved detection and understanding of (at risk) patients with high symptoms and low alliances that do not show a positive upward spiral early in treatment (e.g., Brattland et al., 2018; Lambert, Whipple, & Kleinstäuber, 2018; Wucherpfennig et al., 2017).”
BackgroundFlückiger, C., Hilpert, P., Goldberg, S. B., Caspar, F., Wolfer, C., Held, J., & Vîslă, A. (2019) · Journal of Counseling Psychology · doi:10.1037/cou0000336 · Cited by 39 · cited 1×
“Further research is necessary to better understand to what extent the outcome definition and assessment method may affect the association between process-based psychotherapy factors such as the alliance and outcome (e.g., Flückiger et al., 2019).”
BackgroundSelf-citationWebb, C. A., Beard, C., Auerbach, R. P., Menninger, E., & Björgvinsson, T. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.015 · Cited by 38
Self-citationWeiss, M., Kivity, Y., & Huppert, J. D. (2014) · Psychotherapy Research · doi:10.1080/10503307.2013.868947 · Cited by 38 · cited 2×
“Weiss, Kivity, and Huppert (2014) made a critical innovation when they assessed alliance pre- and postsession in a cognitive–behavioral therapy for panic disorder.”
BackgroundSelf-citationEvidence-Based Practice and Psychological Treatments.
Huppert, J. D., Fabbro, A., & Barlow, D. H. (2007) · Evidence-based psychotherapy: Where practice and research meet. · doi:10.1037/11423-006 · Cited by 38
Self-citationEmpirical Benchmarks for Interpreting Effect Size Variability in Meta-Analysis
Wiernik, B., Kostal, J. W., Wilmot, M. P., Dilchert, S., & Ones, D. (2017) · Industrial and Organizational Psychology · doi:10.1017/iop.2017.44 · Cited by 38
Alliance theory and measurement.
Hatcher, R. L. (2010) · Cited by 37
Errázuriz, P., & Zilcha-Mano, S. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000277 · Cited by 35
Self-citationHuppert, J. D., Kivity, Y., Cohen, L., Strauss, A. Y., Elizur, Y., & Weiss, M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.08.002 · Cited by 31 · cited 2×
“Three authors provided an additional three data sets (Falkenström, Kuria, Othieno, & Kumar, 2019; Huppert et al., 2018; Rubel et al., 2019).”
BackgroundSelf-citationFalkenström, F., Solomonov, N., & Rubel, J. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1769875 · Cited by 31
Self-citationInterpersonal agency as predictor of the within-patient alliance effects on depression severity.
Penedo, J. M. G., Babl, A., Krieger, T., Heinonen, E. O., Flückiger, C., & Holtforth, M. G. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000475 · Cited by 29 · cited 2×
“For example, patients who perceive themselves as “too friendly” may report socially desirable strong alliances with their therapists (e.g., Coyne et al., 2019; Dinger, Strack, Sachsse, & Schauenburg, 2009; Gómez Penedo et al., 2020) and they may be more cautious in reporting negative events in the relationship, such a…”
BackgroundSelf-citationFalkenström, F., Kuria, M. W., Othieno, C. J., & Kumar, M. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000363 · Cited by 27
Self-citationClient Common Factors Represented by Client Motivation and Autonomy
Scheel, M. (2010) · The Counseling Psychologist · doi:10.1177/0011000010375309 · Cited by 26 · cited 1×
“Moreover, the results support the importance of active patient involvement in therapist–patient collaboration early in therapy (e.g., Ryan, Lynch, Vansteenkiste, & Deci, 2011; Scheel, 2011; Pope & Vasquez, 2016).”
ResultCoyne, A., Constantino, M., Westra, H., & Antony, M. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000394 · Cited by 26 · cited 1×
“For example, patients who perceive themselves as “too friendly” may report socially desirable strong alliances with their therapists (e.g., Coyne et al., 2019; Dinger, Strack, Sachsse, & Schauenburg, 2009; Gómez Penedo et al., 2020) and they may be more cautious in reporting negative events in the…”
BackgroundWorking along sudden gains: Responsiveness on small and subtle early changes and exceptions.
Flückiger, C., Holtforth, M. G., Re, A. C. D., & Lutz, W. (2013) · Psychotherapy · doi:10.1037/a0031940 · Cited by 22
Self-citationKaiser, T., & Laireiter, A. (2018) · Psychotherapy Research · doi:10.1080/10503307.2018.1497213 · Cited by 20
Rubel, J. A., Hilpert, P., Wolfer, C., Held, J., Vîslă, A., & Flückiger, C. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000433 · Cited by 19 · cited 3×
“Preliminary results indicated that patients who rate alliance higher (i.e., BP effects) also report higher alliance–symptom effects (WP effects) compared with patients with lower average alliance ratings (e.g., Hoffart, Øktedalen, Langkaas, & Wampold, 2013; Rubel et al., 2019).”
BackgroundMethodResultSelf-citationTherapeutic alliance and binge-eating outcomes in a group therapy context.
Tasca, G. A., Compare, A., Zarbo, C., & Brugnera, A. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000159 · Cited by 18
Self-citationCommon change factors and mediation of the alliance–outcome link during treatment of depression.
Schwartz, C., Hilbert, S., Schlegl, S., Diedrich, A., & Voderholzer, U. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000302 · Cited by 18
Self-citationKumar, M., Kuria, M. W., Othieno, C. J., & Falkenström, F. (2018) · International Journal of Mental Health Systems · doi:10.1186/s13033-018-0254-7 · Cited by 16
Self-citationKivity, Y., Levy, K. N., Kolly, S., & Kramer, U. (2020) · Journal of Personality Disorders · doi:10.1521/pedi_2019_33_376 · Cited by 14
Self-citationIn here and out there: Systemic alliance and intersession processes in psychotherapy.
Quirk, K. M., Smith, A. D., & Owen, J. J. (2018) · Professional Psychology Research and Practice · doi:10.1037/pro0000174 · Cited by 10
Gmeinwieser, S., Hagmayer, Y., Pieh, C., & Probst, T. (2019) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2381 · Cited by 9
Alliance predicts patients' outcome beyond in-treatment change in symptoms.
Barber, J. P., Connolly, M. B., Crits-Christoph, P., Gladis, L., & Siqueland, L. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.6.1027 · Cited by 8
Self-citation
Cited by
Therapeutic alliance as a mediator of change: A systematic review and evaluation of research
Baier, A. L., Kline, A. C., & Feeny, N. C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101921 · Cited by 441
The alliance in mental health care: conceptualization, evidence and clinical applications
Wampold, B. E., & Flückiger, C. (2023) · World Psychiatry · doi:10.1002/wps.21035 · Cited by 213
Self-citationTherapeutic alliance and rapport modulate responses to psilocybin assisted therapy for depression
Murphy, R., Kettner, H., Zeifman, R., Giribaldi, B., Kartner, L., Martell, J., Read, T., Murphy-Beiner, A., Baker-Jones, M., Nutt, D., et al. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.788155 · Cited by 250
Flückiger, C., Del Re, A. C., Wlodasch, D., Horvath, A. O., Solomonov, N., & Wampold, B. E. (2020) · Journal of Counseling Psychology · doi:10.1037/cou0000424 · Cited by 135
Self-citationMeasurement-Based and Data-Informed Psychological Therapy
Lutz, W., Schwartz, B., & Delgadillo, J. (2022) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-071720-014821 · Cited by 127
Self-citation
Metadata
- Authors
- Flückiger, C., Rubel, J., Del Re, A. C., Horvath, A. O., Wampold, B. E., Crits-Christoph, P., Atzil-Slonim, D., Compare, A., Falkenström, F., Ekeblad, A., Errázuriz, P., Fisher, H., Hoffart, A., Huppert, J. D., Kivity, Y., Kumar, M., Lutz, W., Muran, J. C., Strunk, D. R., Tasca, G. A., Vîslă, A., Voderholzer, U., Webb, C. A., Xu, H., Zilcha-Mano, S., & Barber, J. P.
- Affiliations
- Simon Fraser University (CA)
- Loyola University Chicago (US)
- ORCID
- Flückiger, Christoph
- Rubel, Julian
- Horvath, Adam O.
- Wampold, Bruce E.
- Crits-Christoph, Paul
- Compare, Angelo
- Falkenström, Fredrik
- Ekeblad, Annika
- Errázuriz, Paula
- Fisher, Hadar
- Hoffart, Asle
- Huppert, Jonathan D.
- Kivity, Yogev
- Kumar, Manasi
- Lutz, Wolfgang
- Muran, John Christopher
- Strunk, Daniel R.
- Tasca, Giorgio A.
- Vîslă, Andreea
- Voderholzer, Ulrich
- Webb, Christian A.
- Xu, Hui
- Barber, Jacques P.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2020-09
- Volume
- 88
- Issue
- 9
- Pages
- 829-843
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W3047065905
- Cited by
- 180
- References
- 98
- Citations by year
- 2026: 35 · 2025: 21 · 2024: 29 · 2023: 28 · 2022: 40 · 2021: 18 · 2020: 8
- FWCI
- 9.39
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Aisberg (University of Bergamo) (submittedVersion)
- Universidad de Chile (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Swiss National Science Foundation (PP00P1_163702)
- University of Zurich (STWF-19-018)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychoanalysis and Psychopathology Research
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- therapeutic relationship, reciprocal effects, lagged effects, upward spiral, therapeutic process, symptom relief
- MeSH terms
- Therapeutic Alliance, Mental Disorders, Humans, Psychotherapy, Databases, Factual, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.