What the future holds: Machine learning to predict success in psychotherapy
Abstract
Machine learning (ML) may help to predict successful psychotherapy outcomes and to identify relevant predictors of success. So far, ML applications are scant in psychotherapy research and they are typically based on small samples or focused on specific diagnoses. In this study, we predict successful therapy outcomes with ML in a heterogeneous sample in routine outpatient care. We trained established ML models (decision trees and ensembles of them) with routinely collected clinical baseline information from n = 685 outpatients to predict a successful outcome of cognitive behavioral therapy. Treatment success was defined as clinically significant change (CSC) on the Brief-Symptom-Checklist (reached by 326 patients; 48%). The best performing model (Gradient Boosting Machines) achieved a balanced accuracy of 69% (p < .001) on unseen validation data. Out of 383 variables, we identified the 16 most important predictors, which were still able to predict CSC with 67% balanced accuracy. Our study demonstrates that ML models built on data, which is typically available at the outset of therapy, can predict whether an individual will substantially benefit from the intervention. Some of the predictors were theoretically expected (e.g., level of functioning), but others need further validation (e.g., somatization). From a theoretical and practical perspective, ML is clearly an attractive addition to more established psychotherapy research methodology.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Traditionally, the combination of AI and psychotherapy has been used to retrospectively evaluate large amounts of data once a psychological intervention has finished, to evaluate outcome data that can predict a better response to a given psychological treatment or to identify risks for becoming a not-on-track patient once the treatment ended.
“Traditionally, the combination of AI and psychotherapy has been used to retrospectively evaluate large amounts of data once a psychological intervention has finished (i.e., to evaluate the outcome data that can predict a better response to a given psychological treatment or to identify risks for becoming a not-on-track patient once the treatment ended) [87].”
From Using Artificial Intelligence to Enhance Ongoing Psychological Interventions for Emotional Problems in Real- or Close to Real-Time: A Systematic Review (2022) · cites this paper as [87]
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156 · see citing works
Feature Selection with the <b>Boruta</b> Package
Kursa, M. B., & Rudnicki, W. R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i11 · Cited by 5,659 · see citing works
International Statistical Classification of Diseases and Related Health Problems
(2010) · Springer eBooks · doi:10.1007/978-0-387-79948-3_3055 · Cited by 4,181 · see citing works
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445 · see citing works
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215 · see citing works
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · see citing works
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,930 · see citing works
The Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816 · see citing works
Riley, R. D., Snell, K. I., Ensor, J., Burke, D. L., Harrell Jr, F. E., Moons, K. G., & Collins, G. S. (2019) · Statistics in Medicine · doi:10.1002/sim.7992 · Cited by 1,409 · see citing works
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346 · see citing works
Keller, M. B., McCullough, J. P., Klein, D. N., Arnow, B., Dunner, D. L., Gelenberg, A. J., Markowitz, J. C., Nemeroff, C. B., Russell, J. M., Thase, M. E., et al. (2000) · New England Journal of Medicine · doi:10.1056/nejm200005183422001 · Cited by 1,331 · see citing works
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294 · see citing works
Machine Learning Approaches for Clinical Psychology and Psychiatry
Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045037 · Cited by 966 · see citing works
Cross-validation failure: Small sample sizes lead to large error bars
Varoquaux, G. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.061 · Cited by 897 · see citing works
A gradient boosting method to improve travel time prediction
Zhang, Y., & Haghani, A. E. (2015) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2015.02.019 · Cited by 844 · see citing works
Medically Unexplained Physical Symptoms, Anxiety, and Depression: A Meta-Analytic Review
Henningsen, P., Zimmermann, T., & Sattel, H. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000075977.90337.e7 · Cited by 829 · see citing works
Clinical Handbook of Psychological Disorders: A Step-by-Step Treatment Manual
Barnaby, B. (2015) · Occupational Medicine · doi:10.1093/occmed/kqv128 · Cited by 816 · see citing works
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · see citing works
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676 · see citing works
Patient-focused research: Using patient outcome data to enhance treatment effects.
Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.2.159 · Cited by 602 · see citing works
Meta-analysis of comparative therapy outcome studies: a replication and refinement.
Shapiro, D. A., & Shapiro, D. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.581 · Cited by 590 · see citing works
Cuijpers, P., Karyotaki, E., Weitz, E., Andersson, G., Hollon, S. D., & van Straten, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.02.026 · Cited by 586 · see citing works
Psychotherapy relationships that work III.
Norcross, J. C., & Lambert, M. J. (2018) · Psychotherapy · doi:10.1037/pst0000193 · Cited by 578 · see citing works
Predicting Risk of Suicide Attempts Over Time Through Machine Learning
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017) · Clinical Psychological Science · doi:10.1177/2167702617691560 · Cited by 571 · see citing works
A lab test and algorithms for identifying clients at risk for treatment failure.
Hannan, C. R., Lambert, M., Harmon, C., Nielsen, S. L., Smart, D., Shimokawa, K., & Sutton, S. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 550 · see citing works
Bischl, B., Lang, M., Kotthoff, L., Schratz, P., Schiffner, J., Richter, J., Jones, Z., Casalicchio, G., Gallo, M., & Binder, M. (2013) · doi:10.32614/cran.package.mlr · Cited by 506 · see citing works
Eddy, K. T., Dutra, L., Bradley, R., & Westen, D. (2004) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.08.004 · Cited by 475 · see citing works
Handbook of Psychological Assessment in Primary Care Settings
(2000) · Routledge eBooks · doi:10.4324/9781315827346 · Cited by 471 · see citing works
An investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394 · see citing works
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037/0022-0167.50.1.59 · Cited by 374 · see citing works
What works for whom: Tailoring psychotherapy to the person
Norcross, J. C., & Wampold, B. E. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20764 · Cited by 338 · see citing works
Comparisons of nomograms and urologists' predictions in prostate cancer.
Ross, P., Gerigk, C., Gonen, M., Yossepowitch, O., Cagiannos, I., Sogani, P., Scardino, P., & Kattan, M. (2002) · Seminars in Urologic Oncology · doi:10.1053/suro.2002.32490 · Cited by 309 · see citing works
A comparison of random forests, boosting and support vector machines for genomic selection
Ogutu, J. O., Piepho, H., & Schulz‐Streeck, T. (2011) · BMC Proceedings · doi:10.1186/1753-6561-5-s3-s11 · Cited by 303 · see citing works
Specht, M., Kattan, M., Gonen, M., Fey, J., & Zee, K. V. (2005) · Annals of Surgical Oncology · doi:10.1245/aso.2005.06.037 · Cited by 290 · see citing works
Clinical Significance Methods: A Comparison of Statistical Techniques
Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8201_11 · Cited by 258 · see citing works
Use of machine learning to analyse routinely collected intensive care unit data: a systematic review
Shillan, D., Sterne, J. A. C., Champneys, A., & Gibbison, B. (2019) · Critical Care · doi:10.1186/s13054-019-2564-9 · Cited by 251 · see citing works
Malley, J. D., Kruppa, J., Dasgupta, A., Malley, K. G., & Ziegler, A. (2011) · Methods of Information in Medicine · doi:10.3414/me00-01-0052 · Cited by 242 · see citing works
Therapist effects in outpatient psychotherapy: A three-level growth curve approach.
Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007) · Journal of Counseling Psychology · doi:10.1037/0022-0167.54.1.32 · Cited by 233 · see citing works
Koutsouleris, N., Kahn, R. S., Chekroud, A. M., Leucht, S., Falkai, P., Wobrock, T., Derks, E. M., Fleischhacker, W., & Hasan, A. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30171-7 · Cited by 217 · see citing works
Driessen, E., Cuijpers, P., Hollon, S. D., & Dekker, J. J. M. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020570 · Cited by 208 · see citing works
Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A.-K. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103438 · Cited by 196 · see citing works
Using patient self-reports to study heterogeneity of treatment effects in major depressive disorder
Kessler, R. C., van Loo, H. M., Wardenaar, K. J., Bossarte, R. M., Brenner, L. A., Ebert, D. D., de Jonge, P., Nierenberg, A. A., Rosellini, A. J., Sampson, N. A., et al. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000020 · Cited by 193 · see citing works
Cognitive therapy of depression
Hamilton, K. E., & Dobson, K. S. (2002) · Clinical Psychology Review · doi:10.1016/s0272-7358(02)00106-x · Cited by 191 · see citing works
Westbrook, D., & Kirk, J. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.09.006 · Cited by 183 · see citing works
A Scoping Review of Machine Learning in Psychotherapy Research
Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1808729 · Cited by 179 · see citing works
Knopp, J., Knowles, S., Bee, P., Lovell, K., & Bower, P. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.08.008 · Cited by 164 · see citing works
Pharmacotherapy and psychotherapy for body dysmorphic disorder
Ipser, J., Sander, C., & Stein, D. J. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005332.pub2 · Cited by 151 · see citing works
Cohen, Z. D., Kim, T. T., Van, H. L., Dekker, J., & Driessen, E. (2019) · Psychotherapy Research · doi:10.1080/10503307.2018.1563312 · Cited by 122 · see citing works
Psychophysiological Assessment During Exposure in Driving Phobic Patients.
Alpers, G. W., Wilhelm, F. H., & Roth, W. T. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.1.126 · Cited by 107 · see citing works
Self-citationEmpirical comparison of tree ensemble variable importance measures
Auret, L., & Aldrich, C. (2010) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2010.12.004 · Cited by 106 · see citing works
Case complexity as a guide for psychological treatment selection.
Delgadillo, J., Huey, D., Bennett, H., & McMillan, D. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000231 · Cited by 105 · see citing works
Personality traits and disorders in obsessive-compulsives
Steketee, G. S. (1990) · Journal of Anxiety Disorders · doi:10.1016/0887-6185(90)90032-5 · Cited by 104 · see citing works
Lutz, W., Lambert, M. J., Harmon, S. C., Tschitsaz, A., Schürch, E., & Stulz, N. (2006) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.496 · Cited by 103 · see citing works
Goddard, E., Wingrove, J., & Moran, P. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.07.006 · Cited by 96 · see citing works
Therapeutic alliance evaluation in personality disorders psychotherapy
Lingiardi, V., Filippucci, L., & Baiocco, R. (2005) · Psychotherapy Research · doi:10.1080/10503300512331327047 · Cited by 95 · see citing works
Supervised machine learning methods in psychology: A practical introduction with annotated R code
Rosenbusch, H., Soldner, F., Evans, A. M., & Zeelenberg, M. (2021) · Social and Personality Psychology Compass · doi:10.1111/spc3.12579 · Cited by 86 · see citing works
Individual treatment selection for patients with posttraumatic stress disorder
Deisenhofer, A., Delgadillo, J., Rubel, J. A., Boehnke, J. R., Zimmermann, D., Schwartz, B., & Lutz, W. (2018) · Depression and Anxiety · doi:10.1002/da.22755 · Cited by 85 · see citing works
Positive schizotypal symptoms predict treatment outcome in obsessive–compulsive disorder
Moritz, S., Fricke, S., Jacobsen, D., Kloss, M., Wein, C., Rufer, M., Katenkamp, B., Farhumand, R., & Hand, I. (2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(03)00120-7 · Cited by 80 · see citing works
Prediction of remission in obsessive compulsive disorder using a novel machine learning strategy
Askland, K. D., Garnaat, S., Sibrava, N. J., Boisseau, C. L., Strong, D., Mancebo, M., Greenberg, B., Rasmussen, S., & Eisen, J. (2015) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1463 · Cited by 75 · see citing works
Hamm, A. O., Richter, J., Pané‐Farré, C. A., Westphal, D., Wïttchen, H., Voßbeck-Elsebusch, A. N., Gerlach, A. L., Gloster, A. T., Ströhle, A., Lang�, T., et al. (2016) · Psychophysiology · doi:10.1111/psyp.12553 · Cited by 72 · see citing works
Self-citationHoyer, J., Wiltink, J., Hiller, W., Miller, R. E., Salzer, S., Sarnowsky, S., Stangier, U., Strauss, B. M., Willutzki, U., & Leibing, E. (2014) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1936 · Cited by 69 · see citing works
Clinical prediction in group psychotherapy
Chapman, C. L., Burlingame, G. M., Gleave, R., Rees, F., Beecher, M. E., & Porter, G. S. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.702512 · Cited by 66 · see citing works
Fricke, S., Moritz, S., Andresen, B., Jacobsen, D., Kloss, M., Rufer, M., & Hand, I. (2005) · European Psychiatry · doi:10.1016/j.eurpsy.2005.03.010 · Cited by 64 · see citing works
Allen, L. A., Gara, M. A., Escobar, J. I., Waitzkin, H. B., & Silver, R. C. (2001) · Psychosomatics · doi:10.1176/appi.psy.42.1.63 · Cited by 62 · see citing works
A review on predictors of treatment outcome in social anxiety disorder
Mululo, S. C. C., de Menezes, G. B., Vigne, P., & Fontenelle, L. F. (2012) · Brazilian Journal of Psychiatry · doi:10.1590/s1516-44462012000100016 · Cited by 59 · see citing works
Predicting patients who will drop out of out-patient psychotherapy using machine learning algorithms
Bennemann, B., Schwartz, B., Giesemann, J., & Lutz, W. (2022) · British Journal of Psychiatry · doi:10.1192/bjp.2022.17 · Cited by 55 · see citing works
Hilbert, K., Kunas, S. L., Lueken, U., Kathmann, N., Fydrich, T., & Fehm, L. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103530 · Cited by 54 · see citing works
Rayner, C., Coleman, J. R. I., Purves, K. L., Hodsoll, J. P., Goldsmith, K., Alpers, G. W., Andersson, E., Arolt, V., Boberg, J., Bögels, S. M., et al. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0481-y · Cited by 53 · see citing works
Self-citationAlpers, G. W., & Sell, R. (2007) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.11.009 · Cited by 52 · see citing works
Self-citationFlygare, O., Enander, J., Andersson, E., Ljótsson, B., Ivanov, V. Z., Mataix-Cols, D., & Rück, C. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02655-4 · Cited by 51 · see citing works
Cammin-Nowak, S., Helbig-Lang, S., Lang, T., Gloster, A. T., Fehm, L., Gerlach, A. L., Ströhle, A., Deckert, J., Kircher, T., Hamm, A. O., et al. (2013) · Journal of Clinical Psychology · doi:10.1002/jclp.21975 · Cited by 50 · see citing works
Self-citationModel complexity improves the prediction of nonsuicidal self-injury.
Fox, K., Huang, X., Linthicum, K. P., Wang, S. B., Franklin, J., & Ribeiro, J. D. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000421 · Cited by 49 · see citing works
Forand, N. R., Evans, S., Haglin, D., & Fishman, B. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.02.001 · Cited by 47 · see citing works
Lutz, W., Schiefele, A.-K., Wucherpfennig, F., Rubel, J. A., & Stulz, N. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.08.072 · Cited by 46 · see citing works
Avoiding Treatment Failures in the Anxiety Disorders
(2010) · doi:10.1007/978-1-4419-0612-0 · Cited by 41 · see citing works
The effect of therapist experience on psychotherapy outcomes
Leon, S. C., Martinovich, Z., Lutz, W., & Lyons, J. S. (2005) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.473 · Cited by 32 · see citing works
Symons, M., Feeney, G. F. X., Gallagher, M. R., Young, R. M., & Connor, J. P. (2020) · Addiction · doi:10.1111/add.15038 · Cited by 28 · see citing works
The cooperative revolution reaches clinical psychology and psychotherapy: An example from Germany
Margraf, J., Hoyer, J., Fydrich, T., In‐Albon, T., Lincoln, T. M., Lutz, W., Schlarb, A. A., Schöttke, H., Willutzki, U., & Velten, J. (2021) · Clinical Psychology in Europe · doi:10.32872/cpe.4459 · Cited by 23 · see citing works
Cohen, C. I., Goh, K. H., & Gustave, M. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.05.021 · Cited by 22 · see citing works
Avoiding Treatment Failures in Specific Phobias
Alpers, G. W. (2009) · Springer eBooks · doi:10.1007/978-1-4419-0612-0_12 · Cited by 22 · see citing works
Self-citationWeck, F., Grikscheit, F., Höfling, V., Kordt, A., Hamm, A. O., Gerlach, A. L., Alpers, G. W., Arolt, V., Kircher, T. T. J., Pauli, P., et al. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.007 · Cited by 20 · see citing works
Self-citationSalomonsson, S., Santoft, F., Lindsäter, E., Ejeby, K., Ingvar, M., Öst, L.-G., Lekander, M., Ljótsson, B., & Hedman-Lagerlöf, E. (2020) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2019.1669701 · Cited by 20 · see citing works
White, A. P., Umpfenbach, K., & Alpers, G. (2014) · Professional Psychology Research and Practice · doi:10.1037/a0036538 · Cited by 8 · see citing works
Self-citationHauke, C., Gloster, A., Gerlach, A., Hamm, A., Deckert, J., Fehm, L., Alpers, G., Kircher, T., Ströhle, A., Arolt, V., et al. (2013) · International Journal of Research Studies in Psychology · doi:10.5861/ijrsp.2013.335 · Cited by 5 · see citing works
Self-citationLutz, W., Clausen, S. A., Bennemann, B., Zimmermann, D., Prinz, J. N., Rubel, J. A., & Deisenhofer, A. (2019) · Verhaltenstherapie · doi:10.1159/000501026 · Cited by 2 · see citing works
The cooperative revolution reaches Clinical Psychology and Psychotherapy: An example from GermanyPreprint
Margraf, J., Hoyer, J., Fydrich, T., In‐Albon, T., Lincoln, T. M., Lutz, W., Schlarb, A. A., Schöttke, H., Willutzki, U., & Velten, J. (2020) · doi:10.31219/osf.io/h5dta · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 89 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Gual-Montolio, P., Jaén, I., Martínez-Borba, V., Castilla, D., & Suso-Ribera, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19137737 · Cited by 93 · see citing works
“, to evaluate the outcome data that can predict a better response to a given psychological treatment or to identify risks for becoming a not-on-track patient once the treatment ended) [87].”
BackgroundThe future of psychological treatments: The Marburg Declaration
Rief, W., Asmundson, G. J. G., Bryant, R. A., Clark, D. M., Ehlers, A., Holmes, E. A., McNally, R. J., Neufeld, C. B., Wilhelm, S., Jaroszewski, A. C., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102417 · Cited by 54 · see citing works
A review of natural language processing in the identification of suicidal behavior
Young, J. N., Bishop, S., Humphrey, C., & Pavlacic, J. M. (2023) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2023.100507 · Cited by 20 · see citing works
de Vos, J. A., Radstaak, M., Bohlmeijer, E. T., & Westerhof, G. J. (2022) · Psychotherapy Research · doi:10.1080/10503307.2022.2139647 · Cited by 16 · see citing works
“Although predictive models for psychotherapy treatment progress are developing with novel machine learning techniques, they still lack adequate model accuracy to recommend clinicians in their treatment decisions (Taubitz et al., 2022).”
Shayani, D. R., Canale, C. A., Sloan, D. M., & Hayes, A. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104428 · Cited by 15 · see citing works
Peretz, G., Taylor, C. B., Ruzek, J. I., Jefroykin, S., & Sadeh‐Sharvit, S. (2023) · JMIR Formative Research · doi:10.2196/45156 · Cited by 14 · see citing works
“These insights, derived from unobtrusive, passively collected therapy data, can be used to suggest more nuanced and empirically supported interventions [31].”
BackgroundHilbert, K., Böhnlein, J., Meinke, C., Chavanne, A. V., Langhammer, T., Stumpe, L., Winter, N. R., Leenings, R., Adolph, D., Arolt, V., et al. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120639 · Cited by 12 · see citing works
Velten, J., Christiansen, H., Hoyer, J., In‐Albon, T., Lincoln, T. M., Lutz, W., Margraf, J., Schöttke, H., Stark, R. M., Werheid, K., et al. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104691 · Cited by 9 · see citing works
Self-citationArtificial creativity: can there be creativity without cognition?
Pelo, M. D. (2025) · AI & Society · doi:10.1007/s00146-025-02682-3 · Cited by 7 · see citing works
Mahon, D., Minami, T., & Brown, J. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12827 · Cited by 3 · see citing works
Dropout from trauma-focused treatment for PTSD in a naturalistic setting
Semmlinger, V., Takano, K., Wolkenstein, L., Krüger-Gottschalk, A., Kuck, S., Dyer, A., Pittig, A., Alpers, G. W., & Ehring, T. W. (2025) · Clinical Psychology in Europe · doi:10.32872/cpe.14491 · Cited by 4 · see citing works
“However, larger samples may provide more power and enable us to examine even a broader scope of potential predictor variables with modern machine learning ap proaches (see Taubitz et al., 2022).”
Self-citationPontén, M., Flygare, O., Bellander, M., Karemyr, M., Nilbrink, J., Hellner, C., Ojala, O., & Bjureberg, J. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-06391-x · Cited by 3 · see citing works
Penedo, J. M. G., Coyne, A. E., Meglio, M., Fokkema, M., Wassmann, R., Lutz, W., & Rubel, J. A. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104848 · Cited by 2 · see citing works
Ensemble Methods to Optimize Automated Text Classification in Avatar Therapy
Hudon, A., Phraxayavong, K., Potvin, S., & Dumais, A. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4010024 · Cited by 2 · see citing works
Routine Outcome Monitoring Within Child and Adolescent Outpatient Psychotherapy
Huth, D., Ertl, S., Schwenck, C., Lindenberg, K., & Kolar, A. D. R. (2026) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000859 · Cited by 1 · see citing works
“Personality dysfunction captures substantial variability in psychopathology and impairment (Kerber et al., 2024), and the presence of a personality disorder was previously linked to treatment outcome and dropout risk in adult psychotherapy (Mütze et al., 2022; Taubitz et al., 2022).”
Registered report protocol: Stress testing predictive models of ideological prejudice
Thompson, J. L., Cassario, A. L., Vallabha, S., Gnall, S. A., Rice, S., Solanki, P., Carrillo, A., Brandt, M. J., & Wetherell, G. A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308397 · Cited by 1 · see citing works
Bülow, P. (2023) · Journal of Science Humanities and Arts - JOSHA · doi:10.17160/josha.10.5.887
Measurement-Based Care and Applying Statistical Concepts to the Individual Patient
Goldberg, J. F., & Stahl, S. M. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009181549.008
Registered report: Stress testing predictive models of ideological prejudice
Thompson, J. L., Cassario, A. L., Vallabha, S., Gnall, S. A., Rice, S., Solanki, P., Carrillo, A., Brandt, M. J., & Wetherell, G. A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0334152
Navigating Therapy Practice in the Digital World
Bhola, P., Duggal, C., & Isaac, R. (2025) · Springer eBooks · doi:10.1007/978-981-96-9732-8_8
AI-Assisted Precision Psychotherapy: Toward a Process-Based Framework of Therapeutic Interaction
Mendlovic, S. (2026) · Psychiatry International · doi:10.3390/psychiatryint7030124
“Recent efforts to apply precision principles to psychotherapy have focused primarily on predicting treatment outcomes [12,13].”
Artificial intelligence analytics for diagnosis, prognosis, and outcomes prediction
Jalali, S., You, Q., Xu, V., Chen, L., Zini, J., Zamorano, T., Luo, Y., Friesen, T., Fontana, G. J., & Benrimoh, D. A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-33151-0.00009-5
Shi, S., Su, H., Sun, Y., Zhong, N., Jiang, H., Du, J., Chen, T., & Zhao, M. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117407
Weller, P. D., Hilbert, K., Alpers, G. W., Bartholdy, S., Berger, E., Brakemeier, E., Bräscher, A., Brockmeyer, T., Christiansen, H., Equit, M., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-70047-x
Self-citationSiebenhaar, K. U., & Alpers, G. W. (2026) · Journal of Medical Internet Research · doi:10.2196/90732
Self-citation
- Authors
- Taubitz, F.-S., Büdenbender, B., & Alpers, G. W.
- Affiliations
- University of Mannheim (DE)
- Corresponding author
- Alpers, Georg W.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 156
- Pages
- 104116
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W4280525119
- Cited by
- 25
- References
- 89
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 7 · 2023: 4 · 2022: 2
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Behaviour Research and Therapy (publishedVersion)
- PubMed (publishedVersion)
- MADOC (University of Mannheim) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- psychotherapy outcome prediction, cognitive behavioral therapy, treatment response, gradient boosting, decision tree, somatization, predictors of treatment success, outpatient psychotherapy
- MeSH terms
- Machine Learning, Humans, Outpatients, Psychotherapy, Cognitive Behavioral Therapy, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review