The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Predicting personalized process-outcome associations in psychotherapy using machine learning approaches-A demonstration.
Abstract
Objective: Personalized treatment methods have shown great promise in efficacy studies across many fields of medicine and mental health. Little is known, however, about their utility in process-outcome research. This study is the first to apply personalized treatment methods in the field of process-outcome research, as demonstrated based on the alliance-outcome association. Method: Using a sample of 741 patients, individual regressions were fitted to estimate within-patient effects of the alliance-outcome association. The Boruta algorithm was used to identify patient intake characteristics that moderate the within-patient alliance-outcome association. The nearest neighbor approach was used to identify patients whose relevant pretreatment characteristics were similar to those of a target patient. The alliance-outcome associations of the most similar patients were subsequently used to predict the alliance-outcome association of the target patient. Results: Irrespective of the number of selected nearest neighbors, the correlation between the observed and predicted alliance-outcome associations was low and insignificant. According to the true error of the prediction, the demonstrated approach was unable to improve predictions made with a simple comparison model. Conclusion: The study demonstrated the application of personalized treatment methods in process-outcome research and opens many new paths for future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Innovative machine learning approaches might predict trajectories of change based on these data, which can inform pre-treatment and in-session decisions of mental healthcare practices (Cohen and DeRubeis, 2018; Goldberg et al., 2020; Rubel et al., 2020).”
From More Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research (2021) · cites this paper as Rubel et al., 2020
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156
Feature Selection with the Boruta Package
Kursa, M. B., & Rudnicki, W. R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i11 · Cited by 5,659
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238
Bergin and Garfield's Handbook of Psychotherapy and Behavior Change
Lambert, M. J. (2003) · Cited by 3,383
The Path to Personalized Medicine
Hamburg, M. A., & Collins, F. S. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006304 · Cited by 1,970
The alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
Psychotherapy Relationships That Work
Norcross, J. C. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199737208.001.0001 · Cited by 947
Cranford, J. A., Shrout, P. E., Iida, M., Rafaeli, E., Yip, T., & Bolger, N. (2006) · Personality and Social Psychology Bulletin · doi:10.1177/0146167206287721 · Cited by 856
Research works printed but not linked: 2
- Baltagi, B. H. (2013). Economic analysis of panel data. Chichester, United Kingdom: Wiley.
- Hayes, S. C., & Hofmann, S. G. (Eds.). (2018). Process-based CBT: The science and core clinical competencies of cognitive behavioral therapy. Oakland, CA: New Harbinger Publications.
Cited by
A Scoping Review of Machine Learning in Psychotherapy Research
Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1808729 · Cited by 179
Measurement-Based and Data-Informed Psychological Therapy
Lutz, W., Schwartz, B., & Delgadillo, J. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-071720-014821 · Cited by 147
Self-citationHow do you feel? Using natural language processing to automatically rate emotion in psychotherapy
Tanana, M., Soma, C. S., Kuo, P. B., Bertagnolli, N. M., Dembe, A., Pace, B. T., Srikumar, V., Atkins, D. C., & Imel, Z. E. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01531-z · Cited by 107
Complexity in psychological self-ratings: implications for research and practice
Olthof, M., Hasselman, F., & Lichtwarck‐Aschoff, A. (2020) · BMC Medicine · doi:10.1186/s12916-020-01727-2 · Cited by 61
“[88], process-outcome relations in psychotherapy could not be reliably predicted on the basis of processoutcome relations from patients with highly similar pretreatment characteristics.”
BackgroundMore Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research
Domhardt, M., Cuijpers, P., Ebert, D. D., & Baumeister, H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.544129 · Cited by 41
“Innovative machine learning approaches might predict trajectories of change based on these data, which can inform pre-treatment and in-session decisions of mental healthcare practices (Cohen and DeRubeis, 2018; Goldberg et al., 2020; Rubel et al., 2020).”
Background
Metadata
- Authors
- Rubel, J. A., Zilcha-Mano, S., Giesemann, J., Prinz, J., & Lutz, W.
- Affiliations
- Universität Trier (DE)
- Department of Psychology, University of Haifa
- Corresponding author
- Rubel, Julian A.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2019-03-26
- Volume
- 30
- Issue
- 3
- Pages
- 300-309
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2925010062
- Cited by
- 56
- References
- 37
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 4 · 2023: 5 · 2022: 8 · 2021: 11 · 2020: 9 · 2019: 5
- FWCI
- 9.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychotherapy Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- German Research Foundation (LU 660/10-1, LU 660/8-1)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychoanalysis and Psychopathology Research
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- personalized treatment, therapeutic relationship, nearest neighbor prediction, Boruta feature selection, psychotherapy outcome
- MeSH terms
- Machine Learning, Therapeutic Alliance, Adult, Humans, Longitudinal Studies, Outcome and Process Assessment, Health Care, Psychotherapeutic Processes, Precision Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting personalized process-outcome associations in psychotherapy using machine learning approaches-A demonstration. https://app.cochat.ai/papers/10.1080/10503307.2019.1597994
- The paper
- Rubel, J. A., Zilcha-Mano, S., Giesemann, J., Prinz, J., & Lutz, W. (2020). Predicting personalized process-outcome associations in psychotherapy using machine learning approaches-A demonstration. Psychotherapy Research. https://doi.org/10.1080/10503307.2019.1597994
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.