The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 8 of the 52 sources its claims cite were checked for support.
Data-Informed Case Formulation with the Trier Treatment Navigator
Open accessAbstract
The current article presents a way of practising case formulation using technology augmentation in the context of data-informed psychotherapy. First, we explain how case formulation guides the decision-making processes in psychotherapy and how decisions made under an intuitive clinical judgement can be biased. The use of actuarial methods is pointed out as a way of addressing these biases, mainly through clinical decision support systems based on statistical tools and machine learning algorithms. We present the Trier Treatment Navigator (TTN), a clinical decision support system developed in a University research-based clinical training programme. We show how the TTN can contribute to an initial case formulation and its dynamic adaptations during treatment with a clinical case. Finally, we discuss how case formulation and data-informed psychotherapy are aimed at the same goal: treatment personalisation. We argue that case formulation and data-informed psychotherapy enrich and feedback on each other.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This conceptual/clinical case article argues that case formulation (CF) and data-informed psychotherapy share the goal of treatment personalisation and can mutually enrich each other. It illustrates this with the Trier Treatment Navigator (TTN), a clinical decision support system (CDSS), applied to a single case ("Ms. Lux") from intake formulation through dynamic adaptation.
Key findings
- The TTN combines pre-treatment prediction (optimal treatment strategy, dropout probability, psychometric assessment) with a during-treatment feedback system (expected treatment response, dynamic failure boundary) and clinical support tools (CSTs) for critical domains (suicidality risk, motivation/therapy goals, therapeutic alliance, social support and critical life events, emotion- and self-regulation).
- In the case, the TTN flagged a discrepancy between the BSI (85th percentile) and PHQ-9 (35th percentile) depression scores via its coherency tool, and indicated a dropout risk higher than the clinic average; a motivation-oriented strategy was recommended for the first ten sessions.
- In session ten the TTN showed a warning signal above the risk value, with problematic developments in "Motivation/Therapy Goals" and "Therapeutic Alliance"; the therapist identified an alliance rupture ("withdrawal from the therapist") and repaired it using meta-therapeutic communication, after which no more ruptures occurred and the patient reduced her working hours and resumed badminton.
- Cited prior evidence: Lutz et al. (2021b) found therapists who followed recommended treatment strategies in the first 10 sessions obtained a differential effect size of Cohen's d = .30 versus those who did not.
Methods
- Design: conceptual article with an illustrative single clinical case, describing the TTN and its integration into CF; no new empirical data are reported.
- Setting/sample: the Outpatient Psychotherapy Clinic of the University of Trier (CBT-oriented, non-strictly manualised training clinic), with routine outcome monitoring at the start of each session and videotaped sessions; the case is a 48-year-old woman presenting with depressed mood, rumination, loss of interest, social withdrawal and disturbed sleep.
- Measures described: SCID, BSI, PHQ-9, IIP-32, plus session-level alliance and process measures; TTN outputs (coherency tool, dropout risk, treatment strategy recommendation, expected treatment response, risk alerts, CSTs).
Limitations
- Stated in the paper: little is known about the incremental benefit of psychometric assessment on CF; CF reliability research shows mixed results and is considered "modest at best" (Bieling & Kuyken, 2003, p. 52); it is unclear whether reliability problems stem from heuristic/biasing processes or methodological issues, and whether a reliable/valid CF improves outcomes; trials comparing manualised versus CF-tailored therapy found no significant differences (Emmelkamp et al., 1994; Jacobson et al., 1989; Schulte et al., 1992); more prospective studies are needed on treatment recommendation algorithms.
- Stated implementation challenges: need for large routine datasets and ROM embedded in services; need for researcher–clinician collaboration and process/mechanism measures; therapist training, a "feedback culture," and institutional support, given documented therapist reluctance (equipment, finances, time, ecological validity concerns, perceived control, data security).
- Evident from the text: the evidence for the approach rests on a single illustrative case plus cited prior studies, so no causal or generalisable claims about TTN-augmented CF can be drawn from this article itself.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 of 52 cited sources checked · 4 supported · 0 flagged · accuracy not yet measured
- Premisecitation§ the trier treatment navigator and case Formulation
Based on Trier Treatment Navigator information, the therapist can work on an initial case formulation.
“Based on this information, the therapist can work on an initial CF (Schaffrath et al., 2022).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Schaffrath et al., 2022 source
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisecitation§ discussion
More recent developments in data-informed psychotherapy deal with tools from e-mental health apps and intensive longitudinal assessments, which can also be used to create, improve and customize CF.
“More recent developments in data-informed psychotherapy deal with tools from e-mental health apps and intensive longitudinal assessments, which can also be used to create, improve and customize CF (Hehlmann et al., 2021).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Hehlmann et al., 2021 source
The Introduction describes intensive repeated assessments using mobile devices, and the Limitations and Conclusion section says digitally assessed information might help therapists adapt treatment to individual patients. The paper does not say these tools can create, improve, or customize CF specifically; it discusses treatment monitoring and adaptation instead. No page numbers are available in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Premisecitation§ discussion
Practising data-informed psychotherapy with technological augmentation tools (i.e., CDSS, ROM and feedback systems, CSTs) contributes to better treatment outcomes.
“Beyond CF, it has been shown that practising data-informed psychotherapy with technological augmentation tools (i.e., CDSS, ROM and feedback systems, CSTs) contributes to better treatment outcomes (Cohen et al., 2021;de Jong et al., 2021;Delgadillo et al., 2018).”
Quote in the paperSubstantial claim2 of 3 sources checked- cites Cohen et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites de Jong et al., 2021 source
- cites Delgadillo et al., 2018 source
The trial’s discussion of the multilevel models reports that feedback technology improved clinical outcomes, particularly for patients whose progress was not on track. The Procedures section describes the tested tool as outcome-monitoring graphs with automated risk signals. The paper does not establish that every tool listed in the citing sentence improves outcomes; it says that collecting outcome measures alone is not associated with improved outcomes. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Premisecitation§ discussion
Clinicians' behaviour and attitudes, perceived usefulness, and commitment to outcome measurement mediate the impact on the effectiveness of such tools in clinical practice.
“Clinicians' behaviour and attitudes, perceived usefulness, and commitment to outcome measurement mediate the impact on the effectiveness of such tools in clinical practice (de Jong et al., 2021;Lutz et al., 2021b).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites de Jong et al., 2021 source
The paper’s “Mechanisms and moderators” section reports that feedback was effective only among therapists who actively used the reports. Its “Limitations and suggestions for further research” section also identifies therapist expectations as a potential moderator, but says the meta-analysis could not assess it. Our copy does not establish perceived usefulness or commitment to outcome measurement as mediators, so the sentence is more specific and certain than this source supports; page numbers were not available. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites Lutz et al., 2021b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data§ Example of data-informed case Formulation
The Trier Treatment Navigator's coherency tool indicated a deviation of responses on the BSI and PHQ-9 for depressive symptoms.
“The TTN's coherency tool indicated this deviation of responses on the two questionnaires for depressive symptoms (BSI and PHQ-9; Figure 1a).”
Quote in the paperNot a substantial claim
- Findingown data§ Treatment Process and Dynamic Case Formulation Adaptations
After session ten, the therapist saw that Ms. Lux's increased risk warning resulted from problematic developments in the domains of Motivation/Therapy Goals and Therapeutic Alliance.
“After the session, the therapist looked at the TTN and saw that her increased risk warning resulted from problematic developments in the domains of Motivation/Therapy Goals and Therapeutic Alliance (Figure 3).”
Quote in the paperNot a substantial claim - Findingown data§ Example of data-informed case Formulation
The Trier Treatment Navigator calculated an individual dropout risk for Ms. Lux that was higher than the average dropout rate in the clinic.
“Furthermore, the TTN calculated an individual dropout risk, which was higher than the average dropout rate in our clinic (Figure 2a).”
Quote in the paperNot a substantial claim - Findingown data§ Treatment Process and Dynamic Case Formulation Adaptations
In session ten, the Trier Treatment Navigator showed a warning signal that Ms. Lux's assessment rose above the risk value, indicating an increased risk of deterioration.
“After filling out the assessment before the session, the TTN showed a warning signal that Ms. Lux's assessment rose above the risk value, which indicates an increased risk of deterioration.”
Quote in the paperSubstantial claim - Findingown data§ Treatment Process and Dynamic Case Formulation Adaptations
A further inspection of the last measurement showed that Ms. Lux's alliance ratings were low.
“However, a further inspection of the last measurement showed that Ms. Lux's alliance ratings were low.”
Quote in the paperNot a substantial claim - Findingreasoning§ discussion
In Ms. Lux case, based on clinical history, psychometric information and TTN recommendations, the therapist was able to state a case formulation to understand Ms. Lux situation and guide the therapeutic process.
“As shown in Ms. Lux case, based on the clinical history, the psychometric information and the treatment recommendations provided by the TTN, the therapist was able to state a case formulation to understand Ms. Lux situation and guide the therapeutic process.”
Quote in the paperSubstantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
- Findingreasoning§ discussion
With the CF, the therapist could understand and give sense to some of the information revealed by the TTN (e.g., discrepancy between PHQ-9 and BSI depression subscale scores).
“At the same time, with the CF, the therapist could understand and give sense to some of the information revealed by the TTN (e.g., discrepancy between PHQ-9 and BSI depression subscale scores).”
Quote in the paperSubstantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
- Interpretationreasoning§ Initial Case Formulation
The therapist's initial case formulation hypotheses aligned with the socially avoidant and submissive interpersonal style depicted by the IIP-32.
“These hypotheses align with the socially avoidant and submissive interpersonal style depicted by the IIP-32.”
Quote in the paperNot a substantial claim - Premisenone given§ data-informed Psychotherapy and case Formulation
Clinical decision support systems provide the therapist with clues to relevant issues that have not yet come up in therapy or have only come up briefly.
“CDSS also provide the therapist with clues to relevant issues that have not yet come up in therapy or have only come up briefly.”
Quote in the paperSubstantial claim - Premisereasoning§ the trier treatment navigator and case Formulation
The Trier Treatment Navigator combines prediction and tailoring by integrating pre-treatment recommendations and a feedback system with clinical support tools.
“Using different statistical and machine learning algorithms, the TTN combines prediction and tailoring by integrating pre-treatment recommendations and a feedback system with CSTs.”
Quote in the paperSubstantial claim - Premisereasoning§ data-informed Psychotherapy and case Formulation
Clinical decision support systems can support the difficult steps of adapting or supplementing a case formulation.
“CDSS can support these difficult steps.”
Quote in the paperSubstantial claim - Premisecitation§ the trier treatment navigator and case Formulation
Based on the patient's initial characteristics and a dataset of already treated patients, the Trier Treatment Navigator predicts the optimal treatment strategy (problem-solving, motivation-oriented or mixed) for the individual patient.
“First, based on the patient's initial characteristics and a dataset of already treated patients, the TTN predicts the optimal treatment strategy (i.e., problem-solving, motivation-oriented or mixed) for the individual patient.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
- Premisecitation§ the trier treatment navigator and case Formulation
With Trier Treatment Navigator information, the therapist can modify their initial case formulation by dynamically adapting it during ongoing treatment.
“With this information, the therapist can modify their initial CF by counting on information to dynamically adapt it during the ongoing treatment (Lutz & Schwartz, 2021;Lutz et al., 2022a ).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Lutz & Schwartz, 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Lutz et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisereasoning§ data-informed Psychotherapy and case Formulation
Clinical decision support systems can aid decision-making at different points during treatment.
“CDSS can aid decision-making at different points during treatment.”
Quote in the paperSubstantial claim - Premisecitation§ data-informed Psychotherapy and case Formulation
Therapists can present multiple biases that may undermine their clinical practice and compromise their clinical effectiveness, for example the tendency to underestimate patients at risk of deterioration.
“As previously explained, therapists can present multiple biases that may undermine their clinical practice compromising their clinical effectiveness (e.g., the tendency to underestimate patients at risk of deterioration; Lambert et al., 2003).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lambert et al., 2003 source
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisereasoning§ data-informed Psychotherapy and case Formulation
Clinical decision support systems can provide support in recognizing difficult therapy situations and identifying their causes.
“They can also provide support in recognizing difficult therapy situations and identifying their causes.”
Quote in the paperSubstantial claim - Premisecitation§ data-informed Psychotherapy and case Formulation
Modern technologies allow a high level of personalisation by complementing routine outcome monitoring with the feedback of psychometric information to therapists.
“Modern technologies allow a high level of personalisation by complementing routine outcome monitoring (ROM) with the feedback of psychometric information to therapists (practice-and research-based tradition also known as practice-based research, patient-focused research, practice-oriented research, and practice-based evidence; (Barkham & Lambert, 2021;Castonguay et al., 2021;Lutz et al., 2021b).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Barkham & Lambert, 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Castonguay et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Lutz et al., 2021b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisereasoning§ data-informed Psychotherapy and case Formulation
Clinical decision support systems can identify patients at risk for treatment failure or dropout, allowing the therapist to prevent or minimize such risks.
“CDSS can identify patients at risk for treatment failure or dropout, allowing the therapist to prevent or minimize such risks.”
Quote in the paperSubstantial claim - Premisecitation§ the trier treatment navigator and case Formulation
During treatment, the Trier Treatment Navigator feedback system comprises an expected treatment response and a dynamic failure boundary informed by specific patient's pre-treatment features and the experienced change progress.
“Second, during treatment, the feedback system comprises an expected treatment response (i.e., predicted trajectory of progress for the patient) and a dynamic failure boundary informed by specific patient's pre-treatment features and the experienced change progress.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
- Premisecitation§ the trier treatment navigator and case Formulation
When an alert area is activated, the therapist can access clinical support tools that guide how to address that particular area.
“When the alert of one of these areas is activated, the therapist can access the CSTs that guide how to address that particular area (e.g., a clinical guideline on how to work on motivation to change).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
- Premisecitation§ Abstract
Clinician biases can compromise the validity and reliability of case formulation.
“These biases can compromise the validity and reliability of CF (Eells, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Eells, 2015 source
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisereasoning§ data-informed Psychotherapy and case Formulation
Before treatment begins, clinical decision support systems can assist therapists in case formulation by providing psychometric information about the patient, such as symptom burden or personality traits.
“For instance, before treatment begins, CDSS can assist therapists in CF by providing psychometric information about the patient, such as symptom burden or personality traits.”
Quote in the paperSubstantial claim- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisereasoning§ data-informed Psychotherapy and case Formulation
Measurement-based and data-informed psychotherapy has become a way to overcome the issues of clinician biases by fostering the use of actuarial methods.
“Measurement-based and data-informed psychotherapy has become a way to overcome these issues by fostering the use of actuarial methods.”
Quote in the paperSubstantial claim- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Interpretationreasoning§ Abstract
Case formulation and data-informed psychotherapy enrich and feedback on each other.
“We argue that case formulation and data-informed psychotherapy enrich and feedback on each other.”
Quote in the paperNot a substantial claim - Premisereasoning§ data-informed Psychotherapy and case Formulation
During ongoing therapy, clinical decision support systems enable a continuous adaptation of case formulation and treatment.
“During ongoing therapy, CDSS enable a continuous adaptation of CF and treatment.”
Quote in the paperSubstantial claim- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
- Premisecitation§ discussion
In a prospective evaluation of the TTN, therapists who followed the recommended treatment strategies in the first 10 sessions obtained a differential effect size of Cohen's d = .30 compared to therapists that did not follow them.
“For instance, in a prospective evaluation of the TTN, Lutz et al. (2021b) found that therapists who followed the recommended treatment strategies in the first 10 sessions obtained a differential effect size of Cohen's d = .30compared to therapists that did not follow them.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2021b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation§ discussion
Little is known about the incremental benefit of psychometric psychological assessment on CF.
“Nevertheless, despite the current development of data-informed psychotherapy, little is known about the incremental benefit of psychometric psychological assessment on CF (Eells, 2022;Nelson-Gray, 2003).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Eells, 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Nelson-Gray, 2003 source
- Premisecitation§ discussion
ROM forms the basis of modern data-informed psychotherapy.
“In this sense, ROM forms the basis of modern data-informed psychotherapy (Lutz et al., 2022b).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lutz et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation§ discussion
Research on the reliability of CF has shown mixed results.
“Research on the reliability of CF has shown mixed results (Flinn et al., 2015)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Flinn et al., 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning§ discussion
Ms. Lux case showed how CF and the practice of data-informed psychotherapy can complement and enrich each other.
“Ms. Lux case showed how CF and the practice of data-informed psychotherapy can complement and enrich each other.”
Quote in the paperSubstantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The Ms. Lux case is representative enough to illustrate the complementarity of CF and data-informed psychotherapy.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
- Premisecitation§ discussion
Studies comparing outcomes of patients randomly assigned to manualised treatments or tailored therapy based on CF have not found significant differences between them.
“Studies comparing outcomes of patients randomly assigned to manualised treatments or tailored therapy based on CF have not found significant differences between them (Emmelkamp et al., 1994;Jacobson et al., 1989;Schulte et al., 1992).”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation§ discussion
Traditionally, psychotherapists have been reluctant about or even critical of implementing measures on a routine basis.
“Traditionally, psychotherapists have been reluctant about or even critical of implementing measures on a routine basis (Boswell et al., 2015;de Jong, 2016;Douglas et al., 2016).”
Quote in the paperNot a substantial claim0 of 3 sources checked - Premisecitation§ discussion
There is some evidence that factors often included in CF act as moderators or mediators of the change process and treatment outcome.
“However, there is some evidence that factors often included in CF act as moderators or mediators of the change process and treatment outcome (Persons & Hong, 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Persons & Hong, 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationcitation§ discussion
It is expectable that the practice of data-informed psychotherapy with CDSS contributes to addressing part of the issues on the reliability, validity and effectiveness of CF.
“It is expectable that the practice of data-informed psychotherapy with CDSS contributes to addressing part of the issues on the reliability, validity and effectiveness of CF.”
Quote in the paperNot a substantial claim
- Probably not a substantial claim. 31
- It may state two separate claims as one. 17
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown data§ Example of data-informed case FormulationMs. Lux reported only a low to moderate level of impairment on the Patient Health Questionnaire-9.
“However, Ms. Lux reported only a low to moderate level of impairment on a depression-specific questionnaire, the Patient Health Questionnaire -9 (PHQ-9; Kroenke et al., 2001;Löwe et al., 2002) 2 .”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Kroenke et al., 2001 source
- cites Löwe et al., 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
Premisecitation§ data-informed Psychotherapy and case FormulationClinical decision support systems can estimate personalised predictions about the optimal treatment, treatment strategy or dropout risk, which can significantly improve case formulations.
“Additionally, CDSS can estimate personalised predictions about the optimal treatment, treatment strategy or dropout risk, which can significantly improve CFs (Cohen & DeRubeis, 2018).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Cohen & DeRubeis, 2018 source
The Summary Points state that statistical models can generate individualized treatment recommendations, and the Discussion describes treatment-selection tools as aids to clinical decision-making. The passages do not support the added claims about predicting dropout risk or significantly improving case formulations; the paper frames clinical benefits as potential rather than established. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
It may state two separate claims as one.
Premisecitation§ discussionReluctancy on the use of technical equipment, financial support, time disposal, apprehension about the ecological validity of measures, perceiving measurement as a way of control, or concerns about data security contribute to the hesitant reception of measurement in clinical practice.
“For instance, reluctancy on the use of technical equipment, financial support, time disposal, apprehension about the ecological validity of measures (e.g., thinking that empirical findings do not reflect their everyday practice; Boswell et al., 2015;Gilbody et al., 2002), perceiving measurement as a way of control, or concerns about data security (de Jong & de Goede, 2015;Mütze et al., 2022).”
Quote in the paperNot a substantial claim1 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown data§ Example of data-informed case FormulationMs. Lux's interpersonal styles assessed with the Inventory of Interpersonal Problems-32 showed a strong tendency towards the submissive, distant side of the circumplex model, resulting in social avoidance and submissive behaviour.
“Ms. Lux's interpersonal styles were assessed with the Inventory of Interpersonal Problems -32 (IIP-32; Barkham et al., 1996;Thomas et al., 2011) 3 and showed a strong tendency towards the submissive, distant side of the circumplex model, resulting in social avoidance and submissive behaviour (Figure 1b).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingreasoning§ Treatment Process and Dynamic Case Formulation AdaptationsFinally, Ms. Lux could verbalize when she felt she was not being taken seriously and no more alliance ruptures occurred.
“Finally, Ms. Lux could verbalize when she felt she was not being taken seriously and no more alliance ruptures occurred.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown data§ Example of data-informed case FormulationAfter intake and diagnostic sessions, the Trier Treatment Navigator provided the therapist an overview of Ms. Lux's symptom severity.
“After the intake and diagnostic sessions, the TTN provided the therapist an overview of Ms. Lux's symptom severity.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown data§ Example of data-informed case FormulationCompared with all patients treated at the clinic, Ms. Lux's symptom burden on the various scales was in the 35th (for the PHQ-9) to 85th (for the BSI) percentile.
“Compared with all patients treated at the clinic, her symptom burden on the various scales was in the 35th (for the PHQ-9) to 85th (for the BSI) percentile.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown data§ Example of data-informed case FormulationMs. Lux reported a high overall score regarding physical and psychological symptoms in the Brief Symptom Inventory, with high levels of impairment in all subscales.
“She reported a high overall score regarding physical and psychological symptoms in the Brief Symptom Inventory (BSI; Derogatis & Melisaratos, 1983;Franke, 2000) 1 , with high levels of impairment in all subscales (e.g., somatization, insecurity, depression, obsession-compulsion).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Derogatis & Melisaratos, 1983 source
- cites Franke, 2000
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown data§ Initial Case FormulationThe Trier Treatment Navigator indicated a higher than average drop-out risk, so the therapist planned on motivating and convincing Ms. Lux by psycho-education about the rationale of therapy.
“Additionally, the TTN indicated a higher than average drop-out risk, so the therapist planned on motivating and convincing her by psycho-education about the rationale of therapy.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingreasoning§ Initial Case FormulationFollowing the initial conceptualisation and the Trier Treatment Navigator recommendations, the therapist planned to apply a motivation-oriented strategy because Ms. Lux's treatment expectancy and motivation to change seemed low.
“Following the initial conceptualisation and the TTN recommendations, the therapist planned to apply a motivation-oriented strategy because Ms. Lux's treatment expectancy and motivation to change seemed low.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown data§ Example of data-informed case FormulationFor the first ten sessions, the Trier Treatment Navigator recommended a motivation-oriented strategy for Ms. Lux.
“For the first ten sessions, the TTN recommended a motivation-oriented strategy (Figure 2b).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown data§ Treatment Process and Dynamic Case Formulation AdaptationsMs. Lux reduced her working hours, which made it possible for her to go to badminton again.
“She also reduced her working hours, which made it possible for her to go to badminton again.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Findingcitation§ Treatment Process and Dynamic Case Formulation AdaptationsThe therapist realised that they had experienced an alliance rupture in the last session with Ms. Lux, namely a withdrawal from the therapist.
“In the subsection on alliance ruptures, the therapist realised that they had experienced an alliance rupture in the last session with Ms. Lux, namely a 'withdrawal from the therapist' (Eubanks et al., 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Eubanks et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
Findingreasoning§ discussionWith these new understandings, the therapist could enact a different relational style and redirect the therapy to a good resolution.
“With these new understandings, the therapist could enact a different relational style and redirect the therapy to a good resolution.”
Quote in the paperNot a substantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
Probably not a substantial claim. It may be too vague to check against evidence.
Findingreasoning§ discussionBy addressing the alliance rupture with meta-therapeutic communication, the therapist could understand Ms. Lux's experience more in-depth and enrich his CF.
“By addressing the alliance rupture with meta-therapeutic communication, the therapist could understand Ms. Lux's experience more in-depth and enrich his CF.”
Quote in the paperNot a substantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
It may state two separate claims as one.
Findingreasoning§ discussionWith the help of CSTs and the previous CF, the therapist was able to understand the situation, conceptualise it as an alliance rupture and repair it at the correct timing.
“With the help of CSTs and the previous CF, the therapist was able to understand the situation, conceptualise it as an alliance rupture and repair it at the correct timing.”
Quote in the paperSubstantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
Findingnone given§ discussionThe initial relational style chosen by the therapist was counterproductive.
“Nevertheless, the initial relational style chosen by the therapist was counterproductive.”
Quote in the paperNot a substantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
- Rests on an assumption: The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
Probably not a substantial claim.
Findingnone given§ discussionThe TTN reflected this situation with the feedback system and alert signals of critical areas.
“The TTN reflected this situation with the feedback system and alert signals of critical areas.”
Quote in the paperSubstantial claim- Rests on an assumption: The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
It may state two separate claims as one.
Premisecitation§ AbstractThe clinical judgment approach in psychotherapy presents high variability within therapists over time and between therapists.
“This approach presents high variability within (i.e., changes over time) and between therapists (Lutz et al., 2022b).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
It may state two separate claims as one.
Premisecitation§ the trier treatment navigator and case FormulationWhen a patient is not progressing as expected, the Trier Treatment Navigator generates an alert signal, and clinical support tools are activated according to the assessment of critical areas that might hinder the change process.
“When a patient is not progressing as expected, the TTN generates an alert signal, and CSTs are activated according to the assessment of critical areas that might hinder the change process (i.e., suicidality risk, motivation to change and therapy goals, therapeutic alliance, social support and critical life events, emotionand self-regulation).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationreasoning§ Treatment Process and Dynamic Case Formulation AdaptationsThe therapist was always able to resolve alliance ruptures in the same session due to his increased sensitivity to alliance ruptures.
“Nevertheless, the therapist was always able to resolve them in the same session due to his increased sensitivity to alliance ruptures.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisecitation§ data-informed Psychotherapy and case FormulationUsing routine outcome monitoring to guide adaptive decision-making during ongoing treatment has developed into the more advanced concept of personalized mental health.
“In recent years, using ROM to guide adaptive decision-making during ongoing treatment has developed into the more advanced concept of personalized mental health (Müller et al., 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Müller et al., 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
Premisecitation§ the trier treatment navigator and case FormulationThe Trier Treatment Navigator estimates the patient dropout probability and offers the results of the psychometrical initial assessment.
“Additionally, the TTN estimates the patient dropout probability and offers the results of the psychometrical initial assessment.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
It may state two separate claims as one.
Premisecitation§ AbstractResearch has documented limits of clinical judgment, inference, and reasoning, showing biases clinicians may have, such as overconfidence, hindsight bias, representativeness and availability heuristics, confirmation bias, illusory correlation, neglecting base rates, halo and recency effects.
“Furthermore, research has documented the limits of clinical judgment, inference, and reasoning, showing the biases clinicians may have (e.g., overconfidence, hindsight bias, the representativeness and availability heuristics, confirmation bias, illusory correlation, neglecting base rates,”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Garb, 1998 source
- cites Kahneman, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Meehl, 1973
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
Probably not a substantial claim.
Interpretationreasoning§ AbstractCase formulation and data-informed psychotherapy are aimed at the same goal: treatment personalisation.
“Finally, we discuss how case formulation and data-informed psychotherapy are aimed at the same goal: treatment personalisation.”
Quote in the paperSubstantial claimProbably not a substantial claim.
Premisereasoning§ the trier treatment navigator and case FormulationThe Trier Treatment Navigator recommends the treatment strategy with the highest probability of obtaining a good treatment outcome.
“Thus, the treatment strategy with the highest probability of obtaining a good treatment outcome is recommended.”
Quote in the paperSubstantial claimProbably not a substantial claim.
Premisecitation§ data-informed Psychotherapy and case FormulationThe goal of data-informed psychotherapy is to use empirical data to tailor the treatment to the individual patient.
“Rather than intuitively making decisions to treat patients, the goal of this way of practising psychotherapy is to use empirical data to tailor the treatment to the individual patient (Lutz et al., 2021a).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2021a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
It may state two separate claims as one.
Interpretationown data§ Initial Case FormulationThe therapist's initial case formulation fits with the Trier Treatment Navigator's coherence tool, which shows a divergence of depressiveness in the BSI and PHQ-9.
“This fits with the TTN's coherence tool, which shows a divergence of depressiveness in the BSI and PHQ-9.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Premisecitation§ the outpatient Psychotherapy clinic of the university of trierThe Trier Treatment Navigator offers personalized clinical recommendations, helps monitor the process and provides clinical support tools for patients who are not improving as expected.
“The TTN offers personalized clinical recommendations, helps monitor the process and provides clinical support tools (CSTs) for patients who are not improving as expected.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lutz et al., 2019 source
Probably not a substantial claim.
Interpretationreasoning§ discussionThe aims of data-informed psychotherapy and CF are analogous/targeted to the same aim: personalising treatment according to individualised patient characteristics and needs.
“The aims of data-informed psychotherapy (i.e., personalising treatment at the individual level to ensure the highest probability of treatment success) are analogue to the aims of CF (i.e., personalise treatment based on a psychological understanding of the patient's problems).”
- Also stated in: § discussion · plain
“CF and data-informed psychotherapy are targeted to the same aim: personalising treatment according to individualised patient characteristics and needs.”
Quote in the paperSubstantial claim- Also stated in: § discussion · plain
Probably not a substantial claim. It may be too vague to check against evidence.
Interpretationreasoning§ discussionCF is crucial because it establishes the framework under which the information provided by the technological augmentation tools makes sense.
“In this regard, CF is crucial because it establishes the framework under which the information provided by the technological augmentation tools makes sense.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Premisecitation§ discussionFrom the patient perspective, outcome assessment is usually well-received.
“This contrasts with the patient perspective, from which outcome assessment is usually well-received (Lutz et al., 2021a).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lutz et al., 2021a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence.
Interpretationreasoning§ discussionData helps clinicians empirically inform CF.
“At the same time, data helps clinicians empirically inform CF.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Premisecitation§ discussionEMA represents an ecologically valid assessment procedure that can provide a reliable representation of intrapersonal processes that can be used for CF.
“In this way, EMA represents an ecologically valid assessment procedure that can provide a reliable representation of intrapersonal processes that can be used for CF (Scholten et al., 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Scholten et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper may give no reason why it holds.
Interpretationreasoning§ discussionThe information provided by the CDSS can inform the clinician's initial CF after the initial assessment.
“The information provided by the CDSS can inform the clinician's initial CF after the initial assessment.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Premisecitation§ discussionThe expert consensus is that CF reliability is compromised as clinicians move from descriptive to inferential levels.
“The expert consensus is that CF reliability is compromised as clinicians move from descriptive to inferential levels (British Psychological Society, 2011).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites British Psychological Society, 2011
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence.
Interpretationreasoning§ discussionCF can provide an interpretative framework to understand the patient responses and the information provided by the CDSS.
“At the same time, CF can provide an interpretative framework to understand the patient responses and the information provided by the CDSS.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence.
Interpretationreasoning§ discussionThe practice of data-informed psychotherapy and CF complement and enrich each other, generating mutual synergies.
“In this sense, both practices generate mutual synergies, with data-informed psychotherapy providing empirical quantitative support and CF providing a qualitative sense-making framework of the patient's issues and therapy rationale.”
- Also stated in: § discussion · plain
“In this sense, the practice of data-informed psychotherapy and CF complement and enrich each other.”
Quote in the paperNot a substantial claim- Also stated in: § discussion · plain
Probably not a substantial claim. The paper may give no reason why it holds.
Interpretationreasoning§ discussionDuring ongoing therapy, the different tools provided to monitor treatment can continue informing CF in an ongoing dynamic process.
“During the ongoing therapy, the different tools provided to monitor treatment can continue informing CF in an ongoing dynamic process.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence.
Interpretationreasoning§ discussionBoth practices inform and feedback to each other.
“Both practices inform and feedback to each other.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Case formulation involves and guides the processes of clinical decision-making in psychotherapy.
“CF involves and guides the processes of clinical decision-making in psychotherapy.”
The paper relies on this without support.
The TTN's treatment recommendations and feedback signals accurately reflect clinically relevant aspects of the patient's state and therapy process.
“The TTN reflected this situation with the feedback system and alert signals of critical areas.”
The paper relies on this without support.
The Ms. Lux case is representative enough to illustrate the complementarity of CF and data-informed psychotherapy.
“As shown in Ms. Lux case, based on the clinical history, the psychometric information and the treatment recommendations provided by the TTN, the therapist was able to state a case formulation to understand Ms. Lux situation and guide the therapeutic process.”
The paper relies on this without support.
The therapist's case formulation and interpretations of the TTN data in the Ms. Lux case are valid.
“With the help of CSTs and the previous CF, the therapist was able to understand the situation, conceptualise it as an alliance rupture and repair it at the correct timing.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
PHQ-9 response scale is described as both four-point and 0-4
MinorThe note calls the PHQ-9 response scale four-point, but a scale with integer scores from 0 through 4 has five points.
“a 4-point Likert Scale”
“ranging from 0 ("not at all") to 4 ("almost every day")”
Eubanks citation year differs from reference year
MinorThe in-text citation gives 2022, while the corresponding Eubanks, Samstag, and Muran reference is dated 2023.
“(Eubanks et al., 2022)”
“Eubanks, C. F., Samstag, L. W., & Muran, J. C. (2023). Rupture and repair in psychotherapy: A critical process for change.”
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
The brief symptom inventory: an introductory report.
Derogatis, L. R., & Melisaratos, N. (1983) · Psychological Medicine · doi:10.1017/s0033291700048017 · Cited by 6,650
Motivational Interviewing: Helping People Change
Tober, G. (2013) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt010 · Cited by 4,267
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
Interpersonal Diagnosis of Personality
Leary, T. (1957) · Medical Entomology and Zoology · Cited by 2,761
Inventory of interpersonal problems: Psychometric properties and clinical applications.
Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureño, G., & Villaseñor, V. S. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.885 · Cited by 2,026
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608
What intelligence tests miss: the psychology of rational thought
(2009) · Choice Reviews Online · doi:10.5860/choice.46-5908 · Cited by 543
Learning emotion-focused therapy: The process-experiential approach to change.
Elliott, R., Watson, J. C., Goldman, R. N., & Greenberg, L. S. (2004) · doi:10.1037/10725-000 · Cited by 515
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494
Studying the clinician: judgment research and psychological assessment
Garb, H. N. (1999) · Choice Reviews Online · doi:10.5860/choice.36-3045 · Cited by 444
Treatment selection in depression.
Cohen, Z. D., & DeRubeis, R. J. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084746 · Cited by 435
The IIP‐32: A short version of the Inventory of Interpersonal Problems
Barkham, M., Hardy, G. E., & Startup, M. (1996) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1996.tb01159.x · Cited by 430
de Jong, K., Conijn, J. M., Gallagher, R. A. V., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102002 · Cited by 417
Studying the clinician: Judgment research and psychological assessment.
Garb, H. N. (1998) · doi:10.1037/10299-000 · Cited by 371
Research-informed psychotherapy
Grawe, K. (1997) · Psychotherapy Research · doi:10.1080/10503309712331331843 · Cited by 269
The partners for change outcome management system
Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20111 · Cited by 264
Formulation in Psychology and Psychotherapy: Making Sense of People's Problems
Johnstone, L., & Dallos, R. (2006) · Cited by 237
Psychiatrists in the UK do not use outcomes measures: National survey
Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.2.101 · Cited by 234
Tailor-made versus standardized therapy of phobic patients
Schulte, D., Künzel, R., Pepping, G., & Schulte-Bahrenberg, T. (1992) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(92)90001-5 · Cited by 212
Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A.-K. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103438 · Cited by 196
Self-citationIs cognitive case formulation science or science fiction?
Bieling, P. J., & Kuyken, W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.10.1.52 · Cited by 174 · cited 1×
“Research on the reliability of CF has shown mixed results (Flinn et al., 2015), being considered “modest at best” (Bieling & Kuyken, 2003, p. 52).”
Background(1973) · Cited by 154
Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., Nevin, J., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30162-7 · Cited by 152 · cited 2×
“, CDSS, ROM and feedback systems, CSTs) contributes to better treatment outcomes (Cohen et al., 2021; de Jong et al., 2021; Delgadillo et al., 2018).”
BackgroundSelf-citationMeasurement-Based and Data-Informed Psychological Therapy
Lutz, W., Schwartz, B., & Delgadillo, J. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-071720-014821 · Cited by 145
Self-citationProspective evaluation of a clinical decision support system in psychological therapy.
Lutz, W., Deisenhofer, A., Rubel, J. A., Bennemann, B., Giesemann, J., Poster, K., & Schwartz, B. (2021) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000642 · Cited by 140
Self-citationTreatment utility of psychological assessment
Nelson-Gray, R. O. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.4.521 · Cited by 138
Research-structured vs clinically flexible versions of social learning-based marital therapy.
Jacobson, N. S., Schmaling, K. B., Holtzworth-Munroe, A., Katt, J. L., Wood, L. F., & Follette, V. M. (1989) · Behaviour Research and Therapy · doi:10.1016/0005-7967(89)90076-4 · Cited by 128
Process-based CBT the science and core clinical competencies of cognitive behavioral therapy
Hayes, S. C., & Hofmann, S. G. (2018) · Cited by 113
(2017) · Nursing Standard · doi:10.7748/ns.32.8.7.s2 · Cited by 104
Achieving Precision Mental Health through Effective Assessment, Monitoring, and Feedback Processes
Bickman, L., Lyon, A. R., & Wolpert, M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0718-5 · Cited by 99
Thomas, A., Brähler, E., & Strauß, B. (2011) · Diagnostica · doi:10.1026/0012-1924/a000034 · Cited by 91
Emmelkamp, P. M. G., Bouman, T. K., & Blaauw, E. (1994) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.5640010206 · Cited by 77
Dumont, F. (1993) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.24.2.196 · Cited by 58
Constantino, M. J., Boswell, J. F., Coyne, A. E., Swales, T. P., & Kraus, D. R. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.1221 · Cited by 53
Psychotherapy case formulation.
Eells, T. D. (2015) · doi:10.1037/14667-000 · Cited by 51
How reliable are case formulations? A systematic literature review
Flinn, L. C., Braham, L. G., & das Nair, R. (2014) · British Journal of Clinical Psychology · doi:10.1111/bjc.12073 · Cited by 47
Scholten, S., Lischetzke, T., & Glombiewski, J. A. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1916639 · Cited by 44
Hehlmann, M. I., Schwartz, B., Lutz, T., Gómez Penedo, J. M., Rubel, J. A., & Lutz, W. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.613085 · Cited by 43
Self-citationde Jong, K., & de Goede, M. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1076198 · Cited by 38
Douglas, S., Button, S., & Casey, S. E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0607-8 · Cited by 38
Rupture and repair in psychotherapy: A critical process for change.
(2022) · American Psychological Association eBooks · doi:10.1037/0000306-000 · Cited by 34
McAleavey, A. A., Nordberg, S. S., & Moltu, C. (2021) · Quality of Life Research · doi:10.1007/s11136-021-02825-1 · Cited by 33
Schaffrath, J., Weinmann‐Lutz, B., & Lutz, W. (2022) · Journal of Clinical Psychology · doi:10.1002/jclp.23362 · Cited by 24
Self-citationA different kind of chemistry? Reformulating 'formulation'
Harper, D. J., & Moss, D. (2003) · UEL Research Repository (University of East London) · Cited by 22
Aston, R. (2009) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x09000178 · Cited by 22
Challenges in the Implementation of Measurement Feedback Systems
de Jong, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0697-y · Cited by 20
A Principle-Based Approach to Psychotherapy Integration
Eubanks, C. F., & Goldfried, M. R. (2019) · Oxford University Press eBooks · doi:10.1093/med-psych/9780190690465.003.0004 · Cited by 19
Working Towards the Development and Implementation of Precision Mental Healthcare: An Example
Lutz, W., Schwartz, B., Penedo, J. M. G., Boyle, K. S., & Deisenhofer, A. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01053-y · Cited by 19
Self-citationMütze, K., Witthöft, M., Lutz, W., & Bräscher, A. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1930244 · Cited by 19
Self-citationContinuous outcome measurement in modern data‐informed psychotherapies
Lutz, W., Rubel, J. A., Deisenhofer, A., & Danilo Moggia, N. (2022) · World Psychiatry · doi:10.1002/wps.20988 · Cited by 18
Self-citationData-informed clinical training and practice.
Lutz, W., Deisenhofer, A., Weinmann‐Lutz, B., & Barkham, M. (2023) · American Psychological Association eBooks · doi:10.1037/0000364-010 · Cited by 18
Self-citationTrans‐theoretical clinical models and the implementation of precision mental health care
Lutz, W., & Schwartz, B. (2021) · World Psychiatry · doi:10.1002/wps.20888 · Cited by 12
Self-citationPapayianni, F., & Cooper, M. (2017) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2017.1305098 · Cited by 11
Psychometric properties of the Session Rating Scale 3.0 in a Spanish clinical sample
Danilo Moggia, N., Niño‐Robles, N., Miller, S. D., & Feixas, G. (2020) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2020.1778635 · Cited by 7
Case formulation and the outcome of cognitive behavior therapyPreprint
Persons, J. B. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bu5hd · Cited by 7
Data-Informed Advances and Technology Augmentation
Lutz, W. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2022.02.008 · Cited by 5
Self-citationFrank, E., & Levenson, J. C. (2011) · American Psychological Association eBooks · doi:10.1037/17331-000 · Cited by 5
Optimizing psychotherapy with Plan analysis
Caspar, F. (2022) · Bern Open Repository and Information System (University of Bern) · Cited by 5
WHAT IS INDIVIDUALLY TAILORED MENTAL HEALTH CARE?
(2018) · REVISTA ARGENTINA DE CLINICA PSICOLOGICA · doi:10.24205/03276716.2018.1062 · Cited by 4
The Constructivist Integrative Model: A New Proposal
Moggia, D. (2017) · Revista de Psicoterapia · doi:10.33898/rdp.v28i108.205 · Cited by 1
Self-citation
Flagged first, then by citations
Research works printed but not linked: 9
- tb01159.x · DOI · Paper page
- Barkham, M., & Lambert, M. J. (2021). The efficacy and effectiveness of psychological therapies. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change: 50th anniversary edition (7 th ed., pp. 135-189). Wiley.
- Castonguay, L. G., Barkham, M., Youn, S. J., & Page, A. (2021). Practice-based evidence-Findings from routine clinical settings. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change: 50th anniversary edition (7 th ed., pp. 121-222). Wiley.
- Cohen, Z. D., Delgadillo, J., & DeRubeis, R. (2021). Personalized Treatment Approaches. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change: 50th anniversary edition (7 th ed., pp. 673-704). Wiley.
- Eells, T. D. (2022). History and current status of psychotherapy case formulation. In T. D. Eells (Ed.), Handbook of psychotherapy case formulation (3 rd ed., pp. 1-35). The Guildford Press.
- Friedlander, M. L., Heatherington, L., & Diamond, G. D. (2021). Systemic and conjoint couple and family the- rapies: recent advances and future promise. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change: 50th anniversary edition (7 th ed., pp. 539-582). Wiley.
- Kahneman, D. (2013). Thinking, fast and slow (1 st ed.).
- Löwe, B., Spitzer, R. L., Zipfel, S., & Herzog, W. (2002). PRIME MD Patient Health Questionnaire (PHQ)- German version manual and materials (2 nd ed.). Pfizer.
- Lutz, W., de Jong, Ki., Rubel, J. A., & Delgadillo, J. (2021a). Measuring, Predicting, and Tracking Change in Psychotherapy. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change: 50th anniversary edition (7 th ed., pp. 89-134). Wiley.
Cited by
Sorted by citations
Higgins, O., & Wilson, R. L. (2025) · International Journal of Mental Health Nursing · doi:10.1111/inm.70019 · Cited by 38
Precision Mental Health and Data-Informed Decision Support in Psychological Therapy: An Example
Lutz, W., Schaffrath, J., Eberhardt, S. T., Hehlmann, M. I., Schwartz, B., Deisenhofer, A., Vehlen, A., Schürmann, S., Uhl, J., & Moggia, D. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01330-6 · Cited by 24
Self-citationFormulación de Caso en Psicoterapia: "La Cosa se Mueve"
García, C. C., & Quiñones, Á. (2022) · Revista de Psicoterapia · doi:10.33898/rdp.v33i123.35974 · Cited by 1
Potenziale für die PTBS-Behandlung
Eberhardt, S. T., Schaffrath, J., & Lutz, W. (2024) · Trauma und Gewalt · doi:10.21706/tg-18-4-288 · Cited by 1
Self-citation
Metadata
- Authors
- Moggia, D., Schaffrath, J., Bommer, J., Weinmann-Lutz, B., & Lutz, W.
- Affiliations
- Universität Trier (DE)
- Venue
- Revista de Psicoterapia
- Published
- 2022-11-01
- Volume
- 33
- Issue
- 123
- Pages
- 151-171
- ISSN
- 1130-5142 (ISSN-L)
- 2339-7950
- OpenAlex
- W4307756470
- Cited by
- 4
- References
- 61
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1
- FWCI
- 0.78
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Revista de Psicoterapia (publishedVersion, cc-by-nc)
- Dialnet (Universidad de la Rioja) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- case formulation, clinical decision support systems, actuarial methods, personalized treatment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review