Cited by 63Mental Health Research TopicsPsychotherapy Techniques and ApplicationsPersonality Disorders and Psychopathology

Using person-specific networks in psychotherapy: challenges, limitations, and how we could use them anyway

Open access
von Klipstein, Lino, Riese, Harriëtte, van der Veen, Date C., Servaas, Michelle N., Schoevers, Robert A.·2020·BMC Medicine

Abstract

Background: The complexity of psychopathology is evident from its multifactorial etiology and diversity of symptom profiles and hampers effective treatment. In psychotherapy, therapists approach this complexity by using case conceptualization. During this process, patients and therapists closely collaborate on a personalized working theory of the patient’s psychopathology. This is a challenging process and shows low reliability between therapists. With the experience sampling method (ESM), time-series data—valuable for case conceptualization—can be systematically gathered in a patient’s normal daily life. These data can be analyzed and visualized in person-specific networks (PSNs). PSNs may support case conceptualization by providing a schematic representation of association patterns between affective, cognitive, behavioral, and context variables. Main text: We adopt a clinical perspective in considering how PSNs might be implemented to serve case conceptualization and what their role could be in psychotherapy. We suggest PSNs to be based on personalized ESM assessment to capture the unique constellation of variables in each patient. We reflect on the lack of a gold standard for creating PSNs, which may result in substantially different PSNs and thereby disparate information for case conceptualization. Moreover, even if PSNs are created in a consistent manner, results remain ambiguous as they are subject to multiple interpretations. Therefore, associations in PSNs do not allow for firm conclusions about a patient’s psychopathology, but they may nevertheless be valuable in the process of case conceptualization. PSNs are based on systematically gathered, ecologically valid ESM data and provide a unique personalized perspective. When used responsibly, PSNs may be able to support case conceptualization by generating questions that serve as a starting point for a dialog between therapists and patients. Well-targeted questions are an essential tool for therapists to gain insight into the patients’ psychopathology patterns and improve the quality of case conceptualization. Conclusions: PSNs have limitations in terms of the reliability of the insights they provide directly. However, taking these challenges into account, we believe they have potential as a tool to help therapists and patients in their collaborative exploration of a patient’s psychopathology. Clearly, this would need to be validated in future clinical research.

AI snapshot

Written from the paper’s full text.

TL;DR

Person-specific networks (PSNs) built from personalized experience sampling may support case conceptualization in psychotherapy, but they cannot directly provide reliable causal or treatment-target conclusions. The authors argue PSNs should be used responsibly to generate questions for collaborative exploration between therapist and patient, pending future clinical validation.

Key findings

  • PSNs are based on ESM time-series data and can visualize contemporaneous and temporal associations between affective, cognitive, behavioral, somatic, and context variables, but there is no gold standard for creating them; different analytic choices may produce substantially different PSNs and disparate clinical information.
  • Personalized ESM questionnaires for case conceptualization in the Therap-i trial pilots typically contained 20–30 questions, whereas statistical considerations suggest the number of variables for sound PSN modeling is likely less than 10, creating a compromise between comprehensive assessment and statistical power.
  • Associations in PSNs remain ambiguous: they may reflect direct or indirect causal processes, common causes, or collider/spurious structures, and temporal associations are not evidence of causality even if they meet Granger causality criteria.
  • The authors propose using PSNs not as answers or treatment-target recommendations, but as tools to generate questions that guide collaborative case conceptualization, with therapist training in correlational interpretation and limitations.

Methods

  • Design: a clinical perspective/commentary article, not an empirical study; the authors synthesize methodological, clinical, and practical issues around implementing PSNs in psychotherapy.
  • Data or sample: no primary sample or empirical dataset is analyzed; the considerations were informed by the authors’ implementation of PSNs in an ongoing randomized controlled trial, the Therap-i study, and by prior proof-of-principle case studies.
  • Main analysis: conceptual discussion and recommendations, including proposed procedures for personalized ESM questionnaire creation, PSN interpretation, responsible clinical use, and future research questions; no statistical modeling or outcome analysis is reported.

Limitations

  • Stated in the paper: there is no gold standard for creating PSNs, resulting PSNs may differ substantially, associations are subject to multiple interpretations and do not permit firm causal conclusions, PSNs capture only part of the picture, and they cannot directly provide reliable insights into psychopathology or treatment targets.
  • Stated in the paper: the clinical value of PSNs remains unvalidated and must be tested in future clinical research, including whether PSN-generated questions add useful information beyond typical case conceptualization and whether benefits outweigh training and discussion costs.
  • Evident from the text: as a conceptual article without empirical outcomes, it does not demonstrate that the proposed question-generation use improves case conceptualization, treatment, or patient outcomes; the recommendations are proposals rather than tested findings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s12916-020-01818-0

Cites

Statistics

Nothing to recompute.

Claims the paper makes

0 of 56 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Pilots and first experiences in the Therap-i trial have shown that personalized experience sampling method questionnaires for case conceptualization typically contained 20-30 questions.

    “Pilots and first experiences in the Therap-i trial have shown that personalized ESM questionnaires for CC typically contained 20–30 questions.”
    Quote in the paperSubstantial claim
  • Interpretationreasoning

    Person-specific networks may provide information on how elements of an individual patient's psychopathology are functionally related, a core task in case conceptualization.

    “The intuitive appeal of PSNs in the context of CC is that they may provide information on how elements of the individual patient’s psychopathology are functionally related a core task in CC.”
    Quote in the paperSubstantial claim
  • Premisereasoning

    Case conceptualization is based on information that could be incomplete or biased because it depends on the type of questions being asked and the retrospection of the patient.

    “Moreover, CC is based on information that could be incomplete or biased, because it depends on the type of questions being asked and the retrospection of the patient.”
    Quote in the paperSubstantial claim
  • Interpretationcitation

    These case studies give the first indication that person-specific networks may provide added value for case conceptualization.

    “These case studies give the first indication that PSNs may indeed provide added value for CC.”
    Quote in the paperSubstantial claim
  • Premisecitation

    The resulting person-specific networks may differ substantially when different choices are made.

    “This is problematic because the resulting PSNs may differ substantially [40].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [40] Gelman A, Loken E. The garden of forking paths: why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. 2013 [cited 2020 Apr 19] Available from: https://osf.io/n3axs.

      Not checked in the free run.

  • May combine two claims. 38
  • Classified as probably not a substantial claim. 39
  • May combine two claims.

    Findingreasoning

    Person-specific networks can capture aspects that are captured in the experience sampling method questionnaire, but some aspects are not captured.

    “First, PSNs can capture aspects that are captured in the ESM questionnaire. On the one hand, that means that some aspects are not captured.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Methods exist to consider associations on multiple time scales, but they further increase the complexity of person-specific networks, which are already difficult for patients to understand.

    “There are methods to consider associations on multiple time scales [43]. However, such methods further increase the complexity of PSNs, which are already difficult to understand for patients.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [43] Ryan O, Kuiper RM, Hamaker EL. A continuous-time approach to intensive longitudinal data: what, why, and how? In: Kv M, Oud JHL, Voelkle MC, editors. Continuous time modeling in the behavioral and related sciences. New York: Springer; 2018. p. 27–54. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Changes in the mean of included variables are considered an artifact to correct for in person-specific networks.

    “Changes in the mean are considered an artifact to correct for.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    It seems plausible that many processes between variables in a person-specific network occur on such a short time scale.

    “It seems plausible that many processes between variables in a PSN occur on such a time scale.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Changes in the mean are potentially more meaningful than momentary changes that dissipate quickly; they may provide information about what may drive lasting change in the patient and are the very goal of psychotherapy.

    “However, such changes in the mean are potentially more meaningful than momentary changes that dissipate quickly—they may provide information about what may drive lasting change in the patient and are the very goal of psychotherapy.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Initial case studies have shown that person-specific networks were feasible, well-received by patients, and provided clinically relevant information.

    “Several initial case studies, which collected data through ESM and created PSNs for individual patients, have shown that PSNs were feasible, well-received by patients, and provided clinically relevant information [24–27].”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [24] Bak M, Drukker M, Hasmi L, Van Os J. An n=1 clinical network analysis of symptoms and treatment in psychosis. PLoS One. 2016;11(9):e0162811.

      Not checked in the free run.

    • cites [25] Epskamp S, Van Borkulo CD, Van Der Veen DC, Servaas MN, Isvoranu A-M, Riese H, et al. Personalized network modeling in psychopathology: the importance of contemporaneous and temporal connections. Clin Psychol Sci. 2018;6(3):416–27. source

      Not checked in the free run.

    • cites [26] Frumkin M, Piccirillo M, Beck ED, Grossman J, Rodebaugh T. Feasibility and utility of idiographic models in the clinic: a pilot study: PsyArXiv [preprint]; 2019 [cited 2020 Apr 19] Available from: https://doi.org/10.31234/osf.io/m34aw. source

      Not checked in the free run.

    • cites [27] Kroeze R, van der Veen DC, Servaas MN, Bastiaansen JA, Oude Voshaar RC, Borsboom D, et al. Personalized feedback on symptom dynamics of psychopathology: a proof-of-principle study. J Person-Oriented Research. 2017;3(1):1–11. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This assertion is in line with cognitive behavioral therapy, which involves the analysis of connections between momentary affect, behaviors, cognitions, and somatic states in specific moments.

    “This assertion is in line with CBT, which involves the analysis of connections between momentary affect, behaviors, cognitions, and somatic states in specific moments [21].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] Beck J. Cognitive behavior therapy: basics and beyond. 2 ed: New York: Guilford Press; 2011.

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Person-specific networks can capture some, but not all, processes.

    “Accordingly, they can capture some, but not all, processes.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Patients with the same diagnosis may show different symptom profiles, which may also vary over time.

    “Patients with the same diagnosis may show different symptom profiles [1], which may also vary over time.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [1] Galatzer-Levy IR, Bryant RA. 636,120 ways to have posttraumatic stress disorder. Perspect Psychol Sci. 2013;8(6):651–62. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The etiology of mental disorders is highly multifactorial and largely unspecific.

    “In line with its symptomatology, the etiology of mental disorders also is highly multifactorial and largely unspecific [7, 8].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [7] Lahey BB, Krueger RF, Rathouz PJ, Waldman ID, Zald DH. A hierarchical causal taxonomy of psychopathology across the life span. Psychol Bull. 2017;143(2):142–86. source

      Not checked in the free run.

    • cites [8] Cuthbert BN, Insel TR. Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Med. 2013;11(1):126. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Experience sampling method can capture momentary expressions of affect, behaviors, cognitions, and somatic states, with high ecological validity and less retrospective bias.

    “On the other hand, ESM is able to capture variables of central interest to CC, namely momentary expressions of affect, behaviors, cognitions, and somatic states. Also, these aspects are captured with high ecological validity and are less affected by retrospective bias [42].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [42] Hektner JM, Schmidt JA, Csikszentmihalyi M. Psychometrics of ESM data. Experience sampling method: measuring the quality of everyday life. Thousand Oaks; Sage, 2007. p. 104–25. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Person-specific networks only capture processes that are dynamic to begin with; there needs to be variation in all included variables.

    “Third, PSNs only capture processes that are dynamic to begin with. That is, there needs to be variation in all included variables.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Bastiaansen and colleagues asked different research teams to recommend treatment targets based on the same experience sampling method time-series data of one particular patient; most research teams included a person-specific network, but choices in the statistical analyses and recommendations for treatment varied widely.

    “They asked different research teams to recommend treatment targets based on the same ESM time-series data of one particular patient. Most research teams included a PSN in their analysis, but choices in the statistical analyses and recommendations for treatment varied widely.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [41] Bastiaansen J, Kunkels Y, Blaauw F, Boker S, Ceulemans E, Chen M, et al. Time to get personal? The impact of researchers’ choices on the selection of treatment targets using the experience sampling methodology: PsyArXiv [preprint]; 2019 [cited 2020 Apr 19] Available from: https://doi.org/10.31234/osf.io/c8vp7. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Person-specific networks capture linear associations between variables but may misrepresent associations that are non-linear.

    “Sixth, PSNs capture linear associations between variables but may misrepresent associations that are non-linear.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Case conceptualization is a challenging process involving complex problem solving without a gold standard procedure.

    “However, CC is a challenging process, as it involves complex problem solving [12] without a gold standard procedure [13].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [12] Fischer A, Greiff S, Funke J. The process of solving complex problems. J Probl Solving. 2011;4(1):19–42.

      Not checked in the free run.

    • cites [13] Ridley CR, Jeffrey CE, Roberson RB. Case mis-conceptualization in psychological treatment: an enduring clinical problem. J Clin Psychol. 2017;73(4):359–75. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Psychopathology is complex, with multifactorial etiology and diverse symptom profiles, and this complexity hampers effective treatment.

    “The complexity of psychopathology is evident from its multifactorial etiology and diversity of symptom profiles and hampers effective treatment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There are findings that therapists report doubts on whether person-specific networks can provide new information.

    “However, there are also findings that therapists report doubts on whether PSNs can provide new information [26, 28].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [26] Frumkin M, Piccirillo M, Beck ED, Grossman J, Rodebaugh T. Feasibility and utility of idiographic models in the clinic: a pilot study: PsyArXiv [preprint]; 2019 [cited 2020 Apr 19] Available from: https://doi.org/10.31234/osf.io/m34aw. source

      Not checked in the free run.

    • cites [28] Zimmermann J, Woods WC, Ritter S, Happel M, Masuhr O, Jaeger U, et al. Integrating structure and dynamics in personality assessment: first steps toward the development and validation of a personality dynamics diary. Psychol Assess. 2019;31(4):516–31. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Social psychology teaches that context is important in determining how people feel, think, and behave.

    “Social psychology teaches us how important context is in determining how people feel, think, and behave [45].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [45] Ross L. The intuitive psychologist and his shortcomings: distortions in the attribution process. In: Berkowitz L, editor. Adv Exp Soc Psychol. 10: Elsevier; 1977. p. 173–220. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Processes that are consistent and independent of context might be the more important and pathological ones.

    “On the other hand, it is also worth considering that processes that are consistent and independent of context might be the more important and pathological ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Some aspects of case conceptualization cannot be adequately captured on the rating scale of a questionnaire because they are inherently qualitative.

    “Further, there are certain aspects of CC that cannot be adequately captured on the rating scale of a questionnaire because some aspects are inherently qualitative in nature.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Person-specific networks may support case conceptualization by providing a schematic representation of association patterns between affective, cognitive, behavioral, and context variables.

    “PSNs may support case conceptualization by providing a schematic representation of association patterns between affective, cognitive, behavioral, and context variables.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Person-specific networks capture associations that are consistent over time, or whose inconsistency is captured in the included variables.

    “Fourth, PSNs capture associations that are consistent over time, or whose inconsistency (variation) is captured in the included variables.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Experience sampling method time-series data can be analyzed with statistical models that may reveal patterns in daily life dynamics of individual patients and thus provide a useful source of information for case conceptualization.

    “Interestingly, ESM time-series data can be analyzed with different statistical models that may reveal patterns in daily life dynamics of individual patients [17, 18] and thus provide a useful source of information for CC.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [17] Piccirillo ML, Beck ED, Rodebaugh TL. A clinician’s primer for idiographic research: considerations and recommendations. Behav Ther. 2019;50(5):938–51. source

      Not checked in the free run.

    • cites [18] Piccirillo ML, Rodebaugh TL. Foundations of idiographic methods in psychology and applications for psychotherapy. Clin Psychol Rev. 2019;71:90–100. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Experience sampling method time-series data have high ecological validity and are less affected by retrospective bias.

    “The resulting time-series data have high ecological validity and are less affected by retrospective bias.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [42] Hektner JM, Schmidt JA, Csikszentmihalyi M. Psychometrics of ESM data. Experience sampling method: measuring the quality of everyday life. Thousand Oaks; Sage, 2007. p. 104–25. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Inconsistency in associations is likely to occur because patients react differently in different contexts and context cannot be adequately included in a person-specific network.

    “One reason that such inconsistency is likely to occur is the fact that patients react differently in different contexts and we cannot adequately include the context in a PSN.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Not all relevant processes can be captured in person-specific networks, but what can be captured is considerable and relevant to case conceptualization.

    “These considerations show that not all relevant processes can be captured in PSNs, but what can be captured is considerable and relevant to CC.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    The same symptoms may be present in different diagnoses and are not distinctive for one single disorder.

    “Moreover, the same symptoms may be present in different diagnoses and are not distinctive for one single disorder [2, 3].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [2] Narrow WE, Clarke DE, Kuramoto SJ, Kraemer HC, Kupfer DJ, Greiner L, et al. DSM-5 field trials in the United States and Canada, part III: development and reliability testing of a cross-cutting symptom assessment for DSM-5. Am J Psychiatry. 2013;170(1):71–82. source

      Not checked in the free run.

    • cites [3] Tio P, Epskamp S, Noordhof A, Borsboom D. Mapping the manuals of madness: comparing the ICD-10 and DSM-IV-TR using a network approach. Int J Methods Psychiatr Res. 2016;25(4):267–76. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Person-specific networks are based on systematically gathered, ecologically valid experience sampling method data and provide a unique personalized perspective.

    “PSNs are based on systematically gathered, ecologically valid ESM data and provide a unique personalized perspective.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Many of the points and suggestions about PSNs may also generalize to the use of other idiographic models in clinical practice.

    “Beyond the topic of PSNs, many of the points and suggestions we make may also generalize to the use of other idiographic models in clinical practice.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Asking good questions is considered a key skill for any therapist and receives considerable attention in their training through techniques like Socratic questioning and motivational interviewing.

    “Asking good questions is considered a key skill for any therapist and receives considerable attention in their training through techniques like Socratic questioning [50] and motivational interviewing [51].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [50] Clark GI, Egan SJ. The Socratic method in cognitive behavioural therapy: a narrative review. Cognit Ther Res. 2015;39(6):863–79. source

      Not checked in the free run.

    • cites [51] Rollnick S, Miller WR. What is motivational interviewing? Behav Cogn Psychother. 1995;23(4):325–34. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Studies that apply non-personalized experience sampling method questionnaires in clinical samples, including those from our own group, have used a similar or higher number of questions, and compliance rates suggest a manageable burden for participants.

    “Studies that apply (non-personalized) ESM questionnaires in clinical samples, including those from our own group, have used a similar or higher number of questions [32–35], and compliance rates suggest a manageable burden for participants.”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [32] Janssens KAM, Bos EH, Rosmalen JGM, Wichers MC, Riese H. A qualitative approach to guide choices for designing a diary study. BMC Med Res Methodol. 2018;18(1):1–12. source

      Not checked in the free run.

    • cites [33] Bastiaansen JA, Meurs M, Stelwagen R, Wunderink L, Schoevers RA, Wichers M, et al. Self-monitoring and personalized feedback based on the experiencing sampling method as a tool to boost depression treatment: a protocol of a pragmatic randomized controlled trial (ZELF-i). BMC Psychiatry. 2018;18:276. source

      Not checked in the free run.

    • cites [34] Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. Compliance and retention with the experience sampling method over the continuum of severe mental disorders: meta-analysis and recommendations. J Med Internet Res. 2019;21(12):e14475. source

      Not checked in the free run.

    • cites [35] Van Genugten CR, Schuurmans J, Lamers F, Riese H, Penninx BWJH, Schoevers RA, et al. Experienced burden of and adherence to smartphone-based ecological momentary assessment in persons with affective disorders. J Clin Med. 2020;9(2):322. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Creating a personalized experience sampling method questionnaire in this way is in itself an act of starting case conceptualization.

    “Creating a personalized ESM questionnaire in this way is in itself an act of starting CC.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Large-scale application in clinical practice requires that analysis and visualization steps follow a standardized procedure, enabling the automated generation of person-specific networks.

    “Large-scale application in clinical practice requires that these steps follow a standardized procedure, enabling the automated generation of PSNs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    PSN-generated questions can only point to processes that are captured in their associations.

    “PSN-generated questions can only point to processes that are captured in their associations.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    ESM assessment itself is increasingly considered an intervention for psychopathology, and there is first evidence of its benefits.

    “First, ESM assessment itself is increasingly considered an intervention for psychopathology, and there is the first evidence of its benefits [30, 52].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [30] Bos FM, Snippe E, Bruggeman R, Wichers M, Van Der Krieke L. Insights of patients and clinicians on the promise of the experience sampling method for psychiatric care. Psychiatr Serv. 2019;70(11):983–91. source

      Not checked in the free run.

    • cites [52] Kramer I, Simons CJP, Hartmann JA, Menne-Lothmann C, Viechtbauer W, Peeters F, et al. A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry. 2014;13(1):68–77. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    It is a key principle of CC to question one's own perspective and to be open to new information.

    “It is a key principle of CC to question one’s own perspective and to be open to new information [49].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [49] Kuyken W, Padesky CA, Dudley R. Collaborative case conceptualization: working effectively with clients in cognitive-behavioral therapy. New York: Guilford Press; 2009.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    When used responsibly, person-specific networks may be able to support case conceptualization by generating questions that serve as a starting point for a dialog between therapists and patients.

    “When used responsibly, PSNs may be able to support case conceptualization by generating questions that serve as a starting point for a dialog between therapists and patients.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Any idiographic model is bound by its assumptions and based on less-than-perfect data, making far-reaching recommendations problematic.

    “Ultimately, any idiographic model is bound by its assumptions and based on less-than-perfect data, making far-reaching recommendations problematic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Well-targeted questions are an essential tool for therapists to gain insight into the patients' psychopathology patterns and improve the quality of case conceptualization.

    “Well-targeted questions are an essential tool for therapists to gain insight into the patients’ psychopathology patterns and improve the quality of case conceptualization.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Identification of strengths and adaptive skills is central to case conceptualization but can be underrepresented in clinical practice because of the primary focus on psychiatric complaints.

    “Importantly, this also includes the identification of the strengths and adaptive skills of the patient, an area that is central to CC, but can be underrepresented in clinical practice because of the primary focus on psychiatric complaints [29].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [29] Kuyken W, Padesky CA, Dudley R. The science and practice of case conceptualization. Behav Cogn Psychother. 2008;36(6):757–68. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    PSNs cannot directly provide reliable insights into a patient's patterns of psychopathology nor recommendations on treatment targets.

    “Taking together these considerations, it is clear that PSNs cannot directly provide reliable insights into a patient’s patterns of psychopathology nor recommendations on treatment targets.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    The collection of objective data, statistical modeling, and smooth visualizations create an appearance of objectivity that is not supported by firm evidence.

    “The collection of “objective” data, use of statistical modeling, and smooth visualizations create an appearance of objectivity that is not supported by firm evidence.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisenone given

    The maximum number of variables that are adequate from a statistical perspective depends on a number of circumstances, and clear recommendations are not available at the moment.

    “The maximum number of variables that are adequate from a statistical perspective depends on a number of circumstances, and clear recommendations are not available at the moment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    A standardized procedure is necessary to be able to research the effectiveness of using person-specific networks in psychotherapy.

    “This is also necessary to be able to research the effectiveness of using PSNs in psychotherapy.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Formulating experience sampling method questions in the patient's own words may increase their ability to answer accurately and increase compliance.

    “Formulating questions in the patient’s own words may also increase their ability to answer accurately and increase compliance [32].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [32] Janssens KAM, Bos EH, Rosmalen JGM, Wichers MC, Riese H. A qualitative approach to guide choices for designing a diary study. BMC Med Res Methodol. 2018;18(1):1–12. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Person-specific networks have limitations in terms of the reliability of the insights they provide directly.

    “PSNs have limitations in terms of the reliability of the insights they provide directly.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    From a statistical perspective, the number of variables should not exceed a certain maximum to ensure sufficient power.

    “From a statistical perspective, the number of variables should not exceed a certain maximum to ensure sufficient power.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning

    Currently, there are many possible paths to create person-specific networks, and we often do not know how to choose between them.

    “Currently, there are many possible paths to create PSNs, and we often do not know how to choose between them.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    PSN-generated questions provide a novel perspective that may be valuable because it is difficult to obtain a comprehensive overview and understanding of a patient's psychopathology.

    “They provide a novel perspective that may be valuable, because it is difficult to obtain a comprehensive overview and understanding of a patient’s psychopathology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    PSNs may have the most potential when and where there is a need to simulate the collaborative exploration in CC.

    “PSNs may have the most potential when and where there is a need to simulate the collaborative exploration in CC.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Additional investment into case conceptualization is most indicated in the treatment of patients with complex psychopathology (e.g., with comorbidities).
    • Rests on an assumption: Natural moments of exploration in psychological treatment are the start of treatment and moments of evaluation and reorientation.
  • Classified as probably not a substantial claim.

    Premisecitation

    Collaboration between patient and therapist is a key principle of case conceptualization.

    “Such collaboration is a key principle of CC [29], as it makes use of the introspective capability of the patient and the clinical expertise of the therapist.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [29] Kuyken W, Padesky CA, Dudley R. The science and practice of case conceptualization. Behav Cogn Psychother. 2008;36(6):757–68. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    If PSNs are embedded into psychotherapy in a responsible manner, they may prove useful.

    “Yet, if we imbed PSNs into psychotherapy in a responsible manner, it may prove useful.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    PSNs in psychotherapy, like most statistical models in psychiatry, impose a structure on a complex reality.

    “PSNs in psychotherapy, like most statistical models in psychiatry, impose a structure on a complex reality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    A part of relevant processes is likely captured in PSNs.

    “As we have argued above, a part of relevant processes is likely captured in PSNs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Gathered ESM time-series data can easily be presented to patients and therapists descriptively, providing an additional source of information to explore new PSN-generated questions.

    “Lastly, the gathered ESM time-series data can easily be presented to patients and therapists descriptively (e.g., by plotting variable course over time).”
    • Also stated in: § The potential of person-specific networks · hedged
      “This provides them with an interesting additional source of information that may well be used to further explore new PSN-generated questions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    If PSNs are used to generate questions, the clinical value of PSNs in psychotherapy is determined by the added value of these questions.

    “If PSNs are used to generate questions, the clinical value of PSNs in psychotherapy is determined by the added value of these questions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    The different benefits of PSNs integrate well with each other and form a full CC process.

    “This example also illustrates a larger point: The different benefits of PSNs integrate well with each other and form a full CC process.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Personalizing the ESM questionnaire in collaboration between patient and therapist may foster their working alliance.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Personalized experience sampling method has not been empirically studied yet but is currently being investigated in the Therap-i trial.

    “Personalized ESM has not been empirically studied yet but is currently being investigated in the Therap-i trial.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Taking these challenges into account, person-specific networks have potential as a tool to help therapists and patients in their collaborative exploration of a patient's psychopathology.

    “However, taking these challenges into account, we believe they have potential as a tool to help therapists and patients in their collaborative exploration of a patient’s psychopathology.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    An association between two variables in a PSN may be explained by an indirect causal relationship mediated through an unobserved variable, an unobserved common cause, or a collider structure.

    “The direct line between two variables in a network graph appears to suggest a direct (causal) relationship between them, but there are several other possibilities:”
    • Also stated in: § Person-specific networks provide ambiguous information · hedged
      “(i) the relationship could be causal but indirect, mediated through some unobserved variable; (ii) it could also be explained by an unobserved variable that affects both variables (a common cause); and (iii) it might even be spurious, if the two variables both have an effect on a variable that is included in the network (a so-called collider structure) [47].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [47] Elwert F, Winship C. Endogenous selection bias: the problem of conditioning on a collider variable. Annu Rev Sociol. 2014;40(1):31–53. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The structure imposed by PSNs may help navigate the complexity of psychopathology, but because it relies on simplifications, it can also point in the wrong direction.

    “This structure may help us navigate the complexity of psychopathology, but because it relies on certain simplifications, it can also point to the wrong direction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    By using PSNs to guide collaborative exploration while keeping responsibility for developing a working theory of the patient's pathology with patient and therapist, PSNs may prove an important guiding tool in the collaborative CC process.

    “By using PSNs to guide collaborative exploration, but firmly keeping the responsibility for developing a working theory of the patient’s pathology with patient and therapist, PSNs may prove an important guiding tool in the collaborative CC process.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In Kroeze and colleagues' case study, discussion about a PSN led to the formulation of causal hypotheses and motivated the patient to try a new treatment direction she had previously doubted.

    “In their case study, Kroeze and colleagues provided an example of a stimulating discussion about a PSN [27].”
    • Also stated in: § The potential of person-specific networks · plain
      “Their discussion led to the formulation of causal hypotheses and motivated the patient to try a new treatment direction, which she previously had had doubts about.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [27] Kroeze R, van der Veen DC, Servaas MN, Bastiaansen JA, Oude Voshaar RC, Borsboom D, et al. Personalized feedback on symptom dynamics of psychopathology: a proof-of-principle study. J Person-Oriented Research. 2017;3(1):1–11. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    PSN-generated questions may point to different processes than traditional case conceptualization (CC), as they are conceived through a very different process.

    “PSN-generated questions may point to different processes than traditional CC, as they are conceived through a very different process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Patients and therapists may only see part of the picture based on retrospective information discussed in therapy sessions and are naturally limited by their own perspectives and biases.

    “Just like PSNs, patients and therapists may only see part of the picture based on the retrospective information discussed in therapy sessions and are naturally limited by their own perspectives and biases.”
    Quote in the paperNot a substantial claim
65 of 65
  • The authors state this as an assumption.

    We are confident in the collected experience sampling method data and the choices made in modeling and visualizing person-specific networks.

    “Assuming that we are confident in the collected ESM data and the choices made in modeling and visualizing PSNs, two major points are important with regard to their interpretation.”
  • The authors state this as an assumption.

    The mean of included variables is stable over time.

    “Fifth, PSNs assume that the mean of included variables is stable over time and only capture associations between momentary deviations from that stable mean.”
  • The paper relies on this without support.

    The amount of data that can be collected in a clinical setting is limited.

    “However, given that the amount of data that can be collected in a clinical setting is limited, this number is likely less than 10.”
  • The paper relies on this without support.

    Patients and therapists have limited time and experience with experience sampling method compared to researchers.

    “Such an application needs to be user-friendly and guide patients and therapists in the process, since they have limited time and experience with ESM compared to researchers.”
  • The paper relies on this without support.

    Additional investment into case conceptualization is most indicated in the treatment of patients with complex psychopathology (e.g., with comorbidities).

    “Furthermore, additional investment into CC is most indicated in the treatment of patients with complex psychopathology (e.g., with comorbidities).”
  • The paper relies on this without support.

    Natural moments of exploration in psychological treatment are the start of treatment and moments of evaluation and reorientation.

    “Natural moments of exploration in psychological treatment are the start of treatment and moments of evaluation and reorientation.”
  • The paper relies on this without support.

    Personalizing the ESM questionnaire in collaboration between patient and therapist may foster their working alliance.

    “Second, when the ESM questionnaire is personalized in collaboration between patient and therapist, this may foster their working alliance.”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The citation lists haven’t been fetched yet

References 59 · Cited by 63

Authors
von Klipstein, L., Riese, H., van der Veen, D. C., Servaas, M. N., & Schoevers, R. A.
Affiliations
University Medical Center Groningen (NL)
Venue
BMC Medicine
Published
2020-11-23
Volume
18
Issue
1
Pages
345-345
ISSN
1741-7015 (ISSN-L)
OpenAlex
W3106584059
Cited by
63
References
59
Citations by year
2026: 10 · 2025: 9 · 2024: 13 · 2023: 9 · 2022: 8 · 2021: 13 · 2020: 1
FWCI
7.47
Type
journal article
Language
en
Open access
Locations
  • BMC Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
Funders
  • Foundation VCVGZ (239)
  • Innovatiefonds De Friesland (DS81)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Social Sciences › Psychology › Clinical Psychology › Personality Disorders and Psychopathology
Keywords
case formulation, psychotherapy, ecological momentary assessment, psychopathology, network analysis, ecologically valid assessment
MeSH terms
Humans, Psychotherapy, Reproducibility of Results, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review