The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Critical Fluctuations as an Early-Warning Signal for Sudden Gains and Losses in Patients Receiving Psychotherapy for Mood Disorders
Open accessAbstract
Whereas sudden gains and losses (large shifts in symptom severity) in patients receiving psychotherapy appear abrupt and hence may seem unexpected, hypotheses from complex-systems theory suggest that sudden gains and losses are actually preceded by certain early-warning signals (EWSs). We tested whether EWSs in patients’ daily self-ratings of the psychotherapeutic process predicted future sudden gains and losses. Data were collected from 328 patients receiving psychotherapy for mood disorders who completed daily self-ratings about their therapeutic process using the Therapy Process Questionnaire (TPQ). Sudden gains and losses were classified from the Problem Intensity scale of the TPQ. The other items of the TPQ were used to compute the EWSs. EWSs predicted an increased probability for sudden gains and losses in a 4-day predictive window. These results show that EWSs can be used for real-time prediction of sudden gains and losses in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, EMA data has also been successfully used to predict the development of symptoms within treatments [e.g., (42)].”
From Personalised depression forecasting using mobile sensor data and ecological momentary assessment (2022) · cites this paper as [42]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Early-warning signals for critical transitions
Scheffer, M., Bascompte, J., Brock, W. A., Brovkin, V., Carpenter, S. R., Dakos, V., Held, H., van Nes, E. H., Rietkerk, M., & Sugihara, G. (2009) · Nature · doi:10.1038/nature08227 · Cited by 4,854
A Dynamic Systems Approach to the Development of Cognition and Action
Thelen, E., & Smith, L. B. (1994) · doi:10.7551/mitpress/2524.001.0001 · Cited by 3,470
A dynamic systems approach to the development of cognition and action
Thelen, E., & Smith, L. B. (1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90021-8 · Cited by 3,454
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 4×
“One central issue in the study of change processes in psychotherapy is the establishment of a timeline in individual change trajectories (i.e., a temporal relation between a hypothesized mechanism and a symptom severity measure; Kazdin, 2007).”
BackgroundMethodInfluentialAnticipating Critical Transitions
Scheffer, M., Carpenter, S. R., Lenton, T. M., Bascompte, J., Brock, W., Dakos, V., van de Koppel, J., van de Leemput, I. A., Levin, S. A., van Nes, E. H., et al. (2012) · Science · doi:10.1126/science.1225244 · Cited by 2,208
Haken, H. (1983) · Springer series in synergetics · doi:10.1007/978-3-642-88338-5 · Cited by 1,471
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Critical slowing down as early warning for the onset and termination of depression
van de Leemput, I. A., Wichers, M., Cramer, A. O. J., Borsboom, D., Tuerlinckx, F., Kuppens, P., van Nes, E. H., Viechtbauer, W., Giltay, E. J., Aggen, S. H., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312114110 · Cited by 816
Research works printed but not linked: 5
- Haken H., Schiepek G. (2010). Synergetik in der Psychologie: Selbstorganisation verstehen und gestalten [Synergetics in psychology: understanding and shaping self-organization] (corrected ed.). Göttingen, Germany: Hogrefe.
- 10.1016/j.cpr.2007.01.008.Change · DOI
- Heinzel S., 2014, Nonlinear Dynamics, Psychology, and Life Sciences, 18, 155
- Helmich M. A., 2019, Sudden gains and linear change predict better outcomes for depressed individuals in therapy
- World Health Organization, 1992, International statistical classification of diseases and related health problems, 10th revisions (ICD-10)
Cited by
Sorted by citations
Items 101–146 of 146
Bos, F. M., Schreuder, M. J., George, S. V., Doornbos, B., Bruggeman, R., van der Krieke, L., Haarman, B. C. M., Wichers, M., & Snippe, E. (2021) · doi:10.31234/osf.io/v5b7t · Cited by 3
Nordholt, S., Garrison, P., Aichhorn, W., Ochs, M., & Schiepek, G. K. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1259610 · Cited by 2
Self-citationSchiepek, G. K., & Wackernagel, S. (2025) · JMIR Research Protocols · doi:10.2196/78166 · Cited by 2
Self-citationBeyköylü, H., Vervaeke, J., & Meling, D. (2025) · Philosophical Psychology · doi:10.1080/09515089.2025.2601717 · Cited by 4
The S-F Oscillations in Psychotherapy
de Felice, G., Sciaraffa, N., Antonacci, Y., Giuliani, A., Schöller, H. J., Aichhorn, W., Kratzer, L., & Schiepek, G. (2025) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-025-09693-7 · Cited by 2
Self-citationMorgenshtern, G., Rutishauser, Y., Haag, C., von Wyl, V., & Bernard, J. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae230 · Cited by 3
Modeling psychopathology: 4D multiplexes to the rescue
Kästner, L. (2022) · Synthese · doi:10.1007/s11229-022-04008-y · Cited by 5
Early Warning Method of College Students Mental Subhealth Based on Internet of Things
Li, X. (2023) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-33545-7_4 · Cited by 2
Cui, J., Hasselman, F., Olthof, M., & Lichtwarck‐Aschoff, A. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b68wh · Cited by 2
Self-citationBossenbroek, R., Gmelin, J.-O. H., Olthof, M., Knot-Dickscheit, J., Hasselman, F., Poelen, E., & Lichtwarck‐Aschoff, A. (2025) · Children and Youth Services Review · doi:10.1016/j.childyouth.2025.108720 · Cited by 1
Self-citationDer therapeutische Mehrwert von Prozessfeedback aus Sicht von Therapeut*innen und Patient*innen
Schiepek, G. K., Schöller, H. J., & Hülsner, Y. (2026) · Die Psychotherapie · doi:10.1007/s00278-026-00845-1 · Cited by 1
Self-citationBaretta, D., Mazéas, A., Chalabaëv, A., Inauen, J., & Chevance, G. (2026) · npj Exercise Medicine and Health · doi:10.1038/s44437-026-00003-4 · Cited by 1
The Synergetic Navigation System (SNS)
Schiepek, G. K., Eckert, H., Kolenik, T., Aichhorn, W., & Schöller, H. J. (2026) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000887 · Cited by 1
Self-citationDepression in Children and Adolescents
Fenley, A. R., Darling, L. N., Schild, J. S., & Langer, D. A. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00083-2 · Cited by 2
The Application of Exposure Principles to the Treatment of Depression
Hayes, A. M., Yasinski, C. W., & Alpert, E. (2022) · Springer eBooks · doi:10.1007/978-3-031-04927-9_17 · Cited by 1
Helmich, M. A. (2022) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.200101721 · Cited by 2
Self-citationDetecting Idiographic Personality ChangePreprint
Beck, E. D., & Jackson, J. J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/uts5a · Cited by 3
There and back again: a dynamical perspective on psychological resilience
Kuranova, A. (2022) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.223532259 · Cited by 2
Pereira, P. E. C. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.47.2022.tde-07122022-082556 · Cited by 1
Hulsmans, D. H. G., Otten, R., Poelen, E. A. P., van Vonderen, A., Daalmans, S., Hasselman, F., Olthof, M., & Lichtwarck‐Aschoff, A. (2023) · Research Square · doi:10.21203/rs.3.rs-3358763/v1 · Cited by 1
Self-citationExploring boundary conditions of sustained physical activity: implications for theory and practice.Preprint
Baretta, D., Chevance, G., Costello, V. L., Mansour-Assi, S., Wing, D., Hekler, E. B., Inauen, J., Godino, J., & Nigg, C. R. (2024) · doi:10.31219/osf.io/nkcea · Cited by 1
Early warning signs in complex systems: the study of transitions in psychotherapy
Hayes, A. M., & Andrews, L. A. (2020) · Springer eBooks · doi:10.1007/978-3-658-29906-4_8
Høgenhaug, S. S., Bloch, M. S., Schiepek, G. K., Kjølbye, M., & Steffensen, S. V. (2021) · Psychoanalytic Psychotherapy · doi:10.1080/02668734.2021.1920454 · Cited by 1
Self-citationSystemisch Lernen und Lehren: Inhalte – Methoden – Erfahrungen
Schiepek, G. K. (2021) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666407857.101
Self-citationNever waste a good crisis : Examining team coordination breakdowns during crisis situationsPreprint
van Eijndhoven, K. H. J., Wiltshire, T. J., Hałgas, E. A., & Gevers, J. (2022) · doi:10.31234/osf.io/p4r6h
de Felice, G., Meganck, R., Chiepek, G., & Smet, M. M. D. (2021) · Frontiers research topics · doi:10.3389/978-2-88971-526-8
Identifying critical transitions in major depression with fuzzy recurrence entropy
Pham, T. D. (2022) · All Life · doi:10.1080/26895293.2022.2132017
Sun, N., & Lu, C. L. (2022) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec54921.2022.9951905
A Theory-Informed Emotion Regulation Variability Index: Bray-Curtis DissimilarityPreprint
Lo, T. T., Lissa, C. J. V., Verhagen, M., Hoemann, K., Erbaş, Y., & Maciejewski, D. F. (2023) · doi:10.31234/osf.io/twk9m
Canazei, M., & Fürst, J. (2023) · Zeitschrift für Psychodrama und Soziometrie · doi:10.1007/s11620-023-00724-w
Examining Physiological Features Underlying Team Coordination BreakdownsPreprint
van Eijndhoven, K. H. J., Wiltshire, T. J., Hałgas, E. A., Gevers, J., & Louwerse, M. M. (2023) · Research Square · doi:10.21203/rs.3.rs-3777585/v1
Review Essay: Limits of the Numerical and the Personalized Measurement Trend in Mental Health Care
de Boer, N. S., & Runhardt, R. W. (2024) · Philosophy of the Social Sciences · doi:10.1177/00483931241255255 · Cited by 1
de Felice, G., & Pincus, D. (2024) · Psychiatry International · doi:10.3390/psychiatryint5040054
Eckes, T., & Nestler, S. (2025) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-025-10242-8
Kim, M., Perski, O., Torre, S. A. D. L., Smith, T., Park, J.-H., Rivera, D. E., Klasnja, P., & Hekler, E. B. (2026) · Health Psychology Review · doi:10.1080/17437199.2026.2738646
Hulsmans, D. H. G., Otten, R., Poelen, E. A. P., van Vonderen, A., Daalmans, S., Hasselman, F., Olthof, M., & Lichtwarck‐Aschoff, A. (2024) · Figshare · doi:10.6084/m9.figshare.26723765
Self-citationHulsmans, D. H. G., Otten, R., Poelen, E. A. P., van Vonderen, A., Daalmans, S., Hasselman, F., Olthof, M., & Lichtwarck‐Aschoff, A. (2024) · Figshare · doi:10.6084/m9.figshare.26723762
Self-citationBos, F. M., Schreuder, M. J., George, S. V., Doornbos, B., Bruggeman, R., van der Krieke, L., Haarman, B. C. M., Wichers, M., & Snippe, E. (2022) · Figshare · doi:10.6084/m9.figshare.19568752
Van ROM naar gepersonaliseerde proces monitoring: een nieuwe kijk op meten in de praktijkPreprint
Olthof, M., Aas, B., Bossenbroek, R., van den Bergh, R., Goldbeck, F., Daniels-Wredenhagen, N., & Lichtwarck‐Aschoff, A. (2024) · doi:10.31234/osf.io/vedwc
Self-citationFrom diagnosis to dynamics: complex systems, transdiagnostics, and networks in forensic psychiatry
Bogaerts, S., Masthoff, E., Frowijn, I., Caluwé, E. D., Habets, P., Janković, M., & Smith, L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1775635
Reis, D., Stasch, P., Peuckmann, L., Lambert, P., & Kirchner, S. (2026) · Assessment · doi:10.1177/10731911261429617
Network Theories of Psychopathology
Rodebaugh, T. L., Levitan, J. M., & Messner, G. R. (2026) · Oxford University Press eBooks · doi:10.1093/9780197769676.003.0008
Chen, Z., Qi, X., Jiang, Z. H. E. N. G. M., & Liu, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-9910725/v1
Psychiatry and the unknown future: the period of hope
Conca, A., Giupponi, G., Eisendle, K., Boschello, F., & Wedmann, F. M. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1824703 · Cited by 1
Feedback-Informed Psychotherapy
Fritz, J., Hehlmann, M. I., Günther, F., & Rubel, J. A. (2026) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000888
Metadata
- Authors
- Olthof, M., Hasselman, F., Strunk, G., van Rooij, M., Aas, B., Helmich, M. A., Schiepek, G., & Lichtwarck-Aschoff, A.
- Affiliations
- Radboud University Nijmegen (NL)
- TU Dortmund University (DE)
- Behavioural Science Institute, Radboud University
- LMU Klinikum (DE)
- University Medical Center Groningen (NL)
- Paracelsus Medical University (AT)
- Corresponding author
- Olthof, Merlijn
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-09-24
- Volume
- 8
- Issue
- 1
- Pages
- 25-35
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W2976346093
- Cited by
- 146
- References
- 53
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 20 · 2023: 30 · 2022: 32 · 2021: 23 · 2020: 16 · 2019: 2
- FWCI
- 21.34
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Clinical Psychological Science (publishedVersion, cc-by-nc)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by-nc)
- Open access LMU (Ludwid Maxmilian's Universitat Munchen) (submittedVersion, cc-by-nc)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by-nc)
- Funders
- h2020 european research council (ERC-CoG-2015; No 681466)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Ecosystem dynamics and resilience
- Keywords
- early warning indicators, critical fluctuations, psychotherapy outcome prediction, mood disorders, therapeutic process, complexity theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
