Single-subject research in psychiatry: facts and fictions
Open accessAbstract
Scientific evidence in the field of psychiatry is mainly derived from group-based ("nomothetic") studies that yield group-aggregated results, while often the need is to answer questions that apply to individuals. Particularly in the presence of great inter-individual differences and temporal complexities, information at the individual-person level may be valuable for personalized treatment decisions, individual predictions and diagnostics. The single-subject study design can be used to make inferences about individual persons. Yet, the single-subject study is not often used in the field of psychiatry. We believe that this is because of a lack of awareness of its value rather than a lack of usefulness or feasibility. In the present paper, we aimed to resolve some common misconceptions and beliefs about single-subject studies by discussing some commonly heard "facts and fictions." We also discuss some situations in which the single-subject study is more or less appropriate, and the potential of combining single-subject and group-based study designs into one study. While not intending to plea for single-subject studies at the expense of group-based studies, we hope to increase awareness of the value of single-subject research by informing the reader about several aspects of this design, resolving misunderstanding, and providing references for further reading.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In clinical practice, the focus is on individual patients.
“in clinical practice, the focus is on individual patients (120).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [120]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,302 · see citing works
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974 · see citing works
Symonds, P. M. (1954) · Journal of Educational Psychology · doi:10.1037/h0051901 · Cited by 4,902 · see citing works
Associations of depression with C-reactive protein, IL-1, and IL-6: a meta-analysis.
Howren, M. B., Lamkin, D. M., & Suls, J. (2009) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181907c1b · Cited by 2,766 · see citing works
Operant Behavior: Areas of Research and Application,
Honig, W. K. (1966) · Medical Entomology and Zoology · Cited by 2,656 · see citing works
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · see citing works
Handbook of research methods for studying daily life
Mehl, M. R., Conner, T. S., & Csíkszentmihályi, M. (2012) · Choice Reviews Online · doi:10.5860/choice.50-1159 · Cited by 2,121 · see citing works
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056 · see citing works
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · see citing works
Causal Inference in Statistics
Pearl, J., Glymour, M., & Jewell, N. P. (2016) · Cited by 1,436 · see citing works
Coming to terms with the terms of risk
Kraemer, H. C. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830160065009 · Cited by 1,432 · see citing works
Handbook of multivariate experimental psychology
Nesselroade, J., & Cattell, R. (1968) · Springer eBooks · doi:10.1007/978-1-4613-0893-5 · Cited by 1,351 · see citing works
Personalized medicine: Time for one-person trials
Schork, N. J. (2015) · Nature · doi:10.1038/520609a · Cited by 1,229 · see citing works
Stetler, C., & Miller, G. E. (2011) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31820ad12b · Cited by 1,123 · see citing works
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099 · see citing works
The new person-specific paradigm in psychology
Molenaar, P. C. M., & Campbell, C. G. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01619.x · Cited by 1,088 · see citing works
Dynamic Structural Equation Models
Asparouhov, T., Hamaker, E., & Muthén, B. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1406803 · Cited by 875 · see citing works
Haedt-Matt, A. A., & Keel, P. K. (2011) · Psychological Bulletin · doi:10.1037/a0023660 · Cited by 799 · see citing works
The n-of-1 clinical trial: the ultimate strategy for individualizing medicine?
Lillie, E. O., Patay, B., Diamant, J., Issell, B., Topol, E. J., & Schork, N. J. (2011) · Personalized Medicine · doi:10.2217/pme.11.7 · Cited by 706 · see citing works
The new field of ‘precision psychiatry’
Fernandes, B. S., Williams, L. M., Steiner, J. H., Leboyer, M., Carvalho, A. F., & Berk, M. (2017) · BMC Medicine · doi:10.1186/s12916-017-0849-x · Cited by 550 · see citing works
Hamaker, E. L., Asparouhov, T., Brose, A., Schmiedek, F., & Muthén, B. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1446819 · Cited by 549 · see citing works
Simpson's paradox in psychological science: a practical guide
Kievit, R. A., Frankenhuis, W. E., Waldorp, L. J., & Borsboom, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00513 · Cited by 542 · see citing works
Hamaker, E. L., & Wichers, M. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721416666518 · Cited by 505 · see citing works
Self-citationGates, K. M., & Molenaar, P. C. M. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.026 · Cited by 478 · see citing works
Small is beautiful: In defense of the small-N design
Smith, P. L., & Little, D. R. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1451-8 · Cited by 466 · see citing works
Epskamp, S., van Borkulo, C. D., van der Veen, D. C., Servaas, M. N., Isvoranu, A.-M., Riese, H., & Cramer, A. O. J. (2018) · Clinical Psychological Science · doi:10.1177/2167702617744325 · Cited by 448 · see citing works
Self-citationAssociation of maternal hypertension and chorioamnionitis with preterm outcomes.
Gagliardi, L., Rusconi, F., Bellù, R., r, Z., Laforgia, N., & in Italian Neonatal Network (2014) · CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro) · doi:10.1542/peds · Cited by 424 · see citing works
Critical Slowing Down as a Personalized Early Warning Signal for Depression
Wichers, M., Groot, P. C., & Psychosystems, E. G. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000441458 · Cited by 399 · see citing works
Self-citationExploring the idiographic dynamics of mood and anxiety via network analysis
Fisher, A. J., Reeves, J. W., Lawyer, G., Medaglia, J. D., & Rubel, J. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000311 · Cited by 385 · see citing works
Hutcheson, G. (2011) · SAGE Publications Ltd eBooks · doi:10.4135/9781446251119.n86 · Cited by 375 · see citing works
Personalized Medicine for Depression: Can We Match Patients With Treatments?
Simon, G. E., & Perlis, R. H. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09111680 · Cited by 365 · see citing works
Interindividual differences in intraindividual change.
Nesselroade, J. R. (1991) · American Psychological Association eBooks · doi:10.1037/10099-006 · Cited by 358 · see citing works
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325 · see citing works
Are results of randomized controlled trials useful to psychotherapists?
Persons, J. B., & Silberschatz, G. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.126 · Cited by 320 · see citing works
Statistical Issues in the Study of Temporal Data: Daily Experiences
West, S. G., & Hepworth, J. T. (1991) · Journal of Personality · doi:10.1111/j.1467-6494.1991.tb00261.x · Cited by 307 · see citing works
Kramer, I., Simons, C. J. P., Hartmann, J. A., Menne-Lothmann, C., Viechtbauer, W., Peeters, F., Schruers, K., van Bemmel, A. L., Myin-Germeys, I., Delespaul, P., et al. (2014) · World Psychiatry · doi:10.1002/wps.20090 · Cited by 306 · see citing works
Self-citationPersonalized Models of Psychopathology
Wright, A. G. C., & Woods, W. C. (2020) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-102419-125032 · Cited by 281 · see citing works
Emotion-Network Density in Major Depressive Disorder
Pe, M. L., Kircanski, K., Thompson, R. J., Bringmann, L. F., Tuerlinckx, F., Mestdagh, M., Mata, J., Jaeggi, S. M., Buschkuehl, M., Jonides, J. J., et al. (2014) · Clinical Psychological Science · doi:10.1177/2167702614540645 · Cited by 264 · see citing works
Why Can't We Be More Idiographic in Our Research?
Barlow, D. H., & Nock, M. K. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01088.x · Cited by 243 · see citing works
Personalized medicine in psychiatry: problems and promises
Ozomaro, U., Wahlestedt, C., & Nemeroff, C. B. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-132 · Cited by 237 · see citing works
Are results of randomized controlled trials useful to psychotherapists?
Persons, J. B., & Silberschatz, G. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.126 · Cited by 233 · see citing works
Hamaker, E. L., Dolan, C. V., & Molenaar, P. C. M. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4002_3 · Cited by 219 · see citing works
Zucker, D. R., Schmid, C. H., McIntosh, M. W., D’Agostino, R. B., Selker, H. P., & Lau, J. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00429-5 · Cited by 218 · see citing works
Single subject research designs for disability research
Su, Z., & Ottenbacher, K. J. (2001) · Disability and Rehabilitation · doi:10.1080/09638280150211202 · Cited by 212 · see citing works
Modeling Affect Dynamics: State of the Art and Future Challenges
Hamaker, E. L., Ceulemans, E., Grasman, R. P. P. P., & Tuerlinckx, F. (2015) · Emotion Review · doi:10.1177/1754073915590619 · Cited by 207 · see citing works
Single-case methodology in psychotherapy process and outcome research.
Hilliard, R. B. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.3.373 · Cited by 198 · see citing works
Single-case methodology in psychotherapy process and outcome research
Hilliard, R. B. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.3.373 · Cited by 198 · see citing works
Bos, F. M., Snippe, E., de Vos, S., Hartmann, J., Simons, C. J. P., van der Krieke, L., de Jonge, P., & Wichers, M. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000453583 · Cited by 176 · see citing works
Self-citationPERSONALIZED TREATMENT OF ADULT DEPRESSION: MEDICATION, PSYCHOTHERAPY, OR BOTH? A SYSTEMATIC REVIEW
Cuijpers, P. J., Reynolds, C. F., Donker, T., Li, J., Andersson, G., & Beekman, A. T. F. (2012) · Depression and Anxiety · doi:10.1002/da.21985 · Cited by 166 · see citing works
`Nomothetic' and `Idiographic'
Lamiell, J. T. (1998) · Theory & Psychology · doi:10.1177/0959354398081002 · Cited by 159 · see citing works
Open trial of a personalized modular treatment for mood and anxiety
Fisher, A. J., Bosley, H. G., Fernandez, K. C., Reeves, J. W., Soyster, P. D., Diamond, A. E., & Barkin, J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.01.010 · Cited by 156 · see citing works
Hoffman, L. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701710072 · Cited by 153 · see citing works
Modeling individual differences using Dirichlet processes
Navarro, D., Griffiths, T. L., Steyvers, M., & Lee, M. D. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.11.006 · Cited by 145 · see citing works
Hierarchical Bayesian continuous time dynamic modeling.
Driver, C. C., & Voelkle, M. (2018) · Psychological methods · doi:10.1037/met0000168 · Cited by 145 · see citing works
CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement
Vohra, S., Shamseer, L., Sampson, M., Bukutu, C., Schmid, C. H., Tate, R. L., Nikles, J., Zucker, D. R., Kravitz, R. L., Guyatt, G. H., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.004 · Cited by 142 · see citing works
CONSORT extension for reporting N-of-1 trials (CENT) 2015: explanation and elaboration
Shamseer, L., Sampson, M., Bukutu, C., Schmid, C. H., Nikles, J., Tate, R. L., Johnston, B. C., Zucker, D. R., Shadish, W. R., Kravitz, R. L., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.018 · Cited by 142 · see citing works
Estes, W. K., & Maddox, W. T. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03193784 · Cited by 141 · see citing works
Schneider, R. L., Arch, J. J., & Wolitzky-Taylor, K. B. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.02.004 · Cited by 135 · see citing works
Maher, J. P., Rebar, A. L., & Dunton, G. F. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01485 · Cited by 118 · see citing works
Therapist-aided exposure for women with lifelong vaginismus: A replicated single-case design.
ter Kuile, M. M., Bulté, I., Weijenborg, P. T. M., Beekman, A., Melles, R. J., & Onghena, P. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014273 · Cited by 109 · see citing works
Randomised study of n of 1 trials versus standard practice
Mahon, J., Laupacis, A., Donner, A. P., & Wood, T. (1996) · BMJ · doi:10.1136/bmj.312.7038.1069 · Cited by 104 · see citing works
Niendam, T. A., Tully, L. M., Iosif, A., Kumar, D., Nye, K. E., Denton, J. C., Zakskorn, L. N., Fedechko, T. L., & Pierce, K. M. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.10.017 · Cited by 101 · see citing works
Revealing Causal Heterogeneity Using Time Series Analysis of Ambulatory Assessments
Rosmalen, J. G. M., Wenting, A. M. G., Roest, A. M., de Jonge, P., & Bos, E. H. (2012) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3182545d47 · Cited by 99 · see citing works
Self-citationBurger, J., van der Veen, D. C., Robinaugh, D. J., Quax, R., Riese, H., Schoevers, R. A., & Epskamp, S. (2020) · BMC Medicine · doi:10.1186/s12916-020-01558-1 · Cited by 99 · see citing works
Self-citationAn n=1 Clinical Network Analysis of Symptoms and Treatment in Psychosis
Bak, M., Drukker, M., Hasmi, L., & van Os, J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162811 · Cited by 94 · see citing works
Klippel, A., Viechtbauer, W., Reininghaus, U., Wigman, J. T. W., van Borkulo, C. D., MERGE, Myin‐Germeys, I., & Wichers, M. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx037 · Cited by 94 · see citing works
Self-citationPersonalized feedback on symptom dynamics of psychopathology: A proof-of-principle study
Kroeze, R., van der Veen, D. C., Servaas, M. N., Bastiaansen, J. A., Voshaar, R. C. O. V., Borsboom, D., Ruhe, H. G., Schoevers, R. A., & Riese, H. (2017) · Journal for Person-Oriented Research · doi:10.17505/jpor.2017.01 · Cited by 93 · see citing works
Self-citationRamsey, A. T., Wetherell, J. L., Depp, C. A., Dixon, D. J., & Lenze, E. J. (2016) · Journal of Technology in Human Services · doi:10.1080/15228835.2016.1170649 · Cited by 91 · see citing works
Nikles, J., Mitchell, G. K., Mar, C. D., Clavarino, A. M., & McNairn, N. (2006) · PEDIATRICS · doi:10.1542/peds.2005-1328 · Cited by 78 · see citing works
Linear Mixed Models for Longitudinal Data
Avilés, A. I. (2001) · Technometrics · doi:10.1198/tech.2001.s630 · Cited by 72 · see citing works
The Idiographic / Nomothetic Dichotomy: Tracing Historical Origins of Contemporary Confusions
Robinson, O. C. (2011) · History & Philosophy of Psychology · doi:10.53841/bpshpp.2011.13.2.32 · Cited by 71 · see citing works
Exploring the limits and utility of operant conditioning in the treatment of drug addiction
Silverman, K. (2004) · The Behavior Analyst · doi:10.1007/bf03393181 · Cited by 69 · see citing works
van der Krieke, L., Blaauw, F. J., Emerencia, A. C., Schenk, H., Slaets, J. P. J., Bos, E. H., de Jonge, P., & Jeronimus, B. F. (2016) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000378 · Cited by 69 · see citing works
Self-citationConradi, H., de Jonge, P., Kluiter, H., Smit, A., Meer, K. V. D., Jenner, J., van Os, T., Emmelkamp, P., & Ormel, J. (2007) · Psychological Medicine · doi:10.1017/s0033291706009809 · Cited by 68 · see citing works
Development and initial implementation of the Dynamic Assessment Treatment Algorithm (DATA)
Fernandez, K. C., Fisher, A. J., & Chi, C. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178806 · Cited by 68 · see citing works
Bayesian Data Analysis with the Bivariate Hierarchical Ornstein-Uhlenbeck Process Model
Oravecz, Z., Tuerlinckx, F., & Vandekerckhove, J. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1110512 · Cited by 64 · see citing works
The appropriacy of averaging in the study of context effects
Liew, S. X., Howe, P. D. L., & Little, D. R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1032-7 · Cited by 62 · see citing works
Intraindividual Dynamic Network Analysis – Implications for Clinical Assessment
David, S. J., Marshall, A. J., Evanovich, E. K., & Mumma, G. H. (2017) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-017-9632-8 · Cited by 60 · see citing works
A multivariate statistical model for emotion dynamics.
Krone, T., Albers, C. J., Kuppens, P., & Timmerman, M. E. (2017) · Emotion · doi:10.1037/emo0000384 · Cited by 60 · see citing works
van der Krieke, L., Emerencia, A. C., Bos, E. H., Rosmalen, J. G. M., Riese, H., Aiello, M., Sytema, S., & de Jonge, P. (2015) · JMIR Research Protocols · doi:10.2196/resprot.4000 · Cited by 58 · see citing works
Self-citationLévesque, M., Savard, J., Simard, S., Gauthier, J. G., & Ivers, H. (2004) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2004.05.002 · Cited by 58 · see citing works
The evolution of behaviour therapy and cognitive behaviour therapy.
Rachman, S. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.10.006 · Cited by 58 · see citing works
Randomization Does Not Help Much, Comparability Does
Saint‐Mont, U. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132102 · Cited by 55 · see citing works
Liu, S. (2017) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12096 · Cited by 54 · see citing works
Ottenbacher, K. J., & Hinderer, S. R. (2001) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/00002060-200110000-00014 · Cited by 53 · see citing works
van Roekel, E., Vrijen, C., Heininga, V. E., Masselink, M., Bos, E. H., & Oldehinkel, A. J. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.09.009 · Cited by 52 · see citing works
Self-citationSingle-Case Research Design in Pediatric Psychology: Considerations Regarding Data Analysis
Cohen, L. L., Feinstein, A. B., Masuda, A., & Vowles, K. E. (2013) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jst065 · Cited by 50 · see citing works
Double-blind Methylphenidate Trials
Kent, M. A., Camfield, C., & CAMFIELD, P. R. (1999) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.153.12.1292 · Cited by 50 · see citing works
Temporal dynamics of physical activity and affect in depressed and nondepressed individuals
Stavrakakis, N., Booij, S. H., Roest, A. M., de Jonge, P., Oldehinkel, A. J., & Bos, E. H. (2015) · Health Psychology · doi:10.1037/hea0000303 · Cited by 47 · see citing works
Self-citationNezlek, J. B., Holas, P., Rusanowska, M., & Krejtz, I. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.11.031 · Cited by 41 · see citing works
Snippe, E., Bos, E. H., der Ploeg, K. M. V., Sanderman, R., Fleer, J., & Schroevers, M. J. (2014) · Mindfulness · doi:10.1007/s12671-014-0354-7 · Cited by 38 · see citing works
Self-citationBlaauw, F. J., Schenk, H., Jeronimus, B. F., van der Krieke, L., de Jonge, P., Aiello, M., & Emerencia, A. C. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.08.001 · Cited by 37 · see citing works
Miguélez‐Fernández, C., de León-Martínez, S., Baltasar-Tello, I., Peñuelas‐Calvo, I., Barrigón, M. L., Sedano-Capdevila, A., Delgado‐Gómez, D., Baca‐García, E., & Carballo, J. J. (2018) · ADHD Attention Deficit and Hyperactivity Disorders · doi:10.1007/s12402-018-0261-1 · Cited by 37 · see citing works
Are Nomothetic or Ideographic Approaches Superior in Predicting Daily Exercise Behaviors?
Cheung, Y. K., Hsueh, P.-Y. S., Qian, M., Yoon, S., Meli, L., Diaz, K. M., Schwartz, J. E., Kronish, I. M., & Davidson, K. W. (2017) · Methods of Information in Medicine · doi:10.3414/me16-02-0051 · Cited by 34 · see citing works
Rozet, A., Kronish, I. M., Schwartz, J. E., & Davidson, K. W. (2019) · Journal of Medical Internet Research · doi:10.2196/12910 · Cited by 28 · see citing works
Personalized (N-of-1) Trials for Depression
Kronish, I. M., Hampsey, M., Falzon, L., Konrad, B., & Davidson, K. W. (2018) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000864 · Cited by 27 · see citing works
Yang, X., Ram, N., Gest, S. D., Lydon‐Staley, D. M., Conroy, D. E., Pincus, A. L., & Molenaar, P. C. M. (2018) · Complexity · doi:10.1155/2018/5094179 · Cited by 26 · see citing works
Four Functional Roles for Case Studies in Emerging Adulthood Research
Robinson, O. C., & McAdams, D. P. (2015) · Emerging Adulthood · doi:10.1177/2167696815592727 · Cited by 25 · see citing works
Stunnenberg, B. C., Woertman, W. H., Raaphorst, J., Statland, J. M., Griggs, R. C., Timmermans, J., Saris, C. G. J., Schouwenberg, B. J., Groenewoud, H., Stegeman, D. F., et al. (2015) · BMC Neurology · doi:10.1186/s12883-015-0294-4 · Cited by 24 · see citing works
The temporal dynamics of cortisol and affective states in depressed and non-depressed individuals
Booij, S. H., Bos, E. H., de Jonge, P., & Oldehinkel, A. J. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.03.012 · Cited by 24 · see citing works
Self-citationHoenders, R. H. J., Bos, E. H., de Jong, J. T. V. M., & de Jonge, P. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000335928 · Cited by 18 · see citing works
Self-citationSchenk, H., Bos, E. H., Slaets, J. P. J., de Jonge, P., & Rosmalen, J. G. M. (2017) · British Journal of Health Psychology · doi:10.1111/bjhp.12229 · Cited by 16 · see citing works
Self-citationApplication of n-of-1 treatment trials in schizophrenia: systematic review
Marwick, K. F. M., Stevenson, A. J., Davies, C., & Lawrie, S. M. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.71 · Cited by 16 · see citing works
(1901) · Biometrika · doi:10.1093/biomet/1.1.1 · Cited by 16 · see citing works
Cognitive therapy of psychotic depression: A case report.
Bishop, S. B., Miller, I. W., Norman, W. H., Buda, M., & Foulke, M. (1986) · Psychotherapy · doi:10.1037/h0085584 · Cited by 15 · see citing works
Bouwmans, M. E. J., Beltz, A. M., Bos, E. H., Oldehinkel, A. J., de Jonge, P., & Molenaar, P. C. M. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.11.022 · Cited by 15 · see citing works
Self-citationHoutveen, J. H., Hamaker, E. L., & van Doornen, L. J. P. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00951.x · Cited by 14 · see citing works
Replication is already mainstream: Lessons from small- N designs
Little, D. R., & Smith, P. L. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000766 · Cited by 13 · see citing works
N-of-1 trials: an opportunity to tailor treatment in individual patients.
Madhok, V. B., & Fahey, T. P. (2005) · PubMed · Cited by 12 · see citing works
Voigt, A., Kreiter, D., Jacobs, C., Revenich, E., Serafras, N., Wiersma, M., van Os, J., Bak, M., & Drukker, M. (2018) · Bipolar Disorder Open Access · doi:10.4172/2472-1077.1000121 · Cited by 9 · see citing works
Overcoming Depression with Dance Movement Therapy: A Case Report.
Tavormina, R., & Tavormina, M. G. M. (2018) · PubMed · Cited by 8 · see citing works
Bouwmans, M. E. J., Oude Oosterik, N. A. M., Bos, E. H., de Groot, I. W., Oldehinkel, A. J., & de Jonge, P. (2018) · Behavioral Sleep Medicine · doi:10.1080/15402002.2016.1180521 · Cited by 6 · see citing works
Self-citation[The N-of-1 trial: the ideal study design that is underused].
Vandenbroucke, J. P. (2006) · PubMed · Cited by 5 · see citing works
[N-of-1 trials in child and adolescent psychiatry: a closer look at stimulants].
Mordijck, E., Danckaerts, M., & Onghena, P. (2018) · PubMed · Cited by 3 · see citing works
De netwerkbenadering bij depressie: Veel noten op de zang of heilige graal?
Wichers, M., Snippe, E., Riese, H., & Bos, F. (2019) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
2 of the 118 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- [54]Velicer WF Molenaar P Time series analysis. Research methods in psychology. In: Schinka J, Velicer WF, editors. Volume 2 of Handbook of Psychology (I. B. Weiner, Editor-in-Chief). 2nd ed New York, NY: John Wiley & Sons (2013). p. 628– 60.
- [66]Vandenbroucke JP. De N = 1 trial, de meest ideale onderzoeksopzet, die te weinig wordt gebruikt. Ned Tijdschr Geneeskd. (2006) 150: 2794– 5. 17216726
- [70]OCEBM Levels of Evidence Working Group The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine. Available online at: https://www.cebm.net/wp-content/uploads/2014/06/CEBM-Levels-of-Evidence-2.1.pdf (assessed January 13, 2020).
Cited by
Sorted by citations
Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
Self-citationWichers, M., Riese, H., Hodges, T. M., Snippe, E., & Bos, F. M. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.719490 · Cited by 90 · see citing works
Self-citationSo You Want to Do ESM? 10 Essential Topics for Implementing the Experience-Sampling Method
Fritz, J., Piccirillo, M. L., Cohen, Z. D., Frumkin, M. R., Kirtley, O. J., Moeller, J., Neubauer, A. B., Norris, L. A., Schuurman, N. K., Snippe, E., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241267912 · Cited by 90 · see citing works
Self-citationBos, F. M., Schreuder, M. J., George, S. V., Doornbos, B., Bruggeman, R., van der Krieke, L., Haarman, B. C. M., Wichers, M., & Snippe, E. (2022) · International Journal of Bipolar Disorders · doi:10.1186/s40345-022-00258-4 · Cited by 64 · see citing works
Self-citationBurger, J., Ralph‐Nearman, C., & Levinson, C. A. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104221 · Cited by 33 · see citing works
Zainal, N. H., & Newman, M. G. (2021) · European Psychiatry · doi:10.1192/j.eurpsy.2021.2217 · Cited by 33 · see citing works
Smit, A. C., & Snippe, E. (2022) · Psychological Medicine · doi:10.1017/s0033291722002069 · Cited by 27 · see citing works
Self-citationMijnster, T., Boersma, G. J., Meijer, E., & Lancel, M. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12071070 · Cited by 22 · see citing works
Difrancesco, S., Penninx, B. W. J. H., Merikangas, K. R., van Hemert, A. M., Riese, H., & Lamers, F. (2022) · Depression and Anxiety · doi:10.1002/da.23298 · Cited by 19 · see citing works
Self-citationBurger, J., Epskamp, S., van der Veen, D. C., Dablander, F., Schoevers, R. A., Fried, E. I., & Riese, H. (2021) · doi:10.31234/osf.io/bdrs7 · Cited by 15 · see citing works
Self-citationSo you want to do ESM? Ten Essential Topics for Implementing the Experience Sampling Method (ESM)Preprint
Fritz, J., Piccirillo, M. L., Cohen, Z. D., Frumkin, M. R., Kirtley, O. J., Moeller, J., Neubauer, A. B., Norris, L. A., Schuurman, N. K., Snippe, E., et al. (2023) · doi:10.31219/osf.io/fverx · Cited by 15 · see citing works
Self-citationRecent research on the interventions for people with dissociation
Fung, H. W., Ross, C. A., Lam, S. K. K., & Hung, S. L. (2022) · European Journal of Trauma & Dissociation · doi:10.1016/j.ejtd.2022.100299 · Cited by 16 · see citing works
Kunkels, Y. K., Smit, A. C., Minaeva, O., Snippe, E., George, S. V., van Roon, A. M., Wichers, M., & Riese, H. (2023) · Clinical Psychological Science · doi:10.1177/21677026221148101 · Cited by 13 · see citing works
Self-citationTanious, R., & Manolov, R. (2022) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2022.2035774 · Cited by 12 · see citing works
Bos, F. M. (2021) · doi:10.33612/diss.177817937 · Cited by 11 · see citing works
Koning, A.-S. C. A. M., Booij, S. H., Meijer, O. C., Riese, H., & Giltay, E. J. (2023) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2023.106394 · Cited by 9 · see citing works
Self-citationDepression in Fibromyalgia Patients May Require Low-Dose Naltrexone to Respond: A Case Report
Siembida, J., & Johnson, B. (2022) · Cureus · doi:10.7759/cureus.22677 · Cited by 8 · see citing works
Zuidersma, M., Müller, F., Snippe, E., Zuidema, S. U., & Voshaar, R. C. O. (2022) · Aging & Mental Health · doi:10.1080/13607863.2022.2102143 · Cited by 7 · see citing works
Self-citationTieks, A., Voshaar, R. C. O., & Zuidersma, M. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-02797-y · Cited by 7 · see citing works
Self-citationSharaa, H. A., Bartels, S. L., Taygar, A. S., Engman, L., Petersson, S., Flink, I. K., Boersma, K., McCracken, L. M., Simons, L. E., Vlaeyen, J. W. S., et al. (2025) · European Journal of Pain · doi:10.1002/ejp.70128 · Cited by 6 · see citing works
Cognitive profiles across the psychosis continuum
Kristensen, T. D., Mager, F. M., Ambrosen, K. S., Barber, A. D., Lemvigh, C. K., Bojesen, K. B., Nielsen, M. Ø., Fagerlund, B., Glenthoj, B. Y., Syeda, W. T., et al. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116168 · Cited by 5 · see citing works
Robertz, A., Törnhage, C.-J., Nilsson, S., Nyman, V., & Kantzer, A.-K. (2024) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2024.101909 · Cited by 5 · see citing works
Analyzing data in single-case experimental designs: Objectives and available software options
Manolov, R., & Rochat, L. (2024) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2024.100511 · Cited by 5 · see citing works
Minaeva, O., Schat, E., Ceulemans, E., Kunkels, Y., Smit, A., Wichers, M., Booij, S., & Riese, H. (2024) · Scientific Reports · doi:10.1038/s41598-023-50960-1 · Cited by 9 · see citing works
Self-citationKhakbaz, H., Khanjani, M. S., Younesi, S. J., Ardakani, M. R. K., Safi, M. H., & Hosseinzadeh, S. (2023) · فصلنامه علمی پژوهشی توانبخشی · doi:10.32598/rj.24.1.1450.3 · Cited by 4 · see citing works
boroujeni, M. K., Karimi, M. T., Sharifmoradi, K., & Aghdam, H. A. (2023) · فصلنامه علمی پژوهشی توانبخشی · doi:10.32598/rj.24.1.3482.1 · Cited by 3 · see citing works
Steenhuis, L., Harms, T., Nauta, M., Bartels-Velthuis, A., Albers, C. J., Aleman, A., Vos, M., Pijnenborg, G., van den Berg, D. V. D., Palstra, E., et al. (2023) · Schizophrenia Research · doi:10.1016/j.schres.2023.10.012 · Cited by 3 · see citing works
Self-citationSutadi, R., Arneliza, A., & Miranda, C. (2022) · Journal of Psychology and Behavior Studies · doi:10.32996/jpbs.2022.2.1.8 · Cited by 3 · see citing works
Treatment Slow Learner Learning Repetitive Addition with Realistic Mathematics Learning Approach
Hafidah, H., & Rukli, R. (2022) · Mimbar Sekolah Dasar · doi:10.53400/mimbar-sd.v9i3.48586 · Cited by 3 · see citing works
Khakbaz, H., Khanjani, M. S., Younesi, J., Ardakani, M. R. K., Safi, M. H., & Hosseinzadeh, S. (2022) · Iranian Journal of Psychiatry and Behavioral Sciences · doi:10.5812/ijpbs-127419 · Cited by 3 · see citing works
Bos, F. M., Schreuder, M. J., George, S. V., Doornbos, B., Bruggeman, R., van der Krieke, L., Haarman, B. C. M., Wichers, M., & Snippe, E. (2021) · doi:10.31234/osf.io/v5b7t · Cited by 3 · see citing works
Self-citationKaijadoe, S. P. T., Nijhof, K. S., Klip, H., Popma, A., & Scholte, R. H. J. (2024) · International Journal of Qualitative Studies on Health and Well-Being · doi:10.1080/17482631.2024.2409514 · Cited by 2 · see citing works
The use of Experience Sampling Method in psychopharmacological studies: A systematic review
Quadackers, D. M. C., Bos, F. M., Hovenkamp-Hermelink, J., Cath, D. C., & Riese, H. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116327 · Cited by 2 · see citing works
Self-citationHow far are N-of-1 studies suitable evaluation designs in forensic psychiatric sports therapy?
Reimer, V., & Kanning, M. K. (2023) · Sports Psychiatry · doi:10.1024/2674-0052/a000049 · Cited by 2 · see citing works
Besten, M. E., van Vugt, M. K., Riese, H., Bockting, C., Ostafin, B. D., Aleman, A., & van Tol, M. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-05592-8 · Cited by 2 · see citing works
Self-citationSivrikaya, T., & Aygül, N. (2026) · Journal of Special Education Technology · doi:10.1177/01626434251414866 · Cited by 1 · see citing works
Shi, S., Fisher, A. J., Rabinowitz, A. R., & Silverberg, N. D. (2026) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617726101854 · Cited by 1 · see citing works
Fingerhut, J. E., Moeyaert, M., Manolov, R., Xu, X., & Park, K.-H. (2023) · Behavior Modification · doi:10.1177/01454455231178469 · Cited by 1 · see citing works
Should we compromise on n-of-1 data analyses?
Batley, P. N. (2024) · BJPsych Advances · doi:10.1192/bja.2023.65 · Cited by 1 · see citing works
Advances in ESM-Derived Feedback Integrated into Psychotherapy
Hall, M., Servaas, M. N., & Riese, H. (2025) · CBT: science into practice · doi:10.1007/978-3-031-90428-8_8 · Cited by 1 · see citing works
Self-citationWall, J. T., Xie, H., & Wang, X. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14020127
Núñez, D. E., de Almeida, E. R., Smit, A. C., Snippe, E., Muller, M. K., van den Berg, D. P. G., Wang, Y., Veling, W., Booij, S. H., & Wigman, J. T. W. (2025) · Psychiatry Research Case Reports · doi:10.1016/j.psycr.2025.100251
Self-citationIntegrating Personalized Ambulatory Assessments into Routine Mental Health Care (Preprint)Preprint
Riese, H., Schiepek, G. K., & Servaas, M. N. (2025) · doi:10.2196/preprints.79578
Self-citationMultidisciplinary perspectives on personalised prevention in youth mental health
Löchner, J., Bolivar, M., Booth, L., Canella, S., Calobro, M., Firth, J., García‐Palacios, A., Kyritsaka, A., Sander, L., Seiferth, C., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1568472
Tieks, A., Voshaar, R. C. O., & Zuidersma, M. (2022) · Figshare · doi:10.6084/m9.figshare.19194216
Self-citationBesten, M. E., van Vugt, M. K., Riese, H., Bockting, C., Ostafin, B. D., Aleman, A., & van Tol, M.-J. (2024) · Figshare · doi:10.6084/m9.figshare.26682802
Self-citationBos, F. M., Schreuder, M. J., George, S. V., Doornbos, B., Bruggeman, R., van der Krieke, L., Haarman, B. C. M., Wichers, M., & Snippe, E. (2022) · Figshare · doi:10.6084/m9.figshare.19568752
Self-citationKruisinga, S., Matthijssen, S. J. M. A., & Zuidersma, M. (2026) · European Journal of Psychotraumatology · doi:10.1080/20008066.2026.2702141
Self-citationJournal writing for enhancing career adaptability in vocational students: a clinical case study
Jalil, M. K., Ramli, M., Atmoko, A., & Hambali, I. (2026) · Journal of Poetry Therapy · doi:10.1080/08893675.2026.2725157
Matsuda, S., Karasawa, H., & Sugawara, D. (2026) · Single Case in the Social Sciences · doi:10.15763/issn.1936-9298.2026.3.1.56-67
Hilty, D. M., ELNahas, G., Mphil, S. J., Mucić, D., Vukojević, J., Halbreich, U. M., Riese, H., Gentry, M. T., Gkouvas, N., Gaur, V., et al. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00708-1
Self-citationHilty, D. M., Mucić, D., ElNahas, G. M., Gkouvas, N., Joshi, S., Gaur, V., Kyriazakis, V., Vukojević, J., da Costa, M. P., Riese, H., et al. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00709-0
Self-citation
- Authors
- Zuidersma, M., Riese, H., Snippe, E., Booij, S. H., Wichers, M., & Bos, E. H.
- Affiliations
- University Medical Center Groningen (NL)
- University of Groningen (NL)
- Corresponding author
- Zuidersma, Marij
- ORCID
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2020-11-13
- Volume
- 11
- Pages
- 539777-539777
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC7691231
- OpenAlex
- W3100352076
- Cited by
- 54
- References
- 118
- Citations by year
- 2026: 7 · 2025: 5 · 2024: 11 · 2023: 9 · 2022: 17 · 2021: 5
- FWCI
- 1.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (acceptedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Funders
- European Research Council
- Stichting tot Steun Vereniging tot Christelijke Verzorging van Geestes- en Zenuwzieken
- Innovatiefonds Zorgverzekeraars
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- single-case experimental design, personalized treatment, personalized medicine, individual differences, personalized prediction, psychiatric diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
