Real-time monitoring technology in single-case experimental design research: opportunities and challenges
Abstract
Single-case experimental design (SCED) is a rigorous method of studying behavior and behavior change. A key characteristic of SCED is repeated, systematic assessment of outcome variables, which is critical to achieving high internal validity, collecting a sufficient number of observations to conduct adequately powered statistical analyses, capturing dynamic and fine-grained changes in outcomes, and tailoring interventions at the individual level. Recent advances in real-time monitoring technology, such as digital ecological momentary assessment, passive smartphone-based behavioral tracking, and physiological assessment with wearable biosensors, are extremely well-suited to conducting these repeated, systematic measurements. Here, we discuss the rationale for incorporating real-time data collection technologies within SCED and highlight how recent studies have paired SCED with real-time monitoring. We also present original data illustrating how real-time digital monitoring can provide an idiographic and granular view of behavior (in this case, suicidal ideation). Last, we discuss the challenges of, and offer our recommendations for, using real-time monitoring technologies in SCED research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The extensive nature of EMA data allows for more opportunities for single-case data analysis that may be used to examine individual symptom profiles or identify person-specific triggers.
“The extensive nature of EMA data also allows for more opportunities for single-case data analysis that may be used to examine individual symptom profiles or identify person-specific triggers (118)”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [118]
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Diary Methods: Capturing Life as it is Lived
Bolger, N., Davis, A., & Rafaeli, E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145030 · Cited by 3,843 · see citing works
Prince, S. A., Adamo, K. B., Hamel, M., Hardt, J., Connor Gorber, S., & Tremblay, M. (2008) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-5-56 · Cited by 3,162 · see citing works
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 2,852 · see citing works
Single-case research designs: Methods for clinical and applied settings
Hayes, S. C. (1983) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(83)90018-6 · Cited by 2,677 · see citing works
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · see citing works
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232 · see citing works
Duration neglect in retrospective evaluations of affective episodes.
Fredrickson, B. L., & Kahneman, D. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.1.45 · Cited by 1,228 · see citing works
Self-monitoring in weight loss: a systematic review of the literature
Burke, L. E., Wang, J., & Sevick, M. A. (2011) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2010.10.008 · Cited by 1,203 · see citing works
Dennison, L., Morrison, L., Conway, G., & Yardley, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2583 · Cited by 895 · see citing works
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000273 · Cited by 831 · see citing works
Self-citationMcNabb, D. E. (2014) · Routledge eBooks · doi:10.4324/9781315705941-10 · Cited by 767 · see citing works
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758 · see citing works
Choi, K. W., Chen, C.-Y., Stein, M. B., Klimentidis, Y. C., Wang, M.-J., Koenen, K. C., Smoller, J. W., & Major Depressive Disorder Working Group of the Psychiatric Genomics Consortium (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4175 · Cited by 744 · see citing works
Nock, M. K., Prinstein, M. J., & Sterba, S. K. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016948 · Cited by 662 · see citing works
Self-citationSingle-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630 · see citing works
Hamaker, E. L., & Wichers, M. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721416666518 · Cited by 505 · see citing works
van de Water, A. T. M., HOLMES, A., & Hurley, D. A. (2010) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00814.x · Cited by 454 · see citing works
Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429 · see citing works
Critical Slowing Down as a Personalized Early Warning Signal for Depression
Wichers, M., Groot, P. C., & Psychosystems, E. G. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000441458 · Cited by 399 · see citing works
Exploring the idiographic dynamics of mood and anxiety via network analysis
Fisher, A. J., Reeves, J. W., Lawyer, G., Medaglia, J. D., & Rubel, J. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000311 · Cited by 385 · see citing works
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · see citing works
Torous, J. B., Onnela, J., & Keshavan, M. S. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.25 · Cited by 349 · see citing works
Stone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003) · Pain · doi:10.1016/s0304-3959(03)00040-x · Cited by 293 · see citing works
The Role of Ambulatory Assessment in Psychological Science
Trull, T. J., & Ebner-Priemer, U. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414550706 · Cited by 284 · see citing works
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · see citing works
Assessing Temporal Emotion Dynamics Using Networks
Bringmann, L. F., Pe, M. L., Vissers, N., Ceulemans, E., Borsboom, D., Vanpaemel, W., Tuerlinckx, F., & Kuppens, P. (2016) · Assessment · doi:10.1177/1073191116645909 · Cited by 235 · see citing works
van Os, J., Verhagen, S., Marsman, A., Peeters, F., Bak, M., Marcelis, M., Drukker, M., Reininghaus, U., Jacobs, N., Lataster, T., et al. (2017) · Depression and Anxiety · doi:10.1002/da.22647 · Cited by 230 · see citing works
Digital phenotyping of suicidal thoughts
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Picard, R. W., Huffman, J. C., & Nock, M. K. (2018) · Depression and Anxiety · doi:10.1002/da.22730 · Cited by 210 · see citing works
Self-citationReactive self-monitoring: The effects of response desirability, goal setting, and feedback.
Kazdin, A. E. (1974) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0037050 · Cited by 208 · see citing works
Enhancing the Personalization of Psychotherapy With Dynamic Assessment and Modeling
Fisher, A. J., & Boswell, J. F. (2016) · Assessment · doi:10.1177/1073191116638735 · Cited by 205 · see citing works
Single-participant research design: Bringing science to managed care.
Morgan, D. L., & Morgan, R. K. (2001) · American Psychologist · doi:10.1037/0003-066x.56.2.119 · Cited by 189 · see citing works
Runyan, J. D., Steenbergh, T. A., Bainbridge, C., Daugherty, D. A., Oke, L., & Fry, B. N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071325 · Cited by 179 · see citing works
Handbook of Research Methods in Abnormal and Clinical Psychology
Guha, M. (2008) · Reference Reviews · doi:10.1108/09504120810914349 · Cited by 153 · see citing works
Momentary assessment technology as a tool to help patients with depression help themselves
Wichers, M., Simons, C. J. P., Kramer, I., Hartmann, J., Menne‐Lothmann, C., Myin‐Germeys, I., van Bemmel, A. L., Peeters, F. P. M. L., Delespaul, P., & van Os, J. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01749.x · Cited by 150 · see citing works
Assessment of the Fitbit Charge 2 for monitoring heart rate
Benedetto, S., Caldato, C., Bazzan, E., Greenwood, D. C., Pensabene, V., & Actis, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0192691 · Cited by 149 · see citing works
Boonstra, T. W., Nicholas, J., Wong, Q. J. J., Shaw, F., Townsend, S., & Christensen, H. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10131 · Cited by 108 · see citing works
Dynamic networks of PTSD symptoms during conflict
Greene, T., Gelkopf, M., Epskamp, S., & Fried, E. I. (2018) · Psychological Medicine · doi:10.1017/s0033291718000351 · Cited by 106 · see citing works
Daskalova, N., Metaxa, D., Tran, A., Nugent, N. R., Boergers, J., McGeary, J. E., & Huang, J. J. S. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984534 · Cited by 89 · see citing works
Diaries in clinical psychology and psychotherapy: a selective review
Thiele, C., Laireiter, A., & Baumann, U. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.302 · Cited by 88 · see citing works
Less Is More: Psychologists Can Learn More by Studying Fewer People
Normand, M. P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00934 · Cited by 81 · see citing works
McCarthy, D. E., Minami, H., Yeh, V. M., & Bold, K. W. (2015) · Addiction · doi:10.1111/add.12996 · Cited by 76 · see citing works
Raiff, B. R., & Dallery, J. (2010) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2010.43-487 · Cited by 75 · see citing works
A WEB‐BASED CONTINGENCY MANAGEMENT PROGRAM WITH ADOLESCENT SMOKERS
Reynolds, B. A., Dallery, J., Shroff, P., Patak, M., & Leraas, K. (2008) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2008.41-597 · Cited by 70 · see citing works
Development and initial implementation of the Dynamic Assessment Treatment Algorithm (DATA)
Fernandez, K. C., Fisher, A. J., & Chi, C. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178806 · Cited by 68 · see citing works
Matteo, D. D., Fine, A., Fotinos, K., Rose, J., & Katzman, M. A. (2018) · JMIR Mental Health · doi:10.2196/mental.9539 · Cited by 68 · see citing works
The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016 statement.
Tate, R. L., Perdices, M., Rosenkoetter, U., Shadish, W., Vohra, S., Barlow, D. H., Horner, R., Kazdin, A., Kratochwill, T., McDonald, S., et al. (2016) · Archives of Scientific Psychology · doi:10.1037/arc0000026 · Cited by 66 · see citing works
Evaluating reactivity to ecological momentary assessment during smoking cessation.
Rowan, P. J., Cofta-Woerpel, L. M., Mazas, C. A., Vidrine, J. I., Reitzel, L. R., Cinciripini, P. M., & Wetter, D. W. (2007) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.15.4.382 · Cited by 65 · see citing works
Bentley, K. H., Nock, M., Sauer-Zavala, S., Gorman, B., & Barlow, D. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000205 · Cited by 65 · see citing works
Self-citationEcological Momentary Assessment and Alcohol Use Disorder Treatment
Morgenstern, J. (2014) · Alcohol research · doi:10.35946/arcr.v36.1.10 · Cited by 59 · see citing works
Testing self-regulation interventions to increase walking using factorial randomized N-of-1 trials.
Sniehotta, F. F., Presseau, J., Hobbs, N., & Araújo‐Soares, V. (2012) · Health Psychology · doi:10.1037/a0027337 · Cited by 57 · see citing works
Torous, J. B., Chan, S. R., Yellowlees, P., & BOLAND, R. J. (2016) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15com10619 · Cited by 51 · see citing works
The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016 Statement.
Tate, R., Perdices, M., Rosenkoetter, U., Shadish, W., Vohra, S., Barlow, D., Horner, R., Kazdin, A., Kratochwill, T., McDonald, S., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.006 · Cited by 46 · see citing works
Cushing, C. C., Jensen, C. D., & Steele, R. G. (2010) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsq074 · Cited by 42 · see citing works
Vilardaga, R., Bricker, J. B., & McDonell, M. G. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2014.03.003 · Cited by 37 · see citing works
Augmenting Visual Analysis in Single-Case Research With Hierarchical Linear Modeling
Davis, D. H., Gagné, P., Fredrick, L. D., Alberto, P. A., Waugh, R. E., & Haardörfer, R. (2012) · Behavior Modification · doi:10.1177/0145445512453734 · Cited by 34 · see citing works
van Ballegooijen, W., Ruwaard, J., Karyotaki, E., Ebert, D. D., Smit, J. H., & Riper, H. M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1065-5 · Cited by 32 · see citing works
Nyman, S. R., Goodwin, K., Kwaśnicka, D., & Callaway, A. J. (2015) · Psychology and Health · doi:10.1080/08870446.2015.1088014 · Cited by 28 · see citing works
Shingleton, R. M., Pratt, E. M., Gorman, B. S., Barlow, D. H., Palfai, T. P., & Thompson‐Brenner, H. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.01.005 · Cited by 27 · see citing works
Advances in Scientific Possibilities Offered by Real-Time Monitoring Technology
Kleiman, E. M., & Nock, M. K. (2017) · Psychiatry · doi:10.1080/00332747.2017.1325661 · Cited by 26 · see citing works
Self-citationQuantifyMe: An Open-Source Automated Single-Case Experimental Design Platform
Taylor, S., Sano, A., Ferguson, C., Mohan, A., & Picard, R. W. (2018) · Italian National Conference on Sensors · doi:10.3390/s18041097 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
McDonald, S., Vieira, R., & Johnston, D. W. (2020) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2019.1711096 · Cited by 43 · see citing works
Hayes, S. C., Hofmann, S. G., & Stanton, C. E. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.08.009 · Cited by 39 · see citing works
Smartphone psychology: New approaches towards safe and efficacious mobile mental health apps.
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020) · Professional Psychology: Research and Practice · doi:10.1037/pro0000278 · Cited by 25 · see citing works
- Authors
- Bentley, K. H., Kleiman, E. M., Elliott, G., Huffman, J. C., & Nock, M. K.
- Affiliations
- Harvard University (US)
- Corresponding author
- Bentley, Kate H.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 117
- Pages
- 87-96
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W2904036819
- Cited by
- 88
- References
- 61
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 9 · 2023: 15 · 2022: 26 · 2021: 10 · 2020: 12 · 2019: 2
- FWCI
- 7.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behaviour Research and Therapy (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Research Training Program in Biological and Social Psychiatry (T32MH016259)
- KHB
- Griswold Suicide Prevention Fund
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- single-case experimental design, real-time monitoring, wearable biosensors, physiological assessment, suicidal ideation, personalized interventions, idiographic research
- MeSH terms
- Wearable Electronic Devices, Single-Case Studies as Topic, Computer Systems, Humans, Monitoring, Ambulatory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
