Single-case experimental designs: Reflections on conduct and analysis
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
In this editorial discussion we reflect on the issues addressed by, and arising from, the papers in this special issue on Single-Case Experimental Design (SCED) study methodology. We identify areas of consensus and disagreement regarding the conduct and analysis of SCED studies. Despite the long history of application of SCEDs in studies of interventions in clinical and educational settings, the field is still developing. There is an emerging consensus on methodological quality criteria for many aspects of SCEDs, but disagreement on what are the most appropriate methods of SCED data analysis. Our aim is to stimulate this ongoing debate and highlight issues requiring further attention from applied researchers and methodologists. In addition we offer tentative criteria to support decision-making in relation to the selection of analytical techniques in SCED studies. Finally, we stress that large-scale interdisciplinary collaborations, such as the current Special Issue, are necessary if SCEDs are going to play a significant role in the development of the evidence base for clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368 · cited 1×
“Demonstrating experimental control requires that the design offers sufficient opportunities to explore whether the change in condition is associated with a change in the behaviour of interest (Horner et al., 2005; Kratochwill et al., 2010).”
BackgroundStatistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
Combining nonoverlap and trend for single-case research: Tau-U
Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011) · Behavior Therapy · doi:10.1016/j.beth.2010.08.006 · Cited by 1,468
Single-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331
Comparing an Individual's Test Score Against Norms Derived from Small Samples
Crawford, J. R., & Howell, D. C. (1998) · The Clinical Neuropsychologist · doi:10.1076/clin.12.4.482.7241 · Cited by 1,264 · cited 1×
“…but not covered here, are the ones focused on a case-controls design (i.e., the comparison of an individual, measured in a single point in time, to a small, well-matched, control sample representing normative behavioural levels; Crawford & Garthwaite, 2012; Crawford & Howell, 1998).”
BackgroundAn improved effect size for single-case research: nonoverlap of all pairs.
Parker, R. I., & Vannest, K. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.10.006 · Cited by 1,126 · cited 3×
“A related challenge is how to compare intervention effects quantified with different primary indicators—for instance, a standardised mean difference arising from generalised least squares regression (Maggin et al., 2011) and the nonoverlap of all pairs (Parker & Vannest, 2009).”
BackgroundMethodSingle-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630 · cited 9×
“Second, the most appropriate design should be identified (see Kratochwill et al., 2010; Smith, 2012).”
BackgroundMethodInfluentialA probability-based measure of effect size: Robustness to base rates and other factors.
Ruscio, J. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.1.19 · Cited by 398
Research Synthesis and Meta-Analysis
Cooper, H., Patall, E., & Lindsay, J. (2009) · The SAGE Handbook of Applied Social Research Methods · doi:10.4135/9781483348858.n11 · Cited by 397
Tate, R. L., Perdices, M., Rosenkoetter, U., Wakim, D., Godbee, K., Togher, L., & McDonald, S. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.824383 · Cited by 358 · cited 12×
“, 2013) and measures of methodological robustness (Tate et al., 2013) has raised the bar on what constitutes methodological rigour in a SCED study.”
BackgroundMethodInfluentialSelf-citationMatyas, T. A., & Greenwood, K. M. (1990) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1990.23-341 · Cited by 222
Review: single-subject clinical-outcome research: designs, data, effect sizes, and analyses
ROBEY, R. R., SCHULTZ, M. C., CRAWFORD, A. B., & SINNER, C. A. (1999) · Aphasiology · doi:10.1080/026870399402028 · Cited by 194
Bottom-up analysis of single-case research designs
Parker, R. I., & Vannest, K. J. (2012) · Journal of Behavioral Education · doi:10.1007/s10864-012-9153-1 · Cited by 117
Analysis of single-case data: Randomisation tests for measures of effect size
Heyvaert, M., & Onghena, P. (2014) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.818564 · Cited by 64
Cited by
Krasny-Pacini, A., & Evans, J. (2018) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2017.12.002 · Cited by 373
Self-citationTate, R. L., Perdices, M., Rosenkoetter, U., McDonald, S., Togher, L., Shadish, W., Horner, R., Kratochwill, T., Barlow, D. H., Kazdin, A., et al. (2016) · Archives of Scientific Psychology · doi:10.1037/arc0000027 · Cited by 219
Self-citationMcDonald, S., Quinn, F., Vieira, R., O’Brien, N., White, M., Johnston, D. W., & Sniehotta, F. F. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1316672 · Cited by 200
A Priori Justification for Effect Measures in Single-Case Experimental Designs
Manolov, R., Moeyaert, M., & Fingerhut, J. E. (2022) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00282-2 · Cited by 53
“Another facet to take into consideration is the kind of summary statistics desired (e.g., whether to express it in standardized or raw units; Manolov et al., 2014).”
BackgroundSelf-citationMcDonald, S., Vieira, R., & Johnston, D. W. (2020) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2019.1711096 · Cited by 43
Metadata
- Authors
- Manolov, R., Gast, D. L., Perdices, M., & Evans, J. J.
- Venue
- Neuropsychological Rehabilitation
- Publisher
- Informa UK Limited
- Published
- 2014-04-29
- Volume
- 24
- Issue
- 3-4
- Pages
- 634-660
- ISSN
- 0960-2011 (ISSN-L)
- 1464-0694
- OpenAlex
- W2046196349
- Cited by
- 80
- References
- 16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.