The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue.
Abstract
In recent years, single-case designs have increasingly been used to establish an empirical basis for evidence-based interventions and techniques in a variety of disciplines, including psychology and education. Although traditional single-case designs have typically not met the criteria for a randomized controlled trial relative to conventional multiple-participant experimental designs, there are procedures that can be adopted to create a randomized experiment in this class of experimental design. Our two major purposes in writing this article were (a) to review the various types of single-case design that have been and can be used in psychological and educational intervention research and (b) to incorporate randomized experimental schemes into these designs, thereby improving them so that investigators can draw more valid conclusions from their research. For each traditional single-case design type reviewed, we provide illustrations of how various forms of randomization can be introduced into the basic design structure. We conclude by recommending that traditional single-case intervention designs be transformed into more scientifically credible randomized single-case intervention designs whenever the research conditions under consideration permit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 3,984
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368
Wolf, M. M. (1978) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1978.11-203 · Cited by 3,176
Single Case Experimental Designs: Strategies for Studying Behavior Change
Barlow, D. H., Nock, M. K., & Hersen, M. (1976) · Cited by 3,036
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Edgington, E. S. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2169 · Cited by 2,028
Scientific Research in Education
(2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,723
Assessing the Clinical or Applied Importance of Behavior Change through Social Validation
Kazdin, A. E. (1977) · Behavior Modification · doi:10.1177/014544557714001 · Cited by 1,117
Evidence-Based Education Policies: Transforming Educational Practice and Research
Slavin, R. E. (2002) · Educational Researcher · doi:10.3102/0013189x031007015 · Cited by 1,104
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975
Experimental design: Procedures for the behavioral sciences (3rd ed.).
Kirk, R. E. (1995) · Cited by 787
Barlow, D. H., & Hayes, S. C. (1979) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1979.12-199 · Cited by 652
The External Validity of Experiments
Bracht, G. H., & Glass, G. V. (1968) · American Educational Research Journal · doi:10.2307/1161993 · Cited by 602
Single-case research design and analysis : new directions for psychology and education
Kratochwill, T. R., & Levin, J. R. (1992) · Routledge eBooks · Cited by 576
Self-citationThe Scientist Practitioner: Research and Accountability in the Age of Managed Care
Hayes, S. C., Barlow, D. H., & Nelson‐Gray, R. O. (1999) · DigitalGeorgetown (Georgetown University Library) · Cited by 417
Single Subject Research: Strategies for Evaluating Change
Kratochwill, T. R. (1978) · Cited by 411
Self-citationBorckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D., & O'Neil, P. (2008) · American Psychologist · doi:10.1037/0003-066x.63.2.77 · Cited by 407
Evidence matters: randomized trials in education research
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3545 · Cited by 372
Fisher, W. W., Kelley, M. E., & Lomas, J. E. (2003) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2003.36-387 · Cited by 351
Single-case and Small-n Experimental Designs: A Practical Guide To Randomization Tests
Todman, J. B., & Dugard, P. (2001) · Psychology Press eBooks · doi:10.4324/9781410600943 · Cited by 244
Design and Analysis of Single-Case Research
(2014) · Psychology Press eBooks · doi:10.4324/9781315806402 · Cited by 243
Representative and Quasi-Representative Designs for Research on Teaching
Snow, R. E. (1974) · Review of Educational Research · doi:10.2307/1169976 · Cited by 214
Baldwin, S. A., Murray, D. M., & Shadish, W. R. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.924 · Cited by 209
Single case experimental design and empirical clinical practice.
Hayes, S. C. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.49.2.193 · Cited by 203
Customization of Pain Treatments: Single-Case Design and Analysis
Onghena, P., & Edgington, E. S. (2005) · The Clinical Journal of Pain · doi:10.1097/00002508-200501000-00007 · Cited by 188
Preparing psychologists for evidence-based school practice: Lessons learned and challenges ahead.
Kratochwill, T. R. (2007) · American Psychologist · doi:10.1037/0003-066x.62.8.829 · Cited by 147
Self-citationCognitive Learning and Memory in Children
Pressley, M. G., & Brainerd, C. J. (1985) · Springer series in cognitive development · doi:10.1007/978-1-4613-9544-7 · Cited by 136
Max, L., & Onghena, P. (1999) · Journal of Speech Language and Hearing Research · doi:10.1044/jslhr.4202.261 · Cited by 135
Assessment for intervention: a problem-solving approach
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3499 · Cited by 129
ESTABLISHING A GENERALIZED REPERTOIRE OF HELPING BEHAVIOR IN CHILDREN WITH AUTISM
Reeve, S. A., Reeve, K. F., Townsend, D. B., & Poulson, C. L. (2007) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2007.11-05 · Cited by 118
Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design.
Koehler, M. J., & Levin, J. R. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.2.206 · Cited by 117
Self-citationRandomization Tests for One-Subject Operant Experiments
Edgington, E. S. (1975) · The Journal of Psychology · doi:10.1080/00223980.1975.9923926 · Cited by 102
Evidence-based treatments: challenges and priorities for practice and research
Kazdin, A. E. (2004) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.04.002 · Cited by 98
N = Nonparametric Randomization Tests
Levin, J. R., Marascuilo, L. A., & Hubert, L. J. (1978) · Elsevier eBooks · doi:10.1016/b978-0-12-425850-1.50010-7 · Cited by 94
Self-citationRandomization tests for multiple-baseline designs.
Wampold, B. E., & Worsham, N. L. (1986) · Behavioral Assessment · Cited by 93
Fisher, W. W., Kodak, T. M., & Moore, J. W. (2007) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2007.40-489 · Cited by 86
The simultaneous-treatment design
Kazdin, A. E., & Hartmann, D. P. (1978) · Behavior Therapy · doi:10.1016/s0005-7894(78)80023-9 · Cited by 84
Onghena, P. (1992) · Lirias (KU Leuven) · Cited by 82
Empirical Methods for Evaluating Educational Interventions
(2005) · Elsevier eBooks · doi:10.1016/b978-0-12-554257-9.x5000-1 · Cited by 79
ENHANCING EARLY COMMUNICATION THROUGH INFANT SIGN TRAINING
Thompson, R. H., Cotnoir‐Bichelman, N. M., McKerchar, P. M., Tate, T. L., & Dancho, K. A. (2007) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2007.23-06 · Cited by 74
Levin, J. R. (1997) · Psychology and Aging · doi:10.1037//0882-7974.12.1.84 · Cited by 69
Self-citationWhat To Do About Educational Research’s Credibility Gaps?
Levin, J. R., & Donnell, A. O. (2000) · Journal of Cognitive Education and Psychology · doi:10.1891/194589500787383571 · Cited by 66
Self-citationCrafting educational intervention research that's both credible and creditable
Levin, J. R. (1994) · Educational Psychology Review · doi:10.1007/bf02213185 · Cited by 62
Self-citationGeneralized single-case randomization tests: Flexible analyses for a variety of situations.
Levin, J. R., & Wampold, B. E. (1999) · School Psychology Quarterly · doi:10.1037/h0088998 · Cited by 55
Self-citationEducational/Psychological Intervention Research
Levin, J. R., O’Donnell, A. M., & Kratochwill, T. R. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei0722 · Cited by 45
Self-citationNonparametric tests for single-case experiments.
Edgington, E. S. (2015) · doi:10.4324/9781315725994-12 · Cited by 45
Lall, V. F., & Levin, J. R. (2003) · Journal of School Psychology · doi:10.1016/j.jsp.2003.11.002 · Cited by 44
Self-citationSome Methodological and Statistical “Bugs” in Research on Children’s Learning
Levin, J. R. (1985) · Springer series in cognitive development · doi:10.1007/978-1-4613-9544-7_7 · Cited by 44
Self-citationThe principle of parallelism in the design of studies to estimate treatment effects.
Reichardt, C. S. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.1.1 · Cited by 40
A DIAGNOSTIC APPROACH TO INCREASE REUSABLE DINNERWARE SELECTION IN A CAFETERIA
Manuel, J. C., Sunseri, M. A., Olson, R., & Scolari, M. (2007) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2007.143-05 · Cited by 30
Randomized Classroom Trials on Trial
Levin, J. R. (2005) · Elsevier eBooks · doi:10.1016/b978-012554257-9/50002-4 · Cited by 21
Self-citationConducting Science-Based Psychology Research in Schools
Dinella, L. M. (2009) · Cited by 15
Cited by
Single-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331
Self-citationSingle-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630
“…2010; Westen & Bradley, 2005; Westen, Novotny, & Thompson-Brenner, 2004) has renewed researchers’ interest in SCEDs as a means to assess intervention outcomes (e.g., Borckardt et al., 2008; Dattilio, Edwards, & Fishman, 2010; Horner et al., 2005; Kratochwill, 2007; Kratochwill & Levin, 2010).”
BackgroundMethodInfluentialKrasny-Pacini, A., & Evans, J. (2018) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2017.12.002 · Cited by 373
Tate, R. L., Perdices, M., Rosenkoetter, U., Wakim, D., Godbee, K., Togher, L., & McDonald, S. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.824383 · Cited by 358
Single-Subject Experimental Design for Evidence-Based Practice
Byiers, B. J., Reichle, J., & Symons, F. J. (2012) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2012/11-0036 · Cited by 338
Metadata
- Authors
- Kratochwill, T. R., & Levin, J. R.
- Venue
- Psychological Methods
- Published
- 2010
- Volume
- 15
- Issue
- 2
- Pages
- 124-144
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2001189516
- Cited by
- 494
- References
- 58
- FWCI
- 74.45
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.