The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
The Improvement Rate Difference for Single-Case Research
Abstract
This article describes and field-tests the improvement rate difference (IRD), a new effect size for summarizing single-case research data. Termed “risk difference” in medical research, IRD expresses the difference in successful performance between baseline and intervention phases. IRD can be calculated from visual analysis of nonoverlapping data, and is easily explained to most educators. IRD entails few data assumptions and has confidence intervals. The article applies IRD to 166 published data series, correlates results with three other effect sizes: R 2, Kruskal-Wallis W, and percent of nonoverlapping data (PND), and reports interrater reliability of the IRD hand scoring. The major finding is that IRD is a promising effect size for single-case research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
SOME CURRENT DIMENSIONS OF APPLIED BEHAVIOR ANALYSIS1
Baer, D. M., Wolf, M. M., & Risley, T. R. (1968) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1968.1-91 · Cited by 3,935
Skinner, B. F. (1938) · Cited by 3,571
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368 · cited 3×
“Guidelines for single-case research are being strengthened by such fields as school psychology (Kratochwill & Stoiber, 2002); special education (Horner et al., 2005); and clinical psychology (Chambless & Ollendick, 2001).”
MethodStatistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
(2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n175 · Cited by 2,556
Graphical Methods for Data Analysis.
Healy, M. J. R., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981587 · Cited by 2,315
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Graphical Methods for Data Analysis.
Fisher, N. I., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Biometrics · doi:10.2307/2531418 · Cited by 1,982
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 5×
“The statistical summary with fastest rising popularity across research models is the magnitude of effect or effect size index (Kirk, 1996; Thompson, 2002a; Wilkinson & The Task Force on Statistical Inference, TFSI, 1999).”
BackgroundMethodInfluentialPublication Manual of the American Psychological Association: BOOK REVIEW
Yao, R. (2011) · Family and Consumer Sciences Research Journal · doi:10.1111/j.1552-3934.2011.02081.x · Cited by 1,451
Meta-Analysis: Quantitative Methods for Research Synthesis
Rosenthal, R., & Wolf, F. M. (1987) · Contemporary Sociology · doi:10.2307/2071646 · Cited by 1,371
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294
The Quantitative Synthesis of Single-Subject Research: Methodology and Validation
Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987) · Remedial and Special Education · doi:10.1177/074193258700800206 · Cited by 969
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854
Wolf, F. (1986) · doi:10.4135/9781412984980 · Cited by 784
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
Forest plots: trying to see the wood and the trees
Lewis, S., & Clarke, M. (2001) · BMJ · doi:10.1136/bmj.322.7300.1479 · Cited by 763
Handbook of research on social studies teaching and learning
(1991) · Choice Reviews Online · doi:10.5860/choice.29-0441 · Cited by 667
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
Single-case research design and analysis : new directions for psychology and education
Kratochwill, T. R., & Levin, J. R. (1992) · Routledge eBooks · Cited by 576
Complementary methods for research in education
Winne, P. H. (1989) · Teaching and Teacher Education · doi:10.1016/0742-051x(89)90032-2 · Cited by 544
Thompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 538
Social Science Research and Decision-Making.
Conklin, G. H., Weiss, C. H., & Bucuvalas, M. J. (1982) · Social Forces · doi:10.2307/2578408 · Cited by 532
Evidence Based Medicine—How to Practice and Teach EBM
Jones, K. (1996) · BMJ · doi:10.1136/bmj.313.7069.1410 · Cited by 525
M., D. W., & Cleveland, W. S. (1986) · The American Journal of Psychology · doi:10.2307/1422498 · Cited by 434
Thompson, B. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00167.x · Cited by 398 · cited 2×
“Practical significance is achieved when behavior change has a practical impact on the client’s daily life (Shaver, 1991; Thompson, 2002b), and the more demanding clinical significance is change from a dysfunctional to functional range of activity (Jacobson, Follette, & Revenstorf, 1984).”
BackgroundPercentage of All Non-Overlapping Data (PAND): An Alternative to PND
Parker, R. I., Hagan-Burke, S., & Vannest, K. (2007) · The Journal of Special Education · doi:10.1177/00224669070400040101 · Cited by 395
Self-citationMa, H.-H. (2006) · Behavior Modification · doi:10.1177/0145445504272974 · Cited by 370
The Analysis and Presentation of Graphic Data
PARSONSON, B. S., & BAER, D. M. (1978) · Single Subject Research · doi:10.1016/b978-0-12-425850-1.50009-0 · Cited by 301
Design and analysis of single-case research
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1208 · Cited by 297
Kratochwill, T. R., & Stoiber, K. C. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.4.341.20872 · Cited by 288
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Boik, R. J. (2001) · Journal of the American Statistical Association · doi:10.1198/jasa.2001.s432 · Cited by 257
Calculating effect sizes for meta-analysis: The case of the single case∗
Allison, D. B., & Gorman, B. S. (1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90115-b · Cited by 244
Fee, V. E. (1989) · Research in Developmental Disabilities · doi:10.1016/0891-4222(89)90009-7 · Cited by 225
Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006) · Behavior Modification · doi:10.1177/0145445503261167 · Cited by 217
Self-citationEvaluating single-case research data: A comparison of seven statistical methods
Parker, R. I., & Brossart, D. F. (2003) · Behavior Therapy · doi:10.1016/s0005-7894(03)80013-8 · Cited by 168
Self-citationComputer Programs for Epidemiologists: Pepi Version 4.0
Gahlinger, P. M., & Abrahamson, J. (2001) · Cited by 158
Reporting of precision of estimates for diagnostic accuracy: a review
Harper, R. A., & Reeves, B. C. (1999) · BMJ · doi:10.1136/bmj.318.7194.1322 · Cited by 147
Effect Sizes in Single Case Research: How Large is Large?
Parker, R. I., Brossart, D. F., Vannest, K. J., Long, J. R., De-Alba, R. G., Baugh, F. G., & Sullivan, J. R. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12086279 · Cited by 142
Self-citationLee, R. D., McComas, J. J., & Jawor, J. (2002) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2002.35-391 · Cited by 140
Coleman, D. E., & Cleveland, W. (1987) · Technometrics · doi:10.1080/00401706.1987.10488193 · Cited by 132
Kratochwill, T. R., & Brody, G. H. (1978) · Behavior Modification · doi:10.1177/014544557823001 · Cited by 127
Visual Inspection and Statistical Analysis in Single-Case Designs
Park, H. S., Marascuilo, L. A., & Gaylord‐Ross, R. (1990) · The Journal of Experimental Education · doi:10.1080/00220973.1990.10806545 · Cited by 115
Special Education and Related Services: What Have We Learned From Meta-Analysis?
Forness, S. R. (2001) · Exceptionality · doi:10.1207/s15327035ex0904_3 · Cited by 113
Applications of meta analysis in individual-subject research.
White, D. M., Rusch, F. R., Kazdin, A. E., & Hartmann, D. P. (1989) · Behavioral Assessment · Cited by 83
Controlling baseline trend in single-case research.
Parker, R. I., Cryer, J., & Byrns, G. (2006) · School Psychology Quarterly · doi:10.1037/h0084131 · Cited by 82
Self-citationVisual inspection of single-subject data: an empirical analysis.
Ottenbacher, K. J. (1990) · PubMed · Cited by 78
Petrosino, A. J., Boruch, R. F., Rounding, C., McDonald, S. J., & Chalmers, I. (2000) · Evaluation & Research in Education · doi:10.1080/09500790008666973 · Cited by 72
Dyer, K. D. (2013) · Springer eBooks · doi:10.1007/978-1-4419-1698-3_1004 · Cited by 69
Median-Based Overlap Analysis for Single Case Data: A Second Study
Parker, R. I., & Hagan–Burke, S. (2007) · Behavior Modification · doi:10.1177/0145445507303452 · Cited by 65
Self-citationInterrater Reliability of Therapists' Judgments of Graphed Data
Harbst, K., Ottenbacher, K. J., & Harris, S. R. (1991) · Physical Therapy · doi:10.1093/ptj/71.2.107 · Cited by 58
Wolf, F. M. (2000) · Medical Teacher · doi:10.1080/01421590050006214 · Cited by 53
Increased Reliability for Single-Case Research Results: Is the Bootstrap the Answer?
Parker, R. I. (2006) · Behavior Therapy · doi:10.1016/j.beth.2006.01.007 · Cited by 43
Self-citationStrube, M., Gardner, W. P., & Hartmann, D. P. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90030-3 · Cited by 38
Making Statistics More Meaningful for Policy Research and Program Evaluation
May, H. (2004) · American Journal of Evaluation · doi:10.1177/109821400402500408 · Cited by 35
Phase contrasts for multiphase single case intervention designs.
Parker, R. I., & Brossart, D. F. (2006) · School Psychology Quarterly · doi:10.1521/scpq.2006.21.1.46 · Cited by 31
Self-citationStatistical Analysis and Single-Subject Designs
Huitema, B. E. (1986) · Springer eBooks · doi:10.1007/978-1-4684-8786-2_10 · Cited by 27
Mostert, M. P. (2001) · Exceptionality · doi:10.1207/s15327035ex0904_4 · Cited by 20
Evaluating evidence-based interventions in school psychology.
Durlak, J. A. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.4.475.20873 · Cited by 13
Cited by
Combining nonoverlap and trend for single-case research: Tau-U
Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011) · Behavior Therapy · doi:10.1016/j.beth.2010.08.006 · Cited by 1,468
Self-citationAn improved effect size for single-case research: nonoverlap of all pairs.
Parker, R. I., & Vannest, K. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.10.006 · Cited by 1,126
Self-citationEffect Size in Single-Case Research: A Review of Nine Nonoverlap Techniques
Parker, R. I., Vannest, K. J., & Davis, J. L. (2011) · Behavior Modification · doi:10.1177/0145445511399147 · Cited by 841
Self-citationEvaluating Intervention Effects in Single‐Case Research Designs
Vannest, K. J., & Ninci, J. (2015) · Journal of Counseling & Development · doi:10.1002/jcad.12038 · Cited by 665
Self-citationEvidence-Based Practices in Secondary Transition
Test, D. W., Fowler, C. H., Richter, S. M., White, J., Mazzotti, V., Walker, A. R., Kohler, P., & Kortering, L. (2009) · Career Development for Exceptional Individuals · doi:10.1177/0885728809336859 · Cited by 392
Metadata
- Authors
- Parker, R. I., Vannest, K. J., & Brown, L.
- Venue
- Exceptional Children
- Publisher
- SAGE Publications
- Published
- 2009-01
- Volume
- 75
- Issue
- 2
- Pages
- 135-150
- ISSN
- 0014-4029 (ISSN-L)
- 2163-5560
- OpenAlex
- W2144016059
- Cited by
- 406
- References
- 65
- FWCI
- 36.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.