A survey of publication practices of single-case design researchers when treatments have small or large effects.

Shadish, William R.; Zelinsky, Nicole A. M.; Vevea, Jack L.; Kratochwill, Thomas R.

doi:10.1002/jaba.308

Cited by 130Meta-analysis and systematic reviewsPsychology Research and BibliometricsBehavioral and Psychological Studies

A survey of publication practices of single-case design researchers when treatments have small or large effects.

Shadish, William R., Zelinsky, Nicole A. M., Vevea, Jack L., Kratochwill, Thomas R.·2016·Journal of Applied Behavior Analysis

DOI 10.1002/jaba.308

Open this paper in CoChat — free account

Abstract

The published literature often underrepresents studies that do not find evidence for a treatment effect; this is often called publication bias. Literature reviews that fail to include such studies may overestimate the size of an effect. Only a few studies have examined publication bias in single-case design (SCD) research, but those studies suggest that publication bias may occur. This study surveyed SCD researchers about publication preferences in response to simulated SCD results that show a range of small to large effects. Results suggest that SCD researchers are more likely to submit manuscripts that show large effects for publication and are more likely to recommend acceptance of manuscripts that show large effects when they act as a reviewer. A nontrivial minority of SCD researchers (4% to 15%) would drop 1 or 2 cases from the study if the effect size is small and then submit for publication. This article ends with a discussion of implications for publication practices in SCD research.

Integrity signals

Registry

Crossref · 10.1002/jaba.308

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Effect sizes found in SCED studies are usually higher than those found in group designs such as randomized controlled trials.
“the effect sizes found in SCED studies are usually higher than those found in group designs such as randomized controlled trials (Parker and Vannest, 2009; Shadish et al., 2016).”
From A Multiple-Baseline Evaluation of Acceptance and Commitment Therapy Focused on Repetitive Negative Thinking for Comorbid Generalized Anxiety Disorder and Depression (2020) · cites this paper as Shadish et al., 2016

Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · see citing works
nlme : Linear and nonlinear mixed effects models
DebRoy, S. (2006) · Medical Entomology and Zoology · Cited by 10,009 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368 · see citing works
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · see citing works
Single-case research designs: Methods for clinical and applied settings
Hayes, S. C. (1983) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(83)90018-6 · Cited by 2,677 · see citing works
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · see citing works
Empirical Evidence for Selective Reporting of Outcomes in Randomized Trials: Comparison of Protocols to Published Articles
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · see citing works
Combining nonoverlap and trend for single-case research: Tau-U
Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011) · Behavior Therapy · doi:10.1016/j.beth.2010.08.006 · Cited by 1,468 · see citing works
Single-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331 · see citing works
Untitled work
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · see citing works
An improved effect size for single-case research: nonoverlap of all pairs.
Parker, R. I., & Vannest, K. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.10.006 · Cited by 1,126 · see citing works
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079 · see citing works
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · see citing works
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013 · see citing works
Single-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630 · see citing works
A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · see citing works
The Trim and Fill Method
Duval, S. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch8 · Cited by 496 · see citing works
Visual analysis in single case experimental design studies: Brief review and guidelines
Lane, J. D., & Gast, D. L. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.815636 · Cited by 453 · see citing works
A general linear model for estimating effect size in the presence of publication bias
Vevea, J. L., & Hedges, L. (1995) · Psychometrika · doi:10.1007/bf02294384 · Cited by 367 · see citing works
CEC’s Standards for Classifying the Evidence Base of Practices in Special Education
Cook, B. G., Buysse, V., Klingner, J. K., Landrum, T. J., McWilliam, R. A., Tankersley, M., & Test, D. W. (2014) · Remedial and Special Education · doi:10.1177/0741932514557271 · Cited by 362 · see citing works
Characteristics of single-case designs used to assess intervention effects in 2008
Shadish, W. R., & Sullivan, K. J. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0111-y · Cited by 338 · see citing works
Single Case Experimental Designs: Strategies for Studying Behavior Change
Boyle, M. E. (1983) · Journal of Music Therapy · doi:10.1093/jmt/20.3.164 · Cited by 325 · see citing works
A standardized mean difference effect size for single case designs
Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1052 · Cited by 308 · see citing works
Evidence-based interventions in school psychology: Conceptual foundations of the Procedural and Coding Manual of Division 16 and the Society for the Study of School Psychology Task Force.
Kratochwill, T. R., & Stoiber, K. C. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.4.341.20872 · Cited by 288 · see citing works
“PERHAPS IT WOULD BE BETTER NOT TO KNOW EVERYTHING”1
Baer, D. M. (1977) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1977.10-167 · Cited by 279 · see citing works
Analysis and meta-analysis of single-case designs with a standardized mean difference statistic: A primer and applications
Shadish, W. R., Hedges, L. V., & Pustejovsky, J. E. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.11.005 · Cited by 270 · see citing works
Testing for the Presence of Positive-Outcome Bias in Peer Review: A Randomized Controlled Trial
Emerson, G. B., Warme, W. J., Wolf, F. M., Heckman, J. D., Brand, R. A., & Leopold, S. S. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.406 · Cited by 245 · see citing works
Estimating Effect Size Under Publication Bias: Small Sample Properties and Robustness of a Random Effects Selection Model
Hedges, L., & Vevea, J. L. (1996) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986021004299 · Cited by 223 · see citing works
Design-Comparable Effect Sizes in Multiple Baseline Designs
Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998614547577 · Cited by 215 · see citing works
A standardized mean difference effect size for multiple baseline designs across individuals
Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1086 · Cited by 206 · see citing works
Confirmational Response Bias Among Social Work Journals
EPSTEIN, W. M. (1990) · Science Technology & Human Values · doi:10.1177/016224399001500102 · Cited by 141 · see citing works
A systematic review of sensory-based treatments for children with disabilities
Barton, E. E., Reichow, B., Schnitz, A. G., Smith, I. C., & Sherlock, D. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.11.006 · Cited by 131 · see citing works
Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools
Wendt, O., & Miller, B. (2012) · Education and Treatment of Children · doi:10.1353/etc.2012.0010 · Cited by 123 · see citing works
Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship?
Atkinson, D. R., Furlong, M., & Wampold, B. (1982) · Journal of Counseling Psychology · doi:10.1037/0022-0167.29.2.189 · Cited by 120 · see citing works
Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis
Sham, E. B., & Smith, T. H. (2014) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.146 · Cited by 114 · see citing works
Visual analysis of single-case intervention research: Conceptual and methodological issues.
Horner, R. H., & Swoboda, C. M. (2014) · American Psychological Association eBooks · doi:10.1037/14376-004 · Cited by 90 · see citing works
Empirically evaluating the effectiveness of reading interventions: The use of brief experimental analysis and single case designs
Eckert, T. L., Ardoin, S. P., Daisey, D. M., & Scarola, M. D. (2000) · Psychology in the Schools · doi:10.1002/1520-6807(200009)37:5 · Cited by 84 · see citing works
An effect size measure and Bayesian analysis of single-case designs
Swaminathan, H., Rogers, H. J., & Horner, R. H. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.12.002 · Cited by 79 · see citing works
Ad-statistic for single-case designs that is equivalent to the usual between-groupsd-statistic
Shadish, W. R., Hedges, L. V., Pustejovsky, J. E., Boyajian, J. G., Sullivan, K. J., Andrade, A., & Barrientos, J. L. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.819021 · Cited by 54 · see citing works
Peer Management Interventions: A Meta-Analytic Review of Single-Case Research
Dart, E. H., Collins, T. A., Klingbeil, D. A., & McKinley, L. E. (2014) · School Psychology Review · doi:10.17105/spr-14-0009.1 · Cited by 50 · see citing works
How many studies are in the file drawer? An estimate from the family/marital psychotherapy literature
Shadish, W. R., Doherty, M., & Montgomery, L. M. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90013-5 · Cited by 45 · see citing works
Confirmational Response Bias and the Quality of the Editorial Processes Among American Social Work Journals
EPSTEIN, W. M. (2004) · Research on Social Work Practice · doi:10.1177/1049731504265838 · Cited by 43 · see citing works

Flagged first, then by citations

Sorted by citations

Tourism and Economic Growth: A Meta-regression Analysis
Nunkoo, R., Seetanah, B., Jaffur, Z. K., Moraghen, P. G. W., & Sannassee, R. V. (2019) · Journal of Travel Research · doi:10.1177/0047287519844833 · Cited by 224 · see citing works
Single‐case experimental designs: Characteristics, changes, and challenges
Kazdin, A. E. (2021) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.638 · Cited by 166 · see citing works
Systematic Use of Visual Analysis for Assessing Outcomes in Single Case Design Studies
Ledford, J. R., Lane, J. D., & Severini, K. E. (2017) · Brain Impairment · doi:10.1017/brimp.2017.16 · Cited by 163 · see citing works
Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education
Cook, B. G., Lloyd, J., Mellor, D., Nosek, B. A., & Therrien, W. J. (2018) · The Exceptional Child · doi:10.1177/0014402918793138 · Cited by 115 · see citing works
Replication Research, Publication Bias, and Applied Behavior Analysis
Tincani, M., & Travers, J. C. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00191-5 · Cited by 126 · see citing works
Single-Case-Design Research in Special Education: Next-Generation Guidelines and Considerations
Ledford, J. R., Lambert, J. M., Pustejovsky, J. E., Zimmerman, K. N., Hollins, N., & Barton, E. E. (2022) · Exceptional Children · doi:10.1177/00144029221137656 · Cited by 128 · see citing works
Publication Bias in Special Education Meta-Analyses
Gage, N. A., Cook, B. G., & Reichow, B. (2017) · Exceptional Children · doi:10.1177/0014402917691016 · Cited by 120 · see citing works
Augmented reality in special education: a meta-analysis of single-subject design studies
Baragash, R. S., Al-Samarraie, H., Alzahrani, A. I., & Alfarraj, O. (2020) · European Journal of Special Needs Education · doi:10.1080/08856257.2019.1703548 · Cited by 115 · see citing works
Single-case intervention research design standards: Additional proposed upgrades and future directions
Kratochwill, T. R., Horner, R. H., Levin, J. R., Machalicek, W., Ferron, J. M., & Johnson, A. H. (2023) · Journal of School Psychology · doi:10.1016/j.jsp.2022.12.002 · Cited by 92 · see citing works
Meta‐analyses and effect sizes in applied behavior analysis: A review and discussion
Dowdy, A., Peltier, C. J., Tincani, M., Schneider, W. J., Hantula, D. A., & Travers, J. C. (2021) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.862 · Cited by 79 · see citing works
Toward an explicit technology of ecological validity
Fahmie, T. A., Rodriguez, N. M., Luczynski, K. C., Rahaman, J. A., Charles, B. M., & Zangrillo, A. N. (2023) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.972 · Cited by 82 · see citing works
Publishing Single-Case Research Design Studies That Do Not Demonstrate Experimental Control
Tincani, M., & Travers, J. C. (2017) · Remedial and Special Education · doi:10.1177/0741932517697447 · Cited by 75 · see citing works
Technology-Aided Instruction and Intervention for Students With ASD: A Meta-Analysis Using Novel Methods of Estimating Effect Sizes for Single-Case Research
Barton, E. E., Pustejovsky, J. E., Maggin, D. M., & Reichow, B. (2017) · Remedial and Special Education · doi:10.1177/0741932517729508 · Cited by 74 · see citing works
Null Effects and Publication Bias in Special Education Research
Cook, B. G., & Therrien, W. J. (2017) · Behavioral Disorders · doi:10.1177/0198742917709473 · Cited by 71 · see citing works
Preregistration in Single-Case Design Research
Johnson, A. H., & Cook, B. G. (2019) · Exceptional Children · doi:10.1177/0014402919868529 · Cited by 67 · see citing works
A Review and Critical Examination of the System of Least Prompts
Shepley, C., Lane, J. D., & Ault, M. J. (2018) · Remedial and Special Education · doi:10.1177/0741932517751213 · Cited by 63 · see citing works
Teacher-Delivered Strategies to Increase Students’ Opportunities to Respond: A Systematic Methodological Review
Common, E. A., Lane, K. L., Cantwell, E. D., Brunsting, N. C., Oakes, W. P., Germer, K. A., & Bross, L. A. (2019) · Behavioral Disorders · doi:10.1177/0198742919828310 · Cited by 61 · see citing works
A systematic review of interventions for feeding-related behaviors for individuals with autism spectrum disorders
Ledford, J. R., Whiteside, E. E., & Severini, K. E. (2018) · Research in Autism · doi:10.1016/j.rasd.2018.04.008 · Cited by 58 · see citing works
A review of video modeling to teach STEM to students with autism and intellectual disability
Wright, J. C., Knight, V. F., & Barton, E. E. (2019) · Research in Autism · doi:10.1016/j.rasd.2019.101476 · Cited by 54 · see citing works
A Meta-Analysis of Self-Regulated Strategy Development Reading Interventions to Improve the Reading Comprehension of Students With Disabilities
Sanders, S., Losinski, M. L., Ennis, R. P., White, W., Teagarden, J. M., & Lane, J. (2019) · Reading & Writing Quarterly · doi:10.1080/10573569.2018.1545616 · Cited by 52 · see citing works
A Visual Aid and Objective Rule Encompassing the Data Features of Visual Analysis
Manolov, R., & Vannest, K. J. (2019) · Behavior Modification · doi:10.1177/0145445519854323 · Cited by 50 · see citing works
A Multiple-Baseline Evaluation of Acceptance and Commitment Therapy Focused on Repetitive Negative Thinking for Comorbid Generalized Anxiety Disorder and Depression
Ruiz, F. J., Luciano, C., Flórez, C. L., Suárez-Falcón, J. C., & Cardona-Betancourt, V. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00356 · Cited by 49 · see citing works
Furthering Open Science in Behavior Analysis: An Introduction and Tutorial for Using GitHub in Research
Gilroy, S. P., & Kaplan, B. A. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00202-5 · Cited by 47 · see citing works
Additional comparisons of randomization-test procedures for single-case multiple-baseline designs: Alternative effect types
Levin, J. R., Ferron, J. M., & Gafurov, B. S. (2017) · Journal of School Psychology · doi:10.1016/j.jsp.2017.02.003 · Cited by 46 · see citing works
Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor
Zimmerman, K. N., Ledford, J. R., Severini, K. E., Pustejovsky, J. E., Barton, E. E., & Lloyd, B. P. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.02.003 · Cited by 45 · see citing works
A Meta-Analysis of Class-Wide Interventions for Supporting Student Behavior
Chaffee, R. K., Briesch, A. M., Johnson, A. H., & Volpe, R. J. (2017) · School Psychology Review · doi:10.17105/spr-2017-0015.v46-2 · Cited by 44 · see citing works
One by One: Accumulating Evidence by using Meta-Analytical Procedures for Single-Case Experiments
Onghena, P., Michiels, B., Jamshidi, L., Moeyaert, M., & Noortgate, W. V. D. (2017) · Brain Impairment · doi:10.1017/brimp.2017.25 · Cited by 40 · see citing works
Rethinking Rigor in Multiple Baseline and Multiple Probe Designs
Ledford, J. R., & Zimmerman, K. N. (2022) · Remedial and Special Education · doi:10.1177/07419325221102539 · Cited by 39 · see citing works
Evaluation of publication bias in response interruption and redirection: A meta‐analysis
Dowdy, A., Tincani, M., & Schneider, W. J. (2020) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.724 · Cited by 36 · see citing works
A Meta-Analysis Examining the Evidence-Base of Mathematical Interventions for Students With Emotional Disturbances
Losinski, M. L., Ennis, R. P., Sanders, S. A., & Nelson, J. A. (2018) · The Journal of Special Education · doi:10.1177/0022466918796200 · Cited by 33 · see citing works
Participant characteristics predicting communication outcomes in AAC implementation for individuals with ASD and IDD: a systematic review and meta-analysis
Ganz, J. B., Pustejovsky, J. E., Reichle, J. E., Vannest, K. J., Foster, M., Pierson, L. M., Wattanawongwan, S., Bernal, A. J., Chen, M., Haas, A., et al. (2022) · Augmentative and Alternative Communication · doi:10.1080/07434618.2022.2116355 · Cited by 35 · see citing works
Reducing Escape without Escape Extinction: A Systematic Review and Meta-Analysis of Escape-Based Interventions
Chazin, K. T., Velez, M. S., & Ledford, J. R. (2021) · Journal of Behavioral Education · doi:10.1007/s10864-021-09453-2 · Cited by 31 · see citing works
Negative Results: Conceptual and Methodological Dimensions in Single-Case Intervention Research
Kratochwill, T. R., Levin, J. R., & Horner, R. H. (2017) · Remedial and Special Education · doi:10.1177/0741932517741721 · Cited by 29 · see citing works
Systematic Review and Meta-Analysis of Stay-Play-Talk Interventions for Improving Social Behaviors of Young Children
Ledford, J. R., & Pustejovsky, J. E. (2021) · Journal of Positive Behavior Interventions · doi:10.1177/1098300720983521 · Cited by 29 · see citing works
Effectiveness of Responsivity Intervention Strategies on Prelinguistic and Language Outcomes for Children with Autism Spectrum Disorder: A Systematic Review and Meta-Analysis of Group and Single Case Studies
McDaniel, J., Brady, N. C., & Warren, S. F. (2021) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05331-y · Cited by 30 · see citing works
An Information Theoretic Approach to Model Selection: A Tutorial with Monte Carlo Confirmation
Newland, M. C. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00206-1 · Cited by 28 · see citing works
A Systematic Review of Function-Modified Check-In/Check-Out
Klingbeil, D. A., Dart, E. H., & Schramm, A. L. (2018) · Journal of Positive Behavior Interventions · doi:10.1177/1098300718778032 · Cited by 28 · see citing works
Systematic Review of High Probability Requests in K-12 Settings: Examining the Evidence Base
Common, E. A., Bross, L. A., Oakes, W. P., Cantwell, E. D., Lane, K. L., & Germer, K. A. (2018) · Behavioral Disorders · doi:10.1177/0198742918800029 · Cited by 26 · see citing works
A primer for using multilevel models to meta‐analyze single case design data with AB phases
Becraft, J. L., Borrero, J. C., Sun, S., & McKenzie, A. A. (2020) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.698 · Cited by 26 · see citing works
The Evidence Base for Interventions for Individuals With ASD: A Call to Improve Practice Conceptualization and Synthesis
Ledford, J. R., Lambert, J. M., Barton, E. E., & Ayres, K. M. (2021) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576211023349 · Cited by 26 · see citing works
A Meta-Analysis of Interventions to Improve the Compliance of Students with Disabilities
Losinski, M. L., Sanders, S., Katsiyannis, A., & Wiseman, N. (2017) · Education and Treatment of Children · doi:10.1353/etc.2017.0020 · Cited by 25 · see citing works
A Systematic Review of Instructional Comparisons in Single-Case Research
Ledford, J. R., Chazin, K. T., Gagnon, K. L., Lord, A. K., Turner, V. R., & Zimmerman, K. N. (2019) · Remedial and Special Education · doi:10.1177/0741932519855059 · Cited by 24 · see citing works
Search and Selection Procedures of Literature Reviews in Behavior Analysis
King, S. A., Kostewicz, D. E., Enders, O. G., Burch, T., Chitiyo, A., Taylor, J., DeMaria, S., & Reid, M. (2020) · Perspectives on Behavior Science · doi:10.1007/s40614-020-00265-9 · Cited by 26 · see citing works
The use of touch devices for enhancing academic achievement: A meta‐analysis
Petersen‐Brown, S., Henze, E. E. C., Klingbeil, D. A., Reynolds, J. L., Weber, R. C., & Codding, R. S. (2019) · Psychology in the Schools · doi:10.1002/pits.22225 · Cited by 24 · see citing works
Academic and Related Skills Interventions for Autism: a 20-Year Systematic Review of Single-Case Research
Alresheed, F., Machalicek, W., Sanford, A. K., & Bano, C. (2018) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-018-0141-9 · Cited by 20 · see citing works
Methods for addressing publication bias in school psychology journals: A descriptive review of meta-analyses from 1980 to 2019
McClain, M. B., Callan, G. L., Harris, B., Floyd, R. G., Haverkamp, C. R., Golson, M. E., Longhurst, D. N., & Benallie, K. J. (2021) · Journal of School Psychology · doi:10.1016/j.jsp.2020.11.002 · Cited by 23 · see citing works
Teaching Sequences of Pretend Play to Children With Disabilities
Barton, E. E., Choi, G., & Mauldin, E. G. (2018) · Journal of Early Intervention · doi:10.1177/1053815118799466 · Cited by 23 · see citing works
Tablet-based interventions for individuals with ASD: Evidence of generalization and maintenance effects
Hong, E. R., Kawaminami, S., Neely, L. C., Morin, K. L., Davis, J. L., & Gong, L.-Y. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.01.014 · Cited by 22 · see citing works
A Systematic Review of the Evidence Base for Active Supervision in Pre-K–12 Settings
Allen, G. E., Common, E. A., Germer, K. A., Lane, K. L., Buckman, M. M., Oakes, W. P., & Menzies, H. M. (2019) · Behavioral Disorders · doi:10.1177/0198742919837646 · Cited by 22 · see citing works
Open Science and Single-Case Design Research
Cook, B. G., Johnson, A. H., Maggin, D. M., Therrien, W. J., Barton, E. E., Lloyd, J. W., Reichow, B., Talbott, E., & Travers, J. C. (2021) · Remedial and Special Education · doi:10.1177/0741932521996452 · Cited by 22 · see citing works
Systematic Review of Peer-Mediated Intervention for Children with Autism Who Are Minimally Verbal
O’Donoghue, M., O’Dea, Á., O’Leary, N., Kennedy, N., Forbes, J., & Murphy, C. (2020) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-020-00201-2 · Cited by 22 · see citing works
Say something nice: A meta-analytic review of peer reporting interventions
Collins, T. A., Drevon, D. D., Brown, A. M., Villarreal, J. N., Newman, C. L., & Endres, B. E. (2020) · Journal of School Psychology · doi:10.1016/j.jsp.2020.10.002 · Cited by 21 · see citing works
A Meta-Analysis of Single-Case Research on Embedding Interests of Individuals With Autism Spectrum Disorder
Ninci, J., Neely, L. C., Burke, M. D., Rispoli, M. J., Vannest, K. J., Willson, V. L., & Ulloa, P. (2019) · Remedial and Special Education · doi:10.1177/0741932519841692 · Cited by 21 · see citing works
Establishing Interventions via a Theory-Driven Single Case Design Research Cycle
Kilgus, S. P., Riley‐Tillman, T. C., & Kratochwill, T. R. (2016) · School Psychology Review · doi:10.17105/spr45-4.477-498 · Cited by 20 · see citing works
Systematic Review of Safety Skill Interventions for Individuals With Autism Spectrum Disorder
Tekin-İftar, E., Olçay, S., Sirin, N., Bilmez, H., Değirmenci, H. D., & Collins, B. C. (2020) · The Journal of Special Education · doi:10.1177/0022466920918247 · Cited by 20 · see citing works
Evaluation of a finger prompt variation in the treatment of pediatric feeding disorders
Rubio, E. K., Volkert, V. M., Farling, H., & Sharp, W. G. (2019) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.658 · Cited by 19 · see citing works
Introduction to Special Issue: Null Effects and Publication Bias in Learning Disabilities Research
Therrien, W. J., & Cook, B. G. (2018) · Learning Disabilities Research and Practice · doi:10.1111/ldrp.12163 · Cited by 19 · see citing works
Performance criteria‐based effect size ( PCES ) measurement of single‐case experimental designs: A real‐world data study
Aydın, O., & Tanious, R. (2022) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.928 · Cited by 18 · see citing works
Questionable Research Practices in Single-Case Experimental Designs: Examples and Possible Solutions
Tincani, M., & Travers, J. C. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_12 · Cited by 18 · see citing works
A systematic review of physical guidance procedures as an open‐mouth prompt to increase acceptance for children with pediatric feeding disorders
Rubio, E. K., McMahon, M. X. H., & Volkert, V. M. (2020) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.782 · Cited by 18 · see citing works
Comparison of Probe Procedures in the Assessment of Chained Tasks
Alexander, J. L., Ayres, K. M., Shepley, S. B., Smith, K., & Ledford, J. R. (2017) · The Psychological Record · doi:10.1007/s40732-017-0257-9 · Cited by 17 · see citing works
Behavioral Self-Regulation: A Comparison of Goals and Self-Monitoring for High School Students With Disabilities
Estrapala, S., Bruhn, A. L., & Rila, A. (2021) · Journal of Emotional and Behavioral Disorders · doi:10.1177/10634266211051404 · Cited by 17 · see citing works
Discrete‐trial teaching: A scoping review
Frank‐Crawford, M. A., Borrero, J. C., Fisher, A. B., Talhelm, P., & Fernandez, N. (2024) · Behavioral Interventions · doi:10.1002/bin.2012 · Cited by 19 · see citing works
Academic libraries as the flagships of publishing trends in LIS: a complex analysis of rankings, citations and topics of research
Winkler, B., & Kiszl, P. (2020) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2020.102223 · Cited by 16 · see citing works
Systematic Review of Interventions Designed to Teach Imitation to Young Children With Disabilities
Ledford, J. R., & Windsor, S. A. (2021) · Topics in Early Childhood Special Education · doi:10.1177/02711214211007190 · Cited by 16 · see citing works
Quantification of behavioral data with effect sizes and statistical significance tests
Costello, M. S., Bagley, R. F., Bustamante, L. F., & Deochand, N. (2022) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.938 · Cited by 16 · see citing works
A Productive Scholar’s Guide to Respectful, Responsible Inquiry During the COVID-19 Pandemic: Moving Forward
Lane, K. L., Cabell, S. Q., & Drew, S. V. (2021) · Journal of Learning Disabilities · doi:10.1177/00222194211023186 · Cited by 15 · see citing works
Transition States in Single Case Experimental Designs
Brogan, K. M., Rapp, J. T., & Sturdivant, B. R. (2019) · Behavior Modification · doi:10.1177/0145445519839213 · Cited by 15 · see citing works
Special Issue on Advances in Single-Case Research Design and Analysis
Machalicek, W., & Horner, R. H. (2018) · Developmental Neurorehabilitation · doi:10.1080/17518423.2018.1468600 · Cited by 15 · see citing works
Changing Criterion Designs: Integrating Methodological and Data Analysis Recommendations
Manolov, R., Solanas, A., & Sierra, V. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2018.1553838 · Cited by 14 · see citing works
Considering Instructional Contexts in AAC Interventions for People with ASD and/or IDD Experiencing Complex Communicative Needs: a Single-Case Design Meta-analysis
Ganz, J. B., Pustejovsky, J. E., Reichle, J. E., Vannest, K. J., Foster, M., Haas, A., Pierson, L. M., Wattanawongwan, S., Bernal, A. J., Chen, M., et al. (2022) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-022-00314-w · Cited by 13 · see citing works
Extensions of open science for applied behavior analysis: Preregistration for single‐case experimental designs
Tincani, M., Gilroy, S. P., & Dowdy, A. (2024) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.2909 · Cited by 13 · see citing works
The role of single case experimental designs in evidence creation in rehabilitation
Machalicek, W., participants, 5. C. R. M. M., Gross, D. P., Armijo-Olivo, S. L., Ferriero, G., Kiekens, C., Martin, R., Walshe, M., & Négrini, S. (2024) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.24.08713-6 · Cited by 13 · see citing works
Performance-Based Feedback to Enhance Early Interventionist’s Practice and Caregiver and Child Outcomes
Coogle, C. G., Larson, A. L., Ottley, J. R., Root, A. K., & Bougher-Muckian, H. R. (2019) · Topics in Early Childhood Special Education · doi:10.1177/0271121419831414 · Cited by 13 · see citing works
Issues and Advances in the Systematic Review of Single-Case Research: A Commentary on the Exemplars
Manolov, R., Guilera, G., & Solanas, A. (2017) · Remedial and Special Education · doi:10.1177/0741932517726143 · Cited by 13 · see citing works
Creative arts therapy in the United States school system: An integrative systematic review of empirically evaluated interventions from the past decade
Frydman, J. S., Hyman, S. R., & Caputo, S. A. (2021) · Psychology in the Schools · doi:10.1002/pits.22629 · Cited by 12 · see citing works
Questionable and Improved Research Practices in Single-Case Experimental Design: Initial Investigation and Findings
Tincani, M., Travers, J. C., Dowdy, A., Slocum, T. A., & Deitrich, R. (2025) · Perspectives on Behavior Science · doi:10.1007/s40614-025-00441-9 · Cited by 12 · see citing works
Technology-assisted reading fluency interventions for students with reading difficulties: evidence from a meta-analytic approach of single case design studies
Mize, M., Park, Y., & Martin, M. C. (2022) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2022.2060351 · Cited by 11 · see citing works
The Effects of Writing Choice Prompt on the Written Narratives of Students With Emotional and Behavioral Disorders: A Case Study of an Abandoned Single-Case Design
Ennis, R. P., Jolivette, K., & Losinski, M. L. (2017) · Behavioral Disorders · doi:10.1177/0198742917709471 · Cited by 11 · see citing works
Systematic Review of Studies Addressing Computer-Assisted Instruction for Students with Visual Impairment
Tuttle, M., & Carter, E. W. (2022) · Journal of Special Education Technology · doi:10.1177/01626434221088026 · Cited by 10 · see citing works
Extinction and Response Force in Conjugate Schedules
Falligant, J. M., Rapp, J. T., Brogan, K. M., & Pinkston, J. W. (2020) · The Psychological Record · doi:10.1007/s40732-020-00374-6 · Cited by 10 · see citing works
Collective harmony as a moderator of the association between other-referent upward counterfactual thinking and depression
Broomhall, A. G., & Phillips, W. J. (2020) · Cogent Psychology · doi:10.1080/23311908.2020.1714833 · Cited by 10 · see citing works
Reporting single-case design studies: Advice in relation to the designs’ methodological and analytical peculiarities
Manolov, R. (2017) · Anuario de Psicología/The UB Journal of Psychology · doi:10.1016/j.anpsic.2017.05.004 · Cited by 9 · see citing works
Assessing the Differential Effects of Known and Mystery Rewards in a Preschool-Based Group Contingency
Pokorski, E. A., Barton, E. E., & Ledford, J. R. (2019) · Journal of Early Intervention · doi:10.1177/1053815119841088 · Cited by 9 · see citing works
Reforms in Academic Publishing: Should Behavioral Disorders and Special Education Journals Embrace Them?
Cook, B. G. (2016) · Behavioral Disorders · doi:10.17988/0198-7429-41.3.161 · Cited by 9 · see citing works
A Meta-Analysis of the Graduated Guidance Procedure
Tekin-İftar, E., Ault, M. J., Collins, B. C., Olçay, S., Değirmenci, H. D., & Aydın, O. (2023) · The Journal of Special Education · doi:10.1177/00224669231200461 · Cited by 8 · see citing works
Harnessing Available Evidence in Single-Case Experimental Studies: The Use of Multilevel Meta-Analysis
Noortgate, W. V. D., & Onghena, P. (2024) · Psychologica Belgica · doi:10.5334/pb.1307 · Cited by 8 · see citing works
Open Research: Examples of good practice, and resources across disciplines (2025 edition)Preprint
Farran, E. K., Silverstein, P., Ameen, A. A., Misheva, I., & Gilmore, C. K. (2020) · doi:10.31219/osf.io/3r8hb · Cited by 7 · see citing works
School-based consultation and coaching for promoting teachers’ generalized outcomes: A meta-analysis
LaBrot, Z. C., Smith, T. E., Maxime, E., & Lawson, A. (2024) · Journal of School Psychology · doi:10.1016/j.jsp.2024.101379 · Cited by 7 · see citing works
Four Best Practices for Meta-Analysis: A Systematic Review of Methodological Rigor in Mathematics Interventions for Students With or at Risk of Disabilities
Park, S., Lee, Y. R., Nelson, G., & Tipton, E. (2023) · Learning Disability Quarterly · doi:10.1177/07319487231185133 · Cited by 7 · see citing works
A Meta-Analysis of Behavior Interventions for Students With Emotional-Behavioral Disorders in Self-Contained Settings
Gersib, J. A., & Mason, S. C. (2023) · Behavioral Disorders · doi:10.1177/01987429231160285 · Cited by 10 · see citing works
A Synthesis of Spelling Interventions for Secondary Students With Disabilities
Williams, K. J., Austin, C. R., & Vaughn, S. R. (2017) · The Journal of Special Education · doi:10.1177/0022466917732777 · Cited by 6 · see citing works
Save the best for last I: Young adults demonstrate negative time preference—A replication and extension.
Castillo, M. I., Sun, S., Frank‐Crawford, M. A., & Borrero, J. C. (2022) · Behavior Analysis Research and Practice · doi:10.1037/bar0000246 · Cited by 6 · see citing works
Meta-analysis of single-case experimental designs: How can alternating treatments and changing criterion designs be included?
Manolov, R., Onghena, P., & Noortgate, W. V. D. (2022) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2022.2040164 · Cited by 5 · see citing works
Effects of Email Performance Feedback on Teachers’ Use of Play Expansions
Gomez, L., Barton, E. E., Winchester, C., & Locchetta, B. M. (2020) · Journal of Early Intervention · doi:10.1177/1053815120969821 · Cited by 5 · see citing works
Treatment of Inappropriate Sexual Behavior in Persons With Dementia: A Systematic Review
Lane, N. E., Ahuja, M., Hatch, S., Seitz, D. P., McGowan, J., & Watt, J. A. (2025) · Journal of the American Geriatrics Society · doi:10.1111/jgs.19489 · Cited by 4 · see citing works
A Registered Report on Selective Reporting in Single-Case Experimental Research
Travers, J. C., Tincani, M., Dowdy, A., Forbes, H. J., & Johnson, J. V. (2025) · Remedial and Special Education · doi:10.1177/07419325251350697 · Cited by 5 · see citing works
Supporting the replication of your research
Forbes, H. J., Travers, J. C., & Johnson, J. V. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90969-3.00003-7 · Cited by 4 · see citing works
Additional Comments on the Use of Contingent Electric Skin Shock
Fisher, W. W., Greer, B. D., & Mitteer, D. R. (2023) · Perspectives on Behavior Science · doi:10.1007/s40614-023-00382-1 · Cited by 4 · see citing works
Open Science in the Field of Emotional and Behavioral Disorders
Cook, B. G., Lloyd, J. W., & Therrien, W. J. (2019) · Education and Treatment of Children · doi:10.1353/etc.2019.0027 · Cited by 4 · see citing works

Questionable Research Practices in Single-Case Experimental Designs: Examples and Possible Solutions
Tincani, M., & Travers, J. C. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_12 · Cited by 18 · see citing works
An Assessment of Publication Bias Using a Sample of Published Clinical Trials
Berlin, J. A., Begg, C. B., & Louis, T. A. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478782 · Cited by 134 · see citing works
Replication Research, Publication Bias, and Applied Behavior Analysis
Tincani, M., & Travers, J. C. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00191-5 · Cited by 126 · see citing works
Quantifying Intervention Effects in Single-Case Research: A 25-Year Review
Balıkcı, Ş., & Gülboy, E. (2026) · Behavioral Sciences · doi:10.3390/bs16040507
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · see citing works

Authors: Shadish, W. R., Zelinsky, N. A. M., Vevea, J. L., & Kratochwill, T. R.
Affiliations: University of California, Merced (US)
University of Wisconsin–Madison (US)
Corresponding author: Shadish, William R.
Venue: Journal of Applied Behavior Analysis
Publisher: Wiley
Published: 2016-05-13
Volume: 49
Issue: 3
Pages: 656-673
ISSN: 0021-8855 (ISSN-L)
1938-3703
DOI: 10.1002/jaba.308
OpenAlex: W2361447118
Cited by: 130
References: 46
Citations by year: 2026: 5 · 2025: 7 · 2024: 9 · 2023: 9 · 2022: 14 · 2021: 15 · 2020: 17 · 2019: 24 · 2018: 13 · 2017: 15 · 2016: 2
FWCI: 16.81
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Journal of Applied Behavior Analysis (publishedVersion)
PubMed (publishedVersion)
Funders: U.S. Department of Education (R305D100046, R305D100033, R305D150041)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Keywords: publication bias, single-case experimental design, publication practices, effect size, manuscript submission, peer review, reviewer recommendation, small effect sizes, overestimation of treatment effects
MeSH terms: Humans, Surveys and Questionnaires, Research Design, Research Personnel, Publication Bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A survey of publication practices of single-case design researchers when treatments have small or large effects.

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks