Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Publication bias arises when studies with favorable results are more likely to be reported than are studies with null findings. If this bias occurs in studies with single‐subject experimental designs (SSEDs) on applied behavior‐analytic (ABA) interventions, it could lead to exaggerated estimates of intervention effects. Therefore, we conducted an initial test of bias by comparing effect sizes, measured by percentage of nonoverlapping data (PND), in published SSED studies (n = 21) and unpublished dissertations (n = 10) on 1 well‐established intervention for children with autism, pivotal response treatment (PRT). Although published and unpublished studies had similar methodologies, the mean PND in published studies was 22% higher than in unpublished studies, 95% confidence interval (4%, 38%). Even when unpublished studies are included, PRT appeared to be effective (PND M = 62%). Nevertheless, the disparity between published and unpublished studies suggests a need for further assessment of publication bias in the ABA literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“This publication bias means that many seemingly well-established effects are exaggerated or illusory (Ioannidis, 2005), which poses a threat to the credibility of the scientific method (Pashler & Wagenmakers, 2012).”
BackgroundPashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013 · cited 4×
“In the only published study of publication bias in the ABA literature, Mahoney (1977) examined the role of reviewers. He commented that reviewers for ABA journals tend to be strong proponents of ABA interventions and thus may be more accepting of studies that show benefits than studies that do not (Mahoney, 1977). To…”
BackgroundResultInfluential“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734 · cited 1×
“Although publication bias pervades many areas of research (Fanelli, 2010), intervention studies may be especially prone to this problem because “results are often selectively reported, emphasizing the most exciting among them, and outsiders frequently do not have access to what they need to…”
BackgroundFerguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 2×
“Moreover, the use of unpublished dissertations is an imperfect test for publication bias because not all dissertations can be located via search engines (Ferguson & Heene, 2012).”
BackgroundTraining parents to use the natural language paradigm to increase their autistic children's speech
Laski, K. E., Charlop, M. H., & Schreibman, L. (1988) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1988.21-391 · Cited by 316 · cited 1×
“The published studies included the entire dissertation data sets with three exceptions: (a) Laski, Charlop, and Schreibman (1988) reported a sum of three different child behaviors, whereas the dissertation reported data on each of the three behaviors separately; (b)Whalen and Schreibman (2003)…”
BackgroundIndividual Behavioral Profiles and Predictors of Treatment Effectiveness for Children With Autism.
Sherer, M. R., & Schreibman, L. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.3.525 · Cited by 230
Parent education for families of children with autism living in geographically distant areas
Koegel, R. L., Symon, J. B., & Kern Koegel, L. (2002) · Journal of Positive Behavior Interventions · doi:10.1177/109830070200400204 · Cited by 165
Cited by
Evidence Base Update for Autism Spectrum Disorder
Smith, T., & Iadarola, S. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1077448 · Cited by 339
Self-citationSingle‐case experimental designs: Characteristics, changes, and challenges
Kazdin, A. E. (2021) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.638 · Cited by 166
Shadish, W. R., Zelinsky, N. A. M., Vevea, J. L., & Kratochwill, T. R. (2016) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.308 · Cited by 130
Rakap, S., Rakap, S., Evran, D., & Cig, O. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.09.008 · Cited by 80
Clinical outcomes of behavioral treatments for pica in children with developmental disabilities
Call, N. A., Simmons, C. A., Mevers, J. E. L., & Alvarez, J. P. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2375-z · Cited by 55
Metadata
- Authors
- Sham, E., & Smith, T.
- Venue
- Journal of Applied Behavior Analysis
- Publisher
- Wiley
- Published
- 2014-07-03
- Volume
- 47
- Issue
- 3
- Pages
- 663-678
- ISSN
- 0021-8855 (ISSN-L)
- 1938-3703
- OpenAlex
- W2124544221
- Cited by
- 114
- References
- 12
- FWCI
- 17.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis. https://app.cochat.ai/papers/10.1002/jaba.146
- The paper
- Sham, E., & Smith, T. (2014). Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis. Journal of Applied Behavior Analysis. https://doi.org/10.1002/jaba.146
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.