The DOI matches its Crossref record; 63 of the 65 references it cites were found in a registry or an index.
An improved effect size for single-case research: nonoverlap of all pairs.
Abstract
Nonoverlap of All Pairs (NAP), an index of data overlap between phases in single-case research, is demonstrated and field tested with 200 published AB contrasts. NAP is a novel application of an established effect size known in various forms as Area Under the Curve (AUC), the Common Language Effect Size (CL), the Probability of Superiority (PS), the Dominance Statistic (DS), Mann-Whitney's U, and Sommers D, among others. NAP was compared with 3 other non-overlap-based indices: PND (percent of nonoverlapping data), PEM (percent of data points exceeding the median), and PAND (percent of all nonoverlapping data), as well as Pearson's R(2). Five questions were addressed about NAP: (a) typical NAP values, (b) its ability to discriminate among typical single-case research results, (c) its power and precision (confidence interval width), (d) its correlation with the established effect size index, R(2), and (e) its relationship with visual judgments. Results were positive, the new index equaling or outperforming the other overlap indices on most criteria.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the effect sizes found in SCED studies are usually higher than those found in group designs such as randomized controlled trials (Parker and Vannest, 2009; Shadish et al., 2016).”
From A Multiple-Baseline Evaluation of Acceptance and Commitment Therapy Focused on Repetitive Negative Thinking for Comorbid Generalized Anxiety Disorder and Depression (2020) · cites this paper as Parker and Vannest, 2009
In the citing paper
“Parker and Vannest (2009) proposed the following ranges in order to interpret NAP; scores ranging from 0 to 0.65 are weak effects, from 0.66 to 0.92 are medium effects, and from 0.93 to 1.0 are large or strong effects.”
From Acceptance and commitment therapy for individuals with depressive and anxiety symptoms following acquired brain injury: A non-concurrent multiple baseline design across four cases. (2023) · cites this paper as Parker and Vannest (2009)
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Practical Nonparametric Statistics
Groggel, D. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271101 · Cited by 11,076
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368
Robust Tests for the Equality of Variances
Brown, M. B., & Forsythe, A. B. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10482955 · Cited by 3,216
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Graphical Methods for Data Analysis.
Healy, M. J. R., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981587 · Cited by 2,315
Flagged first, then by citations
2 of the 65 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Newson, R. B., 2000. snp15.1: Update to somersd. Stata Technical Bulletin 57: 35. In Stata Technical Bulletin Reprints, vol. 10, 322–323. College Station, TX: Stata Press.
Cited by
Sorted by citations
Items 901–1,000 of 1,001
Problem solving team interventions: Web-based and consultant-based experimental evaluations.
Kratochwill, T., Asmus, J., Schienebeck, C. J., Dohrn, E., Levin, J. R., Ament, A. P., Hagermoser-Bayley, E., Bice-Urbach, B., Willes, M., Sorensen, D., et al. (2024) · Journal of School Psychology · doi:10.1016/j.jsp.2023.101279 · Cited by 1
Kingsdorf, S., Pančocha, K., & Vaďurová, H. (2024) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576241300507 · Cited by 1
“(Parker & Vannest, 2009).”
Within-Person Variation in Personality and Psychological Well-Being
Churchyard, J. S. (2014) · University of Hertfordshire Research Archive (University of Hertfordshire) · doi:10.18745/th.15432 · Cited by 3
Elliott, T. R. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20834 · Cited by 1
“…authors use contemporary statistical procedures to analyze their data (including regression techniques: Brossart et al., 2008; Brossart, Parker, & Castillo, in press; effect sizes: Parker & Hagan-Burke, 2007; Parker & Vannest, 2009) in addition to the traditional graphed data for visual inspection.”
MethodPalmen, A. (2013) · Radboud Repository (Radboud University) · Cited by 1
Knap, K. (2015) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Emotion Regulation Treatment of Disruptive Behavior: A Preliminary Investigation
Turner, K. (2017) · VTechWorks (Virginia Tech) · Cited by 1
Johnson, F. (2020) · TigerPrints (Clemson University) · Cited by 1
Training Observers in Class-Wide Behavior Data Collection Using Behavior Skills Training
Scheel, N. L. (2020) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Aydın, O., & Tanious, R. (2021) · doi:10.31234/osf.io/dcnjz · Cited by 1
Waddington, H. L. (2018) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17068478 · Cited by 4
Buscher, C. S. (2014) · The Mathematics Enthusiast · Cited by 1
Vigeveno, D., Marić, M., Onghena, P., & Hupkes, M. (2022) · Research Square · doi:10.21203/rs.3.rs-1853036/v1 · Cited by 1
The Impact of Adding Art Therapy to a Mindfulness Enhancement Training with a Medical StudentPreprint
Douglas, E., & Dykeman, C. (2022) · doi:10.31234/osf.io/z82cv · Cited by 1
Examining Differences Within Groups and Single‐Case Research Designs
Balkin, R. S., & Kleist, D. M. (2025) · doi:10.1002/9781394346899.ch8 · Cited by 1
The Effects of Tootling on Disruptive and Academic Behaviors in High School
Lum, J. D. K. (2015) · Aquila Digital Community (University of Southern Mississippi) · Cited by 1
Starling, N. R. (2015) · OpenCommons - UConn (University of Connecticut) · Cited by 1
How the Activity Schedules Impact the Children with Autism Spectrum Disorder? A Meta-analysis
Genc‐Tosun, D., Özkan, Ş. Y., & Eyiip, Ö. D. (2023) · Kuramsal Eğitimbilim · doi:10.30831/akukeg.1109787
Hefter, S. (2021) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/6895886.0
O’Handley, R. D. (2014) · Aquila Digital Community (University of Southern Mississippi)
A Monte Carlo Study: The Consequences of the Misspecification of the Level-1 Error Structure
Petit-Bois, M. (2014) · Digital Commons - University of South Florida (University of South Florida)
Carr, S., & Wallace, S. E. (2013) · The Aphasiology Archive (University of Pittsburgh)
Hetherton, M. B. (2019) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/mjwb-vp70
“Parker and Vannest’s (2009) suggest NAP is a better solution than”
BackgroundAuditory and Visual Cues for Topic Maintenance with Persons Who Exhibit Dementia of Alzheimer’s Type
Teten, A. F., Dagenais, P. A., & Friehe, M. J. (2015) · International Journal of Alzheimer s Disease · doi:10.1155/2015/126064
“However, visual inspection of the data and use of Nonoverlap of All Pairs (NAP) analysis indicate strong effectiveness of visual and auditory redirections on topic coherence when compared to baseline conversations.”
An Embedded Planning Tool for Tier Three Reading Instruction
Wei, Y. (2015) · OpenCommons - UConn (University of Connecticut)
Empowering Apprentice Teachers: Tracking Instructional Practices with MyiLOGS
Roggeman, P. M. (2013)
Neuropsychological Rehabilitation: An International
Jamieson, M., Cullen, B., McGee, M. R., Brewster, S. A., & Evans, J. J. (2013)
Social narrative interventions for students with autism
Gikas, S. J. (2013) · OhioLink ETD Center (Ohio Library and Information Network)
Cuijpers, J. P. M., van Oorsouw, W. M. W. J., Hendriks, A. H. C., & Embregts, P. J. C. M. (2015) · GZ - Psychologie · doi:10.1007/s41480-015-0027-8
“De NAP wordt berekend door het aantal vergelijkende paren die geen overlap hebben en de helft van de paren die op dezelfde hoogte liggen te delen door het totale aantal vergelijkingen (Ramdos et al. 2011).”
BackgroundCavell, H. J. (2016) · Aquila Digital Community (University of Southern Mississippi)
The Effects of the Caterpillar Game on Classroom Behavior and Teacher Stress
Jacoby, A. L. (2016) · The Keep (Eastern Illinois University)
Implementing a Positive Variation of the Good Behavior Game with the Use of a Computer-Based Program
Lynne, S. (2016) · Aquila Digital Community (University of Southern Mississippi)
Peters, B. (2022) · Digital Archive @ GSU · doi:10.57709/8776454
Efficacy of a Daily Mindful Breathing Intervention to Increase Academic Engagement
Minkos, M. L. (2016) · OpenCommons at University of Connecticut (University of Connecticut)
Acceptance and Commitment Therapy for Adolescent Difficulties with Emotion Regulation: An Open Trial
Duenas, J. A. (2016) · ScholarWorks - WMU (Western Michigan University)
A Meta-analysis of Communication Interventions Involving Speech-Generating Devices(SGD)
Yang, H.-K. (2016) · The Journal of Special Children Education · doi:10.21075/kacsn.2016.18.3.143
Karich, A. C. (2016) · University of Minnesota Digital Conservancy (University of Minnesota)
Teaching Social Skills to Individuals with Comorbid Down Syndrome and Autism Spectrum Disorder
Davis, M. C. (2017) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2017.061
“Tentative benchmarks for interpreting effect sizes for Tau-U have been established for non-overlap data analyses in previous research (Parker & Vannest, 2009; Rakap, 2015).”
MethodMajszak, H. (2018) · J. Willard Marriott Library · doi:10.26053/0h-gpya-wsg0
Donehower, C. (2017) · Journal of International Crisis and Risk Communication Research
Student-Teacher Relationships and Students with Behavior Difficulties in Therapeutic Schools
Kane, C. (2022) · Digital Archive @ GSU · doi:10.57709/10552126
Project RECESS: Restructuring Environmental Contingencies and Enhancing Self-Managed Supervision
Kern, L. (2017) · OpenCommons at University of Connecticut (University of Connecticut)
The Impact of Psychotherapeutic Reiki on Anxiety and Mindfulness: A Single-Case Design
Webster, L. C. (2016) · doi:10.12794/metadc955118
“I determined whether each paired data conveyed improvement, deterioration, or no change over time (Parker & Vannest, 2009).”
InfluentialKim, E.-K. (2012) · Journal of Special Education · doi:10.34249/jse.2012.19.1.321 · Cited by 3
Merritt, T. A. (2017) · KU ScholarWorks (The University of Kansas)
Phosaly, L. (2018) · J. Willard Marriott Library · doi:10.26053/0h-f4ey-s2g0
Price, C. (2018) · ProQuest LLC eBooks
The Effects of a Peer-Delivered Writing Planning Intervention for Struggling Fifth Graders
Grünke, M. (2018) · World Journal of Education · doi:10.5430/wje.v8n6p157
“According to tentative benchmarks for interpreting Tau-U indices (Parker and Vannest 2009; Rakap 2015), this suggested a medium overall intervention effect.”
Methods for Effect Size Analysis of Single-subject Research Data in Art Therapy
Cho, Y., & 유경미 (2018) · 임상미술심리연구 · doi:10.34167/cliart.8.3.201812.1
Working Together: A Process to Support Teachers in Increasing Specific Praise Statements
Reynolds, J. L., Cochrane, W. S., Furey, W. M., & Matvichuk, T. A. (2019) · Intervention in School and Clinic · doi:10.1177/1053451219842260
“Additional indices are thoroughly discussed in other resources (see Parker & Vannest, 2009).”
BackgroundWood, T. J., & Wolgemuth, K. S. (2019) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2019_pers-sig19-2019-0014
Fachbeitrag: Entwicklung und Pilotierung einer arbeitsgedächtnissensiblen Mathematikförderung
Schulze, S., Kühl, J., & Breucker, T. (2020) · Vierteljahresschrift für Heilpädagogik und ihre Nachbargebiete · doi:10.2378/vhn2020.art10d
Howard, C. L., Wallace, C., Perry, B., & Stokić, D. S. (2020) · Prosthetics and Orthotics International · doi:10.1177/0309364620909049
Pitsch, H.-J. (2020) · Behindertenpädagogik · doi:10.30820/0341-7301-2020-2-118
Haya, H. D., Salazar, A. A., Garate-Navarro, M. A., García, J. R., & Martínez, M. (2020) · Revista de Investigación de Agroproducción Sustentable · doi:10.25127/aps.20201.510
Shelnut, J. (2020) · TigerPrints (Clemson University)
Vilas-Iglesias, M. S., & Caamaño-Alegre, J. (2020) · Anales del Sistema Sanitario de Navarra · doi:10.23938/assn.0926
Sallade, S. J. (2020) · Syracuse University Libraries (Syracuse University)
Training Preservice Mental Health Counselors for Suicide Assessment: A Multiple Baseline StudyPreprint
Bohrer, T., & Dykeman, C. (2019) · doi:10.31234/osf.io/dpj97
دنقل, ع. أ. أ. ا., & الحميد, ه. ج. ع. (2021) · المجلة المصرية للدراسات النفسية · doi:10.21608/ejcj.2021.182587
Davenport, M. (2021) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/88048
Donahue, E., & Dykeman, C. (2021) · doi:10.31234/osf.io/ja9q4
Teaching Preschool Teachers to Converse Productively with Children: A Single Case Design
Broderick, J. T., Sareh, N., & Aggrey, P. M.-B. (2022) · Early Childhood Education Journal · doi:10.1007/s10643-021-01284-0
“NAP is the percentage of non-overlapping data between the baseline and intervention (Parker & Vannest, 2009).”
BackgroundInfluentialBoendermaker, L., & Landman, E. (2022) · SAGE Open · doi:10.1177/21582440211069387
“As a rule of thumb, in this pilot we interpreted .65 as “meaningful” (Parker & Vannest, 2009).”
MethodAlternative methods of movement incorporation in middle school classrooms
Spring, K. E. (2019) · Mississippi State University · doi:10.54718/ttrj7126
“According to Parker and Vannest, values between 0 and 0.65, 0.66 to 0.92, and 0.93 to 1.00 are considered weak, moderate, and large effects, respectively (Parker & Vannest, 2009).”
BackgroundMethodInfluentialAsencio, M. A., Gea-García, G. M., García, J. P. F., & Antúnez, R. M. (2022) · Retos · doi:10.47197/retos.v45i0.91939
“As for the dispersion of the backhand strokes according to the NAP analysis, the results for Player 1 showed an overall reduction in the transverse axis, although the improvement was not significant.”
MethodInfluentialvan der Meer, L. A. J. (2012) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17000590 · Cited by 1
Social, R. D. I. D. P. Y. C. (2020) · Revista Digital Internacional de Psicología y Ciencia Social · doi:10.22402/j.rdipycs.unam.6.2.2020.327.245-526
Single-Case Design Interventions
Skierkiewicz, A., & Clark, R. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_9147-1
Single-Case Design Interventions
Skierkiewicz, A., & Clark, R. (2018) · Springer eBooks · doi:10.1007/978-3-319-57111-9_9147
(2020) · Revista Digital Internacional de Psicología y Ciencia Social · doi:10.22402/j.rdipycs.unam.6.2.2020
BOZKURT, N., KARABULUT, E., KOÇARSLAN, N., KORKMAZ, G. H., & Tekin-İftar, E. (2022) · Ankara Üniversitesi Eğitim Bilimleri Fakültesi Özel Eğitim Dergisi · doi:10.21565/ozelegitimdergisi.904902
Differentiating Academic Behaviors from Academic Skills to Inform Interventions
Preast, J. L., Taylor, C. N., Brann, K. L., Aguilar, L. N., Kilgus, S. P., & Burns, M. K. (2022) · Journal of Applied School Psychology · doi:10.1080/15377903.2022.2124571
“Based on Parker and Vannest (2009), a NAP of 0-0.65 is considered small, 0.66-0.92 is considered moderate, and 0.93-1.0 is considered large.”
BackgroundMethodInfluentialEficacia de la musicoterapia en un caso de duelo patológico
Martín, J. A. S., González, D. J. G., & Cahill, M. F. (2022) · Revista de Investigación en Musicoterapia · doi:10.15366/rim2022.6.003
Visuelle Inspektion und deskriptive Maße für die Einzelfallanalyse
Pospeschill, M. (2023) · Springer eBooks · doi:10.1007/978-3-662-64801-8_108-1
النجیم, م., بالبیــد, ر. ب. ع., & الجهنـــی, م. ب. س. (2023) · مجلة التربية الخاصة والتأهيل · doi:10.21608/sero.2023.288839
Lian, F., Wang, Y., & Qin, Y. (2023) · International Journal of Developmental Disabilities · doi:10.1080/20473869.2023.2190139
“A score from 0 to 0.65 was interpreted as minimal to no change, 0.66-0.92 as a moderate effect, and 0.93-1 as a strong effect (Parker and Vannest 2009).”
InfluentialCox, D. J., & Vladescu, J. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-99885-7.00006-4
Parent Coaching via Telepractice for Children From Latinx Backgrounds With Autism Spectrum DisorderPreprint
Yllades, V. A., Ganz, J. B., Wattanawongwan, S., Dunn, C. M., & Pierson, L. M. (2023) · doi:10.31219/osf.io/fg3yq
Watkins, L., & Bloomfield, B. S. (2022) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2023.2243294
“The authors also statistically analyzed the data using nonoverlap of all pairs (NAP; Parker & Vannest, 2009), a non-parametric effect size estimate suitable for single case design research.”
MethodRispoli, M. J., & Hollins, N. A. (2022) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2023.2252024
Evidence for generative learning through matrix training in individuals with autism
Goldstein, H. (2022) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2023.2252018
Peer-vermitteltes Unterrichten
Radley, K. C., & Dart, E. H. (2023) · Springer eBooks · doi:10.1007/978-3-031-42601-8_6
Rico, J. G. M., Morales, S. E. C., & Mandujano, J. L. (2023) · Revista Internacional de Investigación en Adicciones · doi:10.28931/riiad.2023.2.05 · Cited by 1
Metadata
- Authors
- Parker, R. I., & Vannest, K.
- Affiliations
- Texas A&M University (US)
- Corresponding author
- Parker, Richard I.
- ORCID
- Vannest, Kimberly
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2009-12
- Volume
- 40
- Issue
- 4
- Pages
- 357-367
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W2028628292
- Cited by
- 1,126
- References
- 65
- Citations by year
- 2026: 61 · 2025: 95 · 2024: 85 · 2023: 97 · 2022: 99 · 2021: 90 · 2020: 87 · 2019: 81 · 2018: 86 · 2017: 84 · 2016: 69 · 2015: 57 · 2014: 49 · 2013: 30 · 2012: 35
- FWCI
- 12.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behavior Therapy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- effect size, single subject research, data overlap, R-squared, visual assessment, confidence interval width, statistical power
- MeSH terms
- Humans, Models, Psychological, Probability, Psychology, Research Design, Confidence Intervals, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review